At MWC 2025, Google confirmed that its experimental Project Astra assistant will roll out widely in March. It seems the feature has started reaching out to users, albeit in a phased manner, beginning with Android smartphones.
On Reddit, one user shared a demo video that shows a new “Share Screen With Live” option when the Gemini Assistant is summoned. Moreover, the Gemini Live interface also received two new options for live video and screen sharing.
Google has also confirmed to The Verge that the aforementioned features are now on the rollout trajectory. So far, Gemini has only been capable of contextual on-screen awareness courtesy of the “Ask about screen” feature.
In case you aren’t familiar, Project Astra is the most futuristic iteration of an AI that can understand text, audio, picture, video, and live camera feed in real-time. Google Deepmind’s research director, Greg Wayne, likened it to a “little parrot on your shoulder that’s hanging out with you and talking to you about the world.”
When you summon Gemini and enable the Share Screen With Live option in any app, it will analyze the on-screen content and will answer queries based on it. For example, users can ask it to describe the current activity happening in an app, break down or summarize any article they were reading, or talk to them about the scene during video playback.
The more impressive capability is the world understanding system. When you switch to the Live mode for Gemini, it now shows a video feed option that opens the camera. In this mode, if you point your camera at any object, Gemini will be able to see, comprehend, and answer questions based on what it sees.
Pointing the camera at a book passage, asking Gemini to tell more about a monument, getting advice on decor, or solving problems written on a board or book — Gemini Live’s Project Astra upgrade can do it all. It is not too different from Apple’s Visual Intelligence on iPhones, or the open-source HuggingSnap app that promises an offline world-understanding AI.
Digital Trends got a demo of Project Astra at MWC earlier this year, getting an early taste of a massively upgraded AI assistant experience on smartphones. It is worth pointing out that Gemini Live’s Project Astra upgrade will be limited to customers who pay for a Gemini Advanced subscription.
It seems the scale of this Project Astra update rollout isn’t too wide at the moment. I have a Gemini Advanced subscription via Google One AI Premium bundle, but don’t see it yet on any of my Pixel phones running the latest stable version of Android 15 or the beta build of Android 16.
“If you’re not paying for the product, you are the product.” Bogdan Onikiienko, an engineer at MacPaw, dropped that hard-hitting quote on me after usi
Artificial intelligence brands are in fierce competition, and their next steps are to make AI tools smarter by allowing them to execute deep search fu
Although the entire AI boom was triggered by just one ChatGPT model, a lot has changed since 2022. New models have been released, old models have been
Everyone’s heard the expression, “Politeness costs nothing,” but with the advent of AI chatbots, it may have to be revised.Just recently, someone on X
ChatGPT didn’t just emerge onto the AI scene, it birthed an entire revolution of AI assistants and agents and made them accessible to consumers who we
Apple has lately focused on giving the AirPods more of a wellness-focused makeover than hawking them as plain wireless earbuds. Late last year, the Ai
OpenAI has released its latest model, o1-pro, an updated version of its reasoning model o1 — but it’s not going to come cheap.“It uses more compute th
Pixabay / PexelsGoogle will continue to go all in on AI in 2025, CEO Sundar Pichai announced during the company’s Q4 earnings call Wednesday. Alphabet
We are a comprehensive and trusted information platform dedicated to delivering high-quality content across a wide range of topics, including society, technology, business, health, culture, and entertainment.
From breaking news to in-depth reports, we adhere to the principles of accuracy and diverse perspectives, helping readers find clarity and reliability in today’s fast-paced information landscape.
Our goal is to be a dependable source of knowledge for every reader—making information not only accessible but truly trustworthy. Looking ahead, we will continue to enhance our content and services, connecting the world and delivering value.
