UPDATE: 2025/05/05 15:01 EST BY KARANDEEP SINGH OBEROI
Live for AI Mode has been enabled
It appears as though Live’s camera search integration with AI Mode is closer than previously anticipated. The folks over at Android Authority were able to manually enable the feature. Here’s what it will look like once available widely.
Summary
- Google is developing a new “Live for AI Mode” feature, discovered in the latest Google app beta, which aims to bring real-time voice conversation capabilities, similar to Gemini Live’s Project Astra, to AI Mode for enhanced search.
- This potential integration builds upon AI Mode’s existing visual identification features (powered by Google Lens) and the recent move to make both AI Mode and Gemini Live’s screen/video sharing functionalities free for all users.
- Code strings suggest that “Live for AI Mode” will be accessible within Google Lens, offering features like voice search initiation, volume control, response interruption, screen/video sharing, and a transcript with web links, pointing towards a more interactive and conversational search experience.
Google’s Project Astra, which is essentially the formal name given to Gemini Live’s ability to gather on-screen and camera-view context, was previously locked behind the Gemini Advanced paywall.
The feature went completely free-to-use last month, and has since become widely available on all compatible Android devices.
In similar vein, Google’s new AI Mode, too, was initially paywalled, before it lost its Gemini One AI Premium exclusivity — and subsequently its waitlist too (US only). Now, Google might just be working on integrating the two ‘newly-freed-up’ features together by bringing Live’s Project Astra capabilities to AI Mode.
For reference, this isn’t the first ‘visual identification’ feature to make its way to AI Mode. Early in April, AI Mode became privy to Google Lens’ secret sauce, allowing users to gain a deeper understanding of their visual search.
Related
Google’s AI Mode gains popular camera search as rollout expands to more users
Google AI Mode unlocks new senses
Now, with the potential ‘Live for AI Mode’ feature expected to be in development, as highlighted by the folks at 9to5Google, users can look forward to a more conversational AI Mode visual search experience.
Hints surrounding the feature’s arrival were found in the latest Google app beta (version 16.17), suggesting that Live functionality, at least in AI Mode, will reside within Google Lens.
Live in AI Mode will offer transcripts too
</string>=”lens_live_onboarding_title”>Start speaking to search</string>
<string name=”lens_live_volume_error_subtitle”>To start searching and hear results, raise the volume on your device</string>
<string name=”lens_live_wave_tap_view_description”>Tap to interrupt response playback.</string>
<string name=”lens_live_web_corroborations_termination_message”>”It’s not possible to ask a follow up question. Your next question will start a new search.”</string>
Users will have the option to run Live search with or without their microphone enabled. In addition to camera view, users will also be able to share their screen with AI Mode, as indicated by “Screencast” and “Video” references in the code strings.
Further, similar to a regular Gemini Live session, AI Mode will return a transcript, complete with relevant links, allowing you to revisit your conversation with the AI tool. Other strings also indicate the presence of a peristent notification to indicate a Live session, dedicated mute/unmute buttons, and buttons to enable/disable video.
It’s not entirely clear when the feature might land, but considering how both AI Mode and Gemini Live screen/video sharing are now free for all, integrating the two services seems like the logical next step for Google.
<string name=”lens_live_coachmark_ecosystem”>Tap links to explore the web while you chat<string name
<string name=”lens_live_coachmark_transcript”>Tap \\”transcript\\” to read your conversations<string name
