Guided Vision in Gemini Live: built for accessibility
Today, we’re launching Guided Vision in Gemini Live across compatible Android devices — bringing voice-forward, real-time visual interpretation to people who are blind, have low vision, or want intuitive visual assistance.
Technology is most powerful when it opens up the world for everyone, and Guided Vision turns Gemini into a conversational visual partner. Guided Vision was developed through close collaboration with the accessibility community. We previewed it earlier this month, among other tools to expand digital and physical accessibility across Android,
To train Gemini Live for conversational, real-world context, we partnered with Aira to visually interpret data for a total of tens of thousands of hours. More than 1,000 members of Aira’s Trusted Tester network helped stress-test and refine the model across daily routines, while Aira specialists worked directly with our teams as subject-matter experts to help establish and evaluate our safety guardrails.
Now, you can simply share your camera during a Gemini Live session to hear clear descriptions of your surroundings, ask detailed follow-up questions, and receive proactive, spoken cues to center whatever you want to explore.
Real-time visual assistance designed for how you experience the world
When you share your camera in Gemini Live with Guided Vision turned on, Gemini acts as a conversational partner. If your camera is pointed too high, too close, or slightly off to the side, Gemini provides natural verbal prompts to help you reframe — asking you to pan slowly to the right, tilt downward, or step back so it can get the clear visual context needed to answer your questions.
Everyday moments made simple
Whether locating objects, preparing a meal, or picking an outfit, Guided Vision supports everyday tasks where quick visual verification matters most:
- Reading fine print and complex text: Read small nutrition labels on food packages, decipher appliance dials and washing machine cycles, or read printed menus in dimly lit restaurants.
- Finding and localizing objects: Search your immediate area for everyday items, such as finding a dropped earbud on the floor or locating the black pepper inside a crowded spice cabinet.
- Describing objects and matching details: Ask about colors, patterns, and shapes — such as checking whether a striped shirt pairs with a pair of trousers or identifying the color of a specific jacket.
- Exploring your immediate environment: Get descriptive overviews of unfamiliar spaces, room layouts, or objects placed across a table.
- Conversing naturally in your preferred language: Guided Vision supports conversations across multiple languages. It reflects extensive testing and feedback from blind and low-vision communities across India, Brazil, Singapore, Indonesia, Japan, and more to make descriptions, reframing cues, and answers feel natural and helpful.
Like many accessibility innovations, Guided Vision also provides practical visual assistance for older adults, individuals with low literacy, or anyone trying to read fine print in low lighting.
Quick access across Android
Guided Vision is designed to fit seamlessly into daily routines with minimal friction:
- Gemini App: Open your profile settings in the Gemini mobile app and switch on Use Guided Vision in Live. From there, open Gemini Live and tap to share your camera.
- Accessibility Shortcuts: Under Android Settings > Accessibility > Vision assistance > Guided Vision, configure an Accessibility shortcut to launch Guided Vision using the floating accessibility button, a two-finger swipe gesture, or by pressing both volume keys.
- TalkBack Integration: Users running Google TalkBack can bring up the TalkBack menu with a three-finger tap and select Guided Vision directly.
As with any generative AI technology, Guided Vision is an assistive utility and can make mistakes. It is not a medical device, mobility aid, or white cane replacement, and it’s not intended for navigation, safe-travel guidance, or obstacle detection. Users should continue relying on established mobility aids and safe-travel practices in physical environments.
Guided Vision is now available on Android devices running Android 9 and above in regions and languages where Gemini Live is supported. Make sure your Gemini app and Android system software are updated to the latest versions to get started.
