The Wire
TechnologyArtificial IntelligenceScience & Health

Google schedules Gemini Live visual assistance for Android

Google schedules Gemini Live visual assistance for Android
Photo: theverge.com

Google scheduled Guided Vision's Android rollout for October 1, 2026.

Why it matters: Guided Vision adds real-time visual assistance to Gemini Live, including spoken descriptions of text, objects and surroundings. Its usefulness will depend on accuracy, availability and users' understanding of its safety and privacy limits.

  • Google says the scheduled rollout begins October 1, 2026, on Android 9 or later.
  • Users can share their camera for spoken descriptions of text, objects, colors, patterns and surroundings.
  • Google says Aira's Trusted Tester network contributed more than 1,000 testers.
  • Google warns Guided Vision is not a navigation tool, obstacle detector, mobility aid or cane replacement.

Google announced Guided Vision in Gemini Live, with the Android rollout scheduled to begin October 1, 2026. Gemini Live is Google's conversational assistant experience; Guided Vision adds camera-based visual assistance to it.

Users can share their phone camera during a Gemini Live conversation and receive spoken descriptions of objects, text and surroundings. The feature can read fine print and complex text, identify or locate objects, describe colors, shapes and patterns, and provide overviews of rooms. The Verge reported that users can ask follow-up questions, such as requesting an expiration date after Gemini locates an item.

Gemini can also ask users to pan, tilt or step back to improve the camera view. Guided Vision can be activated through the Gemini app, Android accessibility shortcuts or the TalkBack menu, an accessibility control menu used with Android's screen reader.

Google says it developed the feature with blind and low-vision communities and partnered with Aira. The company says Aira's Trusted Tester network contributed more than 1,000 testers, and that Gemini Live was trained using tens of thousands of hours of visual interpretation data.

Google describes the scheduled rollout as covering compatible Android devices running Android 9 or later, in regions and languages where Gemini Live is supported. Its announcement does not specify a complete device list, account requirements, countries or supported languages, so Android 9 or later alone should not be treated as sufficient eligibility.

Google's privacy documentation says Live audio, video and screen shares are not used to improve its services by default. The linked documentation does not, in the materials reviewed here, provide the separate retention, human-review or transcript-handling details needed to assess those issues.

The caveat: Google says Guided Vision can make mistakes and is not a medical device, mobility aid, cane replacement, navigation tool or obstacle detector. Object identification or location should not be treated as reliable mobility assistance.

By the numbers

  • October 1, 2026 - Google says the scheduled start date for the Android rollout.
  • More than 1,000 testers - Google says this was the contribution from Aira's Trusted Tester network.
  • Tens of thousands of hours - Google says this is the amount of visual interpretation data used to train Gemini Live; it did not disclose a more precise figure or methodology in the supplied materials.

Yes, but: The feature is not a substitute for navigation or mobility assistance, and Google has not published complete device, account, country or language eligibility details.

What's next: Google's scheduled rollout is set to begin October 1, 2026. The company may need to provide more specific device, account, country and language requirements before launch.

Based on reporting from

  • The Verge

See how this story touches your network - open The Wire in Jane.

Open in Jane