Google has rolled out a new accessibility tool called Guided Vision to its Gemini Live service, launching today on compatible Android devices. The feature leverages artificial intelligence to provide real-time audio descriptions of whatever the user points their phone’s camera at.
By sharing the camera feed within the Gemini Live interface, users can ask Google’s AI to assist with a variety of tasks. These include reading fine print, describing the user’s immediate environment, locating or identifying objects, and detailing specific items in view.
The functionality mirrors Apple’s VoiceOver Live Recognition, recently introduced on the iPhone and Vision Pro. It is primarily designed to support individuals who are blind or have low vision, though it may also aid anyone needing assistance in specific visual situations.
While the feature is integrated into the Gemini app, it is also accessible through other Google platforms, expanding its reach beyond the primary application.
It’s about time we saw more AI used for good in accessibility. Real-time descriptions sound incredibly useful for navigating unfamiliar places.
Small print is such a headache for everyone, not just visually impaired users. This might actually come in handy for me too occasionally.
Does this work well with low-light conditions? I’m curious how the AI handles reading small text in darker environments.
Wait, isn’t this basically copying Apple’s VoiceOver Live? Why did it take so long for Google to catch up to this feature set?
This is a game-changer for independence. Finally, another solid accessibility tool from Google helping the blind community navigate daily life.