Android's screen reader can now answer questions about images

Google News

Android's screen reader can now answer questions about images
Screen Reader
  • 📰 engadget
  • ⏱ Reading Time:
  • 80 sec. here
  • 4 min. at publisher
  • 📊 Quality Score:
  • News: 38%
  • Publisher: 63%

After double majoring in unemployment (English and Art History), Igor’s career prospects were, to say the least, limited. It was either become a teacher or a writer. Thankfully, he went with the latter.

, and, as in years past, many tech companies are marking the occasion with the announcement of new assistive features for their ecosystems.on Tuesday, and now Google is joining in on the parade. To start, the company has made TalkBack, Android's built-in screen reader , more useful.

With the help of one of Google's Gemini models, TalkBack can now answer questions about images displayed on your phone, even they don't have any alt text describing them. "That means the next time a friend texts you a photo of their new guitar, you can get a description and ask follow-up questions about the make and color, or even what else is in the image," explains Google. The fact Gemini can see and understand the image is thanks to the multi-modal capabilities Google built into the model. Additionally, the Q&A functionality works across the entire screen. So, for example, say you're doing some online shopping, you can first ask your phone to describe the color of the piece of clothing you're interested in and then ask if it's on sale., the feature generates subtitles that attempt to capture the emotion of what’s being said. For instance, if you're video chatting with some friends and one of them groans after you make a lame joke, your phone will not only subtitle what they said but it will also include "" in the transcription. With the new version of Expressive Captions, the resulting subtitles will reflect when someone drags out the sound of their words. That means the next time you're watching a live soccer match and the announcer yells "goallllllll," their excitement will be properly transcribed. Plus, there will be more labels now for sounds like when someone is clearing their throat. The new version of Expressive Captions is rolling out to English-speaking users in the US, UK, Canada and Australia running Android 15 and above on their phones.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

engadget /  🏆 276. in US

Screen Reader

 

United States Latest News, United States Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

This powerful anti-theft feature is finally coming to more Android phones with Android 16This powerful anti-theft feature is finally coming to more Android phones with Android 16Aleksandar is a tech enthusiast with a broad range of interests, from smartphones to space exploration. His curiosity extends to hands-on DIY experiments with his gadgets, and he enjoys switching between different brands to experience the latest innovations.
Read more »

Jacksonville’s Mandarin Art Festival brings art, community spirit back for EasterJacksonville’s Mandarin Art Festival brings art, community spirit back for EasterA Jacksonville Easter tradition returned this weekend in Duval County, delighting locals with art and community spirit.
Read more »

Salt Lake Valley art students show their talents in 'art scholar competition'Salt Lake Valley art students show their talents in 'art scholar competition'Darienne is from Draper, Utah and is so excited to start her broadcast journalism career in her home state!
Read more »

Latest Android distribution numbers once again show us the problem with AndroidLatest Android distribution numbers once again show us the problem with AndroidAlan, an ardent smartphone enthusiast and a veteran writer at PhoneArena since 2009, has witnessed and chronicled the transformative years of mobile technology. Owning iconic phones from the original iPhone to the iPhone 15 Pro Max, he has seen smartphones evolve into a global phenomenon.
Read more »

Google I/O 2025: What to expect from Android 16, Android XR and GeminiGoogle I/O 2025: What to expect from Android 16, Android XR and GeminiAfter double majoring in unemployment (English and Art History), Igor’s career prospects were, to say the least, limited. It was either become a teacher or a writer. Thankfully, he went with the latter.
Read more »

From Android 1.0 to Android 16: How Google’s mobile OS has evolved since 2008From Android 1.0 to Android 16: How Google’s mobile OS has evolved since 2008With Google I/O 2025 streaming next week, we're taking a walk through the complete history of Android, from its humble beginnings in 2008 to today, with Android 16 on the way.
Read more »



Render Time: 2026-04-01 05:35:16