Apple has announced several new accessibility features powered by Apple Intelligence, just one day before Google’s annual developer conference. The updates target VoiceOver, voice control, live recognition, and real-time caption generation for videos.
The timing appears deliberate. Both tech giants have made accessibility a competitive battleground, with each company working to prove its AI technology can better serve users with disabilities. Apple’s announcement also comes as the company faces increased scrutiny over the pace of its artificial intelligence rollout compared to rivals.
Apple Intelligence will make VoiceOver’s image recognition much more detailed. The feature can now look at a bill and read out specific information like the amount due and payment date. It can also provide richer descriptions of photographs and personal documents.
iPhone users can now activate Live Recognition through the camera to identify content in real time. The feature lets users ask follow-up questions about what they see. People with low vision can assign Magnifier to the action button for quick access to a high-contrast interface. Voice commands like “zoom in” or “turn on flashlight” control the app’s features.
Voice control improvements extend beyond the Magnifier app. Users can describe tasks in natural language to control what appears on screen. In Apple Maps, they might say “tap the guide about best restaurants,” or in Files, “tap the purple folder.”
The company is updating Reader to handle complex documents with multiple columns, images, and tables like scientific papers. Users can get AI-powered summaries or read text in their preferred language while keeping custom fonts and colors. Apple says the updated reader works for people with dyslexia and low vision.
Apple is adding AI-generated subtitles for videos without existing captions. This includes iPhone recordings and videos shared by friends and family. The generated subtitles work across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro with customizable appearance options.
Vision Pro users will be able to control compatible wheelchairs using eye tracking. Apple says the feature works in different lighting conditions without needing recalibration. The capability launches with Tolt and LUCI alternative drive systems in the U.S., supporting both Bluetooth and wired connections.
Other updates include:
- Name recognition for hearing disabilities now supports 50 languages
- Large text support comes to tvOS
- Better handoff between devices for Made for iPhone hearing aids
These features will arrive later this year, likely as part of iOS 27. The accessibility focus shows how AI competition has moved beyond basic features to specialized applications that serve underrepresented users. For Apple, it’s also a chance to demonstrate practical uses for Apple Intelligence beyond writing assistance and photo editing.
