Apple has announced new accessibility features that are likely to be released with iOS 18 and iPadOS 18 later this year, reaffirming its commitment to inclusivity and innovative design. Leveraging cutting-edge advancements in hardware and software, particularly in artificial intelligence and machine learning, Apple aims to provide enhanced user experiences for individuals with disabilities.
New Features for iOS 18 Revealed by Apple
Eye Tracking for iPad and iPhone
One of the most anticipated features, Eye Tracking, enables physically disabled users to control their devices solely with their eyes. This feature utilizes the front camera for setup and calibration, with all data stored on the device to ensure privacy. Eye Tracking is compatible with iOS and iPadOS applications, working seamlessly with functions like physical button activation and motion control.
Music Haptics for Hearing-Impaired Individuals
Music Haptics introduces a new dimension to the music experience for hearing-impaired users. Leveraging the Taptic Engine, this feature transforms sound into tactile feedback, providing a sensory experience through taps, textures, and refined vibrations. Integrated with Apple Music, Music Haptics will also be offered as an API for developers to enhance their applications.
Innovations in Speech and Communication
With Vocal Shortcuts, users can assign specific sounds recognized by Siri to perform tasks and initiate shortcuts. Additionally, the Unusual Speech Listening feature enhances speech recognition capabilities for users with conditions affecting speech, such as cerebral palsy or ALS, offering support beyond previous efforts.
Vehicle Motion Cues to Reduce Motion Sickness
Vehicle Motion Cues aim to reduce motion sickness by aligning animated dots on the screen with vehicle movements. This feature utilizes built-in sensors to detect when the user is in a moving vehicle, providing visual cues that reduce sensory conflict without interrupting the main content.
Enhancements to CarPlay and visionOS
CarPlay gains accessibility improvements with features like Voice Control, Color Filters, and Speech Recognition to cater to users with diverse needs. Meanwhile, visionOS introduces Live Captions, enhanced support for hearing aids made for iPhone, and other visual accessibility features.
Additional Updates and Features
VoiceOver: New voices, customizable keyboard shortcuts, and flexible Voice Rotator. Magnifier: Quick launch of Reader Mode and Motion Detection Mode. Braille Support: Enhanced Braille Display Input, multi-line braille support, and more. Personal Voice: Now available in Mandarin Chinese. Live Speech: Improved compatibility with Categories and Live Captions. AssistiveTouch: Virtual Touch Surface added for device control. Key Control: Finger gesture recognition capabilities. Voice Control: Support for custom word dictionaries and complex words.
Apple is expected to enhance all these features with artificial intelligence through its partnership with OpenAI and elevate them to the level of AGI at the WWDC event scheduled for June.
