All eyes are on Apple's WWDC event next month. That's when the company will no doubt show off their latest operating system upgrades, including its late-to-the-party AI plans for iOS and macOS.
But AI doesn't just mean generative AI. Apple has more traditional features in the works for users to check out, some simply powered by AI. And as it happens, we just got a glimpse at a slew of upcoming iPhone and Mac features that fit that mold, specifically related to accessibility.
Apple unexpectedly announced a batch of these new accessibility features Wednesday. The company says these features are coming "later this year," which almost assuredly means they're shipping with iOS 18. Apple switches between using the language "AI" and "machine learning" to describe how these features work, but rest assured, the underlying tech is part of Apple's AI push this year.
Out of nowhere, Apple announced that both iPhone and iPad users will soon have the ability to control their devices with just their eyes. Apple says the front camera on either your phone or tablet will use AI to calibrate and set up the feature, as well as power it. Most impressive of all, you don't need any additional hardware to use it.
Once Eye Tracking is set up, you can navigate apps, use Dwell Controls to engage with elements, and replicate physical buttons, swipes, and gestures with your eye movements.
Apple added a new music feature for users who are deaf or hard of hearing: Music Haptics uses the Taptic Engine to play taps and complex vibrations along to the beat of the song. While it sounds like a great accessibility feature, it also seems like a great way to enhance the Apple Music experience for everyone. This feature works on "millions" of songs in Apple Music, but Apple has also included it as an API for developers to add to their apps.
Vocal Shortcuts is a new feature that lets you assign actions to words or phrases. For example, you could set the word "Rings" to open your Apple Watch Activity Rings in Fitness. In addition, Listen for Atypical Speech uses on-device AI to learn your speech patterns, so your device will recognize the way you speak.
These features are designed for users with conditions such as cerebral palsy, amyotrophic lateral sclerosis (ALS), or stroke—as these conditions affect speech.
Apple wants to cure motion sickness. Vehicle Motion Cues places dots on your screen when your iPhone or iPad recognizes you're in a moving car. These dots will then move according to the direction of the vehicle: These moving dots may counter the effects of motion sickness, as Apple says research shows motion sickness happens when there's a conflict between what you're seeing and what you're feeling.
You can choose to have these Motion Cues appear automatically, or enable them manually from Control Center.
Speaking of cars, CarPlay is getting a series of new accessibility features: Voice Control, which lets you control CarPlay with your voice; Color Filters, which lets you fine tune the color space of your CarPlay UI; and Sound Recognition, CarPlay will let you know when it detects sounds like car horns and sirens.
Remember Apple Vision Pro? That's still around, even if it isn't getting much attention lately. Still, Apple is working on some visionOS accessibility features, including Live Captions. These captions will work in conversations in-person and on FaceTime, as well as from audio in your apps. Apple is also adding new vision features like Reduce Transparency, Smart Invert, and Dim Flashing Lights, as well as support for Made for iPhone hearing devices and cochlear hearing processors.
VoiceOver is getting new voices. Apple didn't say how many, or what they sounded like, but they're coming. In addition, the feature is getting a "flexible Voice Rotor," which lets you control how VoiceOver works, custom volume control, customizable VoiceOver keyboard shortcuts on macOS, and support for custom vocabularies and complicated words.
Apple's Magnifier doesn't get the love it deserves, but it is getting some new features. Coming soon, you'll get a new Reader Mode, as well as quick ways to launch Detection Mode with the Action button on iPhone 15 Pro.
There are some new Braille features as well: You'll have a new way to start and stay in Braille Screen Input, Japanese will be available, Dot Pad users have support for multi-line braille, and you'll have the ability to choose input and output tables.
Hover Typing is a new feature that increases the size of the text whenever you're typing in a text field. Plus, you get to control the font and color.
Apple rolled out Personal Voice last year, an AI-powered feature that can replicate your voice during Live Speech. The feature is now available in Mandarin Chinese. In addition, you can now create a Personal Voice even if you have difficulty with reading full sentences out loud.
Speaking of Live Speech, the feature now comes with categories, and is compatible with Live Captions.
Apple is adding a virtual trackpad feature as part of AssistiveTouch, so one area of your iPhone or iPad can be used to move a cursor around the screen. I could see this being useful for anyone who wants a trackpad experience, especially on the larger iPads, but doesn't have a physical trackpad to use.
With Switch Control later this year, you can use your iPhone or iPads' camera to recognize finger-tap gestures as switches. Switch Control lets you use hardware to control your iPhone or iPad with switches, so this means you can gesture with your fingers in view of the camera to control on-screen elements.
One of the most under-appreciated Mac features is the services menu, which you can find by right-clicking just about anything—highlighted text, say, o
"AI for the rest of us." That's how Apple advertises Apple Intelligence on its website, the company's upcoming generative AI experience. The problem i
1Password just got a major update with lots of new features, finally adding a way for you to recover your account even if you forget your master passw
Working on a Mac is like a dance. You're always collecting files, documents, or links. You're saving them here, dragging them there, finding new sourc
After an underwhelming launch in June, Microsoft is retooling Copilot and Copilot+ to make it match up to its competitors a bit more. It's a mixed bag
Over the last 10 years, Hisense, a brand that has never had as much recognition as say, Sony or Panasonic, has been forming a growing community of dev
We are a dynamic information platform dedicated to delivering timely, relevant, and reliable content across a broad spectrum of topics. From the latest in technology and business to lifestyle, health, and global affairs, we aim to keep our readers informed and inspired.
Our editorial team is committed to maintaining high standards of accuracy and clarity, ensuring that every article provides value and context in an ever-changing world. We believe in the importance of accessible knowledge and strive to make complex topics understandable for everyone.
Whether you're here to stay updated on current events, explore thought-provoking features, or simply learn something new, our goal is to offer a trustworthy source of information that meets the needs of a diverse and curious audience.