Tolt, LUCI, and the Lab Behind Vision Pro Wheelchair Control

Apple will ship iOS 27 and visionOS 27 on September 14 with AI VoiceOver upgrades and eye-driven wheelchair control on Vision Pro. The phone features are the volume play. The mobility feature depends on Tolt, LUCI, and a Northwestern software bridge.

On May 19 Apple previewed a suite of accessibility updates that fold Apple Intelligence into tools people already use, while keeping that work on the device. Tim Cook, Apple’s CEO, said the company was “bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design.” The line that changes a day for a smaller group sits further down the same release: Vision Pro will drive compatible power chairs by eye, at launch only in the United States, and only with Tolt and LUCI.

iOS 27 Puts Apple Intelligence Inside VoiceOver

Apple’s iOS 27 release notes list the VoiceOver, Magnifier, Accessibility Reader, and Voice Control work as part of the Monday software drop. Image Explorer will give richer descriptions of photographs, scanned bills, personal records, and other visuals. Live Recognition lets a VoiceOver user press the iPhone Action button, ask what the camera is seeing, and follow up in ordinary language. Magnifier gets the same visual help in a high-contrast layout, plus spoken app control with lines such as “zoom in” and “turn on flashlight.”

THE ROAD FROM MAY TO SEPTEMBER

1. May 19, 2026: Apple previews the accessibility suite two days before Global Accessibility Awareness Day on May 21, and puts the Hikawa Grip & Stand on the Apple Store worldwide in three new colors.
2. June 22, 2026: Northwestern Engineering says Project DRIVE software will sit between Vision Pro and the chair, and that Apple plans to launch the wider suite in September.
3. September 14, 2026: iOS 27 and visionOS 27 go to the public, with the AI reading and control tools in Apple’s iOS 27 notes and wheelchair support tied to visionOS.

Sarah Herrlinger, Apple’s senior director of Global Accessibility Policy and Initiatives, said the updates add “new, intuitive options for input, exploration, and personalization” and are “designed to protect users’ privacy at every step.” Image Explorer and Live Recognition extend accessibility AI as an operating system test, asking on-device models to describe a bill or a room without shipping that view to a server. Apple still warns, in the usual way, that generated descriptions are an aid, not a substitute for looking with a human when the stakes are high.

Tolt and LUCI Already Ran This Market

Eye-driven chairs did not start in Cupertino. Tolt Technologies, based in Duvall, Washington, already sells Ability Drive with Drive by Eye, a control interface that turns gaze on virtual buttons into movement for people who cannot use a joystick. Tolt lists U.S. patents 12,226,330 and 12,204,687 on that product. Its A13J is a lighter box for riders who do not already have a supported eye-gaze speech device, and the Ability Mount is built to hold that hardware while the chair is moving, then swing aside for transfers.

LUCI does a different job. It is a sensing and safety layer that bolts onto chairs from makers such as Permobil, Quantum, and Sunrise, watching for collisions, drop-offs, and unstable input. LUCI does not replace the joystick, the sip-and-puff, or the eye-gaze box. It sits between whatever the rider uses and the motors.

WHO DOES WHAT ON THE CHAIR

Apple’s launch pairing is therefore not a generic accessory list. Tolt is the input vendor that already treats eye gaze as a drive method. LUCI is the vendor that treats a missed glance as a crash risk. Vision Pro becomes another supported gaze device on that stack, talking over Bluetooth or a wired link, with Apple saying it will keep working with developers to add more drive systems.

The option to control my power wheelchair on my own is gold to me.

Pat Dolan, founder of GeoALS and Team Gleason patient advisory board member, Apple newsroom

Dolan has lived with ALS for 10 years. Blair Casey, Team Gleason’s CEO, called the Vision Pro tie-in “a huge step forward” after a decade of watching eye-driven chairs improve in smaller, clinical steps. Team Gleason’s backing is the social proof Apple wanted next to a headset that most buyers still treat as a media device.

A Chicago Lab Built the Bridge Apple Used

The missing piece was not another camera. It was a way for a consumer headset to talk to chair electronics that were never designed for a $3,000-class spatial computer. Northwestern’s Project DRIVE, led by Brenna Argall, a professor of computer science and mechanical engineering who also directs the Assistive and Rehabilitation Robotics Lab at Shirley Ryan AbilityLab, has been building that pipe since 2023. The lab’s open Wheelchair Digital Interface is meant so eye tracking, head arrays, sip-and-puff, switches, and even brain-computer interfaces can address the same chair. Northwestern says Apple used that work rather than writing a wheelchair-control system from scratch. DRIVE software translates eye movements into signals the chair already understands.

Often, as a person’s motor impairment increases in severity, their ability to operate the very machines designed to assist them decreases.

Brenna Argall, principal investigator, Project DRIVE, Northwestern Engineering

Argall’s second point is the one that should follow every demo video. Many people with severe mobility loss cannot keep a joystick, and some cannot keep a reliable sip-and-puff seal either. Gaze is residual movement they still have. NSF funding sits under that lab work, and LUCI and LifeDrive Mobility LLC are named partners on the interface. Seeing it land inside visionOS is the rare case of an academic API showing up in a consumer settings pane.

A glance now can help drive a wheelchair.

Northwestern’s Project DRIVE—led by Professor Brenna Argall—developed software that helps turn eye movements into wheelchair commands. It’s part of a new Apple Vision Pro accessibility feature. @northwesterncshttps://t.co/VWqOcnc8Ho pic.twitter.com/yvMmNwusXQ

— Northwestern Engineering (@NorthwesternEng) June 26, 2026

That is also why the AI branding on the May 19 release is a poor map of this feature. Wheelchair control uses Vision Pro’s existing eye-tracking cameras, the same ones that already move a cursor in visionOS. Apple Intelligence writes the VoiceOver paragraphs. The chair moves because a lab, two drive vendors, and a headset already built for gaze agreed on a cable.

Why a Safety Layer Has to Sit Between Gaze and Motors

Driving by eye is unforgiving in a way that tapping an icon is not. A glance that is a little long becomes a turn. A blink can be a stop, or it can be a gap in command. Tolt’s own Drive by Eye design already treats looking at a stop control, looking away, or closing the eyes as a halt. Apple says Vision Pro eye tracking does not need frequent recalibration and holds up in mixed light, which is the claim that matters outdoors and under clinic fluorescents. It still does not make a headset a bumper.

LUCI’s product notes describe a sensor mix of stereo cameras, radar, and ultrasonics that scans the scene ten times per second. Coverage is listed as 15 feet in front of the chair and 3-4 feet on the sides and the back, with software that slows and then stops when it sees a collision object or an unsafe drop. Apple’s release says the Vision Pro feature also integrates with LUCI-enabled chairs that watch for dynamic obstacles and sudden drop-offs. That sentence is doing safety work, not marketing work. An eye-tracking driver who looks at a doorway too long still needs something else to refuse the stairs.

The United States-only start, and the two-vendor list, are the other limits hiding under the demo. Most power chairs in the world will not take this input on September 14. Riders who already paid for a Tobii, Smartbox, or other gaze speech device may stay on Tolt’s older supported-camera list rather than add a headset. Apple has not published a public map of how a look becomes forward, reverse, yaw, and emergency stop, which is the documentation clinicians will want before they write a funding letter.

Say What You See When Labels Are Missing

The feature that will actually touch the most people on September 14 is quieter than a chair. Voice Control, with Apple Intelligence, will take natural-language descriptions of on-screen controls instead of forcing someone to memorize overlay numbers or exact button names. Apple’s own examples are “tap the purple folder” and “tap the guide about best restaurants.” That helps in Maps and Files, and it also helps when an app ships without proper accessibility labels, which is still a common failure.

Accessibility Reader is the other large-surface change. It is a custom reading view for dyslexia, low vision, and related needs, and the new version is built for scientific articles, multi-column layouts, images, and tables. On-demand summaries sit on top of that, and built-in translation keeps the reader’s font, colors, and formatting while switching language. Generated subtitles, run with on-device speech recognition, fill in spoken audio when a clip has no captions, including home videos, family shares, and uncaptioned streams, on iPhone, iPad, Mac, Apple TV, and Vision Pro. Appearance is adjustable in playback settings.

Those are the Apple Intelligence items. They are also the items that will be judged in a week the way VoiceOver users always judge a release: does the description of a receipt include the due date, or does it hallucinate a logo? On-device processing is the privacy argument. Accuracy is the one that decides whether someone trusts it at a pharmacy counter.

Subtitles, Reader, and the Rest of the Kit

The May 19 list did not stop at reading and chairs. Several items are hardware or protocol work that has nothing to do with a language model, and they are easy to skip if the coverage stays on VoiceOver.

THE REST OF THE MAY 19 KIT

• Vehicle Motion Cues: The dots-and-dots aid that already exists on iPhone comes to visionOS for people who wear Vision Pro as a passenger.
• Face gestures and Dwell Control: visionOS adds face gestures for taps and system actions, and Dwell Control can confirm a choice by glancing up at a marker instead of waiting out a timer.
• Hearing aids and larger TV text: Made for iPhone hearing aids get more reliable pairing and handoff across iOS, iPadOS, macOS, and visionOS, and tvOS gains larger text in menus.
• Name Recognition: Alerts for people who are deaf or hard of hearing when someone says their name expand to more than 50 languages.
• FaceTime interpreter API: Sign language interpretation apps can add a human interpreter to a live FaceTime call.
• Sony Access controller: iOS, iPadOS, and macOS gain support for the Access controller’s thumbstick, nine built-in buttons, up to four extra switches, and two-controller pairing.
• Hikawa Grip & Stand: Bailey Hikawa’s MagSafe grip, made with PopSockets, went on sale worldwide on May 19 in three new colors after a limited 2025 run.

Hikawa, a Los Angeles designer, said Apple’s habit of bringing disabled users in at the start of a project “has been the driving force” of the grip. It is the one item on the list that did not wait for September 14. The Sony Access work is the gaming parallel to Tolt: Apple is not inventing the controller, it is letting a specialty input that already exists talk to the OS.

A Headset Is Still a Heavy Way to Drive

The practical objection is not that eye drive is a gimmick. Tolt has been selling that idea for years, usually with a tablet on a mount about 18 inches from the face, which leaves the rider visible in a room. Vision Pro covers the eyes with a ski-goggle shell. Pass-through video can be excellent and still make conversation with a caregiver, a clerk, or a child feel like talking to a visor. Until this stack lives in glasses, it is a clinic and home tool more than an all-day street tool, and that is before battery, weight, and sweat.

WHAT WE KNOW

• The date: iOS 27 ships September 14, and Apple lists visionOS 27 available starting September 14.
• The first chairs: Wheelchair control launches in the United States with Tolt and LUCI, over Bluetooth or a wired connection.
• The AI tools: VoiceOver, Magnifier, Accessibility Reader, Voice Control, and on-device subtitles are in Apple’s iOS 27 notes for the same drop.

WHAT IS UNCONFIRMED

• The control map: Apple has not published a full public chart of how gaze becomes throttle, steer, and stop.
• The next vendors: Extra drive systems and countries have no dates.
• All-day use: There is no independent wear study yet on driving with the headset in mixed weather, crowds, or long community routes.

Monday’s download will make VoiceOver talk in fuller sentences on phones that already live in pockets. The chair feature will matter to the people Tolt, LUCI, Argall’s lab, and Team Gleason already serve, if a compatible drive system is on the chair, if a Vision Pro is funded, and if the safety layer is on. Apple can add vendors after that. The partners who already own the motors will decide how far the eyes actually go.