Get the newsletter
Apple · AR / VR · Filed Apr 2, 2026 · USPTO published Aug 13, 2026 · Aug 13 release

Apple Patents a Way to Control Nearby Devices Just by Looking at Them

Apple has filed a patent for a system that figures out which device you want to control by tracking where you're looking, then sends the command to that device automatically, no tapping or naming required.

A person looking toward a table lamp while a smart speaker listens and provides voice feedback. Drawing from patent filing US 2026/0236096 A1.
A person looking toward a table lamp while a smart speaker listens and provides voice feedback.All 31 drawings ↓
Publication number
US 2026/0236096 A1(US20260236096A1)
Applicant
Apple Inc.
Filed · Published
Apr 2, 2026 · Aug 13, 2026
Inventors
Sean B. KELLY, Felipe BACIM DE ARAUJO E SILVA, Karlin Y. BARK
Status when we published
Waiting for an examiner
Document
10 claims
US classification
345/156
Parent application
Continuation of 18/829,038 (filed Sep 9, 2024)(18829038)

What Apple's gaze-based device control actually does

You're standing in your living room and you want to turn off a lamp, but your hands are full of groceries. Right now, you'd have to say "Hey Siri, turn off the floor lamp" and hope it picks the right one. Apple's patent describes a better way: you look at the lamp, say something (or press a button), and the system figures out that that lamp is what you mean.

The idea is that your gaze direction acts like a pointer. The device you're wearing or holding tracks where your eyes are aimed, checks whether you're actually focused on a specific gadget, and then sends the control command to exactly that one. No need to name it, tap it, or walk over to it.

This could matter most in situations where you have multiple similar devices nearby, like several smart lights or two TVs in the same room, and picking the right one with voice or touch alone gets awkward. Your eyes already go to the thing you want; this patent just lets the system follow along.

From the filing · CLAIM 1
… in accordance with a determination, based on information from the one or more sensors, that a set of one or more gaze criteria are met for the first external device, transmitting, to a second external device that is different from the first external device, an instruction to transition the first external device from the first state to a second state …

Translation: The system checks where you are looking to decide which device should send a command to change another device's settings.

How the gaze criteria trigger the right device

The patent describes an electronic device (likely a phone, watch, or wearable with a camera or sensor) that monitors gaze information from one or more sensors to determine what the user is looking at.

Here's how the core loop works:

  • The device receives some kind of input from the user, such as a button press, a voice command, or a gesture.
  • At the same time, it checks whether a set of gaze criteria are met for a specific external device. Think of gaze criteria as pass/fail rules: are your eyes pointed at the target long enough, at the right angle, within a certain distance?
  • If the criteria are satisfied, the device sends an instruction to a second external device (not the one in your hand) telling it to change state, for example, switching from off to on.

The claim structure is deliberately layered. The device doing the sensing is separate from the device receiving the command, which is itself separate from the device being controlled. That three-way split matters because it suggests a hub-and-spoke model: your Apple Watch or Vision Pro reads your gaze, communicates through a home hub or over a network, and changes the state of a smart bulb or thermostat.

The patent also mentions providing indications that distinguish between different speakers, hinting at multi-user scenarios where the system needs to know whose gaze (and whose voice) is issuing the command.

From the filing · THE ABSTRACT
In some examples, the electronic device uses gaze information to activate a digital assistant. In some examples, the electronic device uses gaze information to identify an external device on which to act.

Translation: The device can wake up a virtual assistant or select a specific gadget to control simply by tracking your eye movements.

What this means for hands-free smart home control

For anyone who has wrestled with voice assistants in a room full of similar devices, the frustration is real. "Turn off the light" in a space with four smart bulbs is a coin flip. A gaze-based approach turns your natural attention into an unambiguous selection mechanism, which could make hands-free control feel much less like a guessing game and more like pointing with your eyes.

Apple has been building toward this kind of spatial awareness across its devices, and the patent fits neatly into the Vision Pro and AirPods ecosystem where eye-tracking and head-orientation data are already available. The new Big Tech patents in the AR and smart-home space increasingly treat your body's natural signals (where you look, how you tilt your head) as first-class inputs, and this filing is a clear step in that direction.

Source: US 2026/0236096 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Apple patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 31 sheets

31 drawing sheets from US 2026/0236096 A1 · click any drawing to enlarge

System architecture of portable device, drawing sheet 1 from US 2026/0236096 A1
Sheet 1 System architecture of portable device
Event handling and recognition hierarchy, drawing sheet 2 from US 2026/0236096 A1
Sheet 2 Event handling and recognition hierarchy
Digital assistant server network structure, drawing sheet 3 from US 2026/0236096 A1
Sheet 3 Digital assistant server network structure
Handheld device with touch screen, drawing sheet 4 from US 2026/0236096 A1
Sheet 4 Handheld device with touch screen
Computer system memory and interface components, drawing sheet 5 from US 2026/0236096 A1
Sheet 5 Computer system memory and interface components
Smart speaker responding to user gaze, drawing sheet 6 from US 2026/0236096 A1
Sheet 6 Smart speaker responding to user gaze
Touchpad input and orientation sensing, drawing sheet 7 from US 2026/0236096 A1
Sheet 7 Touchpad input and orientation sensing
Electronic device housing and button layout, drawing sheet 8 from US 2026/0236096 A1
Sheet 8 Electronic device housing and button layout
Show the other 23 sheets
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 9
Sheet 9
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 10
Sheet 10
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 11
Sheet 11
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 12
Sheet 12
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 13
Sheet 13
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 14
Sheet 14
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 15
Sheet 15
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 16
Sheet 16
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 17
Sheet 17
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 18
Sheet 18
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 19
Sheet 19
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 20
Sheet 20
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 21
Sheet 21
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 22
Sheet 22
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 23
Sheet 23
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 24
Sheet 24
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 25
Sheet 25
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 26
Sheet 26
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 27
Sheet 27
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 28
Sheet 28
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 29
Sheet 29
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 30
Sheet 30
Apple Patents a Way to Control Nearby Devices Just by Looking at Them patent drawing, sheet 31
Sheet 31
Patent filing page

Watchlists this filing belongs to

All watchlists →