Get the newsletter
Apple · AR / VR · Filed Apr 15, 2026 · USPTO published Aug 20, 2026 · Aug 20 release

Apple Patent Tracks Hand Height to Determine Mid-Air Typing Intent

Apple is working on a way for spatial-computing devices to tell the difference between a hand that's resting and a hand that's ready to give a command, using height as the trigger.

User raising a hand to activate an air-typing interface in front of a display. Drawing from patent filing US 2026/0244279 A1.
User raising a hand to activate an air-typing interface in front of a display.All 7 drawings ↓
Publication number
US 2026/0244279 A1(US20260244279A1)
Applicant
Apple Inc.
Filed · Published
Apr 15, 2026 · Aug 20, 2026
Inventors
Ashwin Kumar Asoka Kumar Shenoi, Julian K. Shutzberg, Leah M. Gum, Daniel J. Brewer, Chia-Ling Li
Status when we published
Waiting for an examiner
Document
20 claims
US classification
345/156
Parent application
Continuation of 18/302,888 (filed Apr 19, 2023)(18302888)

What Apple's hand-height input zone actually does

A person puts on Apple's Vision Pro headset and lifts their hand to scroll through a menu. The headset has to figure out whether that hand movement was intentional input or just the person shifting in their seat, and right now that line can be blurry.

This patent describes a system that watches how high your hand is relative to a virtual boundary. When your hand rises above that line, the device enters an "engagement state" and starts actively watching for gestures. When your hand drops back below it, the device relaxes and stops treating every twitch as a command. The boundary isn't fixed either, it adjusts based on what you have been doing, so the system gets better at reading your natural habits.

The practical effect is fewer accidental inputs when you're just resting your hands, and faster recognition when you actually want to do something. It's a small but meaningful quality-of-life fix for a device where your hands are the keyboard and the mouse.

From the filing · CLAIM 1
… determining a comparison of the location of the hand to a first boundary ofan input zoneselecting a set of motion types to monitor for user input based on the comparison …

Translation: The system checks if your hand crosses an invisible boundary to decide what movements to watch for.

How the system decides when your hand is 'in play'

The patent describes a method that uses sensor data (cameras or depth sensors on the headset) to track the position of a user's hand in three dimensions.

The core logic works like this:

  • The system continuously reads hand tracking data to figure out where the hand is in space.
  • It compares that location to a first boundary, essentially a height threshold that marks the edge of an "input zone."
  • Based on whether the hand is above or below that boundary, it selects a set of motion types to monitor. Above the line, it watches for deliberate gesture inputs. Below it, it mostly ignores movement.
  • When the hand enters the active zone, the system enters a UI engagement state, processes incoming sensor data more aggressively, and translates detected motions into actual commands.

Critically, the boundary height isn't hardcoded. The patent says it is modifiable based on user activity, meaning the system can shift the threshold over time to match how a particular person naturally holds their hands. That adaptive tuning is what separates this from a simple "hand up equals active" rule.

From the filing · THE ABSTRACT
… initiating a UI engagement state, wherein the system monitors the user for user input during the UI engagement state, and determining user input into the system based on a user motion detected while the hand is tracked.

Translation: Once your hand is in the right spot, the system starts actively watching for you to type in mid-air.

What this means for hands-free AR control

For anyone who has used a spatial-computing headset, accidental input is a real frustration. Your hand drifts slightly, and suddenly you've scrolled past the thing you wanted. A threshold-based engagement zone directly attacks that problem by giving the device a cleaner model of intent, which could make gesture-driven interfaces feel considerably less fidgety.

The adaptive boundary detail is the part worth watching closely. If the system really does learn each person's natural resting-hand height, it could make Vision Pro, or any future Apple headset, feel more personal over time. Apple's AR control patents have been a busy category, and plain-English patent summaries of filings in the spatial-computing input space show just how much engineering effort the company is putting into making hand gestures a reliable replacement for physical keyboards and trackpads.

Apple's 21st filing we've tracked since May in our eye and hand control watchlist builds on ideas like controlling nearby devices by gaze and reading intent from eye movement.

Source: US 2026/0244279 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Apple patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 7 sheets

7 drawing sheets from US 2026/0244279 A1 · click any drawing to enlarge

Hand height triggers display, drawing sheet 1 from US 2026/0244279 A1
Sheet 1 Hand height triggers display
Flowchart for UI engagement, drawing sheet 2 from US 2026/0244279 A1
Sheet 2 Flowchart for UI engagement
Physical surface hand placement, drawing sheet 3 from US 2026/0244279 A1
Sheet 3 Physical surface hand placement
Flowchart for threshold updates, drawing sheet 4 from US 2026/0244279 A1
Sheet 4 Flowchart for threshold updates
Hand tracking data pipeline, drawing sheet 5 from US 2026/0244279 A1
Sheet 5 Hand tracking data pipeline
Electronic device system architecture, drawing sheet 6 from US 2026/0244279 A1
Sheet 6 Electronic device system architecture
Detailed hardware component schematic, drawing sheet 7 from US 2026/0244279 A1
Sheet 7 Detailed hardware component schematic
Patent filing page

Watchlists this filing belongs to

All watchlists →