Apple Patents a Fix for Warped Hands in Headset Camera Views
Your hands are the hardest thing for a headset to show correctly, because they are so close to its cameras. Apple's patent fixes that by pretending close objects are a little farther away than they really are.
What Apple's headset distance cap actually does
Every time you reach for a coffee mug while wearing a headset that shows you the room through cameras, your eyes and those cameras disagree about where your hand is. The cameras sit in front of your face, so the video they capture comes from a slightly different spot than your eyes.
To fix that, the headset redraws the video as if it had been filmed from your eyes. The catch is that things very close to you, like your own hands, shift the most during that redraw. They tend to come out stretched, gappy or smeared.
Apple's patent has a simple workaround. Anything closer than a set distance (the filing gives 70 centimeters as an example) is treated as if it sits right at that distance. Close objects end up shifted a little less than strictly correct, but the glitches become much harder to notice. You trade a bit of accuracy up close for a cleaner picture.
… changing the set of depth values for the set of points to the depth threshold to obtain a plurality of changed depth values for the plurality of points …
Translation: The system flattens out parts of the image that are closer than a certain minimum distance.
How Apple raises too-close objects to a floor
The patent covers a method for devices with a camera and a screen, mainly headsets that show you the real world as live video (often called pass-through). Because the camera sits in front of the display and your eye sits behind it, the device has to warp the camera image so it matches what your eye would see. Claim 1 describes the key step: find points whose distance from the camera is under a threshold, change those distances to the threshold, then do the warp using the changed numbers.
The filing walks through the steps:
- Measure distances: the device gets a distance for each pixel from a depth sensor, from stereo matching (comparing two cameras), or from where your two eyes are looking.
- Clamp: any distance below the threshold is raised to the threshold, for example 70 cm.
- Warp: for each pixel of the new image, the device uses matrix math (a stored grid of numbers that captures the offset between camera and eye) to find which camera pixel it should copy.
- Patch holes: gaps left by the warp can be filled by interpolation (guessing from neighboring pixels) or from another camera image.
The threshold can be fixed or can change. The filing says it may be reduced when the device is moving, or set farther out than something like a computer screen in the room.
Virtual objects can be warped separately, using just one distance (where your hand touches the object, or its center) or a few points on its outline, which the filing says cuts delay.
… generating a clamped depth map of the image of the physical environment based on the plurality of depths, wherein each element of the clamped depth map has a depth value above or equal to a depth threshold …
Translation: It creates a modified depth map where no object is allowed to get closer than a set limit.
Why warped hands matter for headset comfort
A headset that shows you the world through cameras only works if what you see lines up with where things really are. The filing says a mismatch leads to poor distance judgment, disorientation and bad hand-eye coordination. Your own hands are the worst case, since they are close to the cameras and always in view, so any warping there is the first thing you would notice.
The approach gives up a little accuracy on very close objects to keep the picture clean. It also points to a practical concern for any headset maker: virtual objects have to be added to the camera view without making it lag. Warping them with one distance or a few points is a cheaper way to keep that delay down. The filing does not name a product, but this is the problem video pass-through headsets have to solve.
Apple's 121st filing we've tracked since May joins earlier applications like one on torso-anchored controls and flat maps rising into 3D in our Apple AR glasses watchlist.
Claim 1 is short and broad. It asks for a device with a camera and a screen, a set of distance readings, a cutoff, a step that lifts every reading under the cutoff up to the cutoff, and a warp to the user's viewpoint using the lifted numbers. It never mentions a headset, eyes or holes in the image, so on paper it reaches any camera-and-screen device that does this.
The narrower ideas sit in the dependent claims: a cutoff that follows the device's movement or the objects in the room, a viewpoint taken from the eye, and separate warping of virtual content using a single distance. Those are the details that give it a specific shape.
If granted, claim 1 would stand in the way of any rival whose headset raises too-close distances to a floor before shifting the view. That is a small, simple step, and it solves a problem you feel the moment your hand looks wrong. It is a modest trick, but a useful one.
Get our take in your Top Stories
Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Apple patent news breaks.
There are more where this came from
We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.
The drawings
10 drawing sheets from US 2026/0350860 A1 · click any drawing to enlarge
Show the other 2 sheets
Want this weekly breakdown for a company we don't cover? Patentlyze Pro →
Be the first to weigh in