Get the newsletter
Sony · Display · Filed Jun 3, 2025 · USPTO published Nov 12, 2026 · This week's release

Sony Patents a Camera That Maps Objects in 3D While Using Less Power

Sony describes a depth camera that flashes coded light patterns at your hand and listens only for the pixels that change. That lets it keep measuring distance even while its own light is switched off.

A projector sweeps a line of light across an object while a sensor tracks how the light bends to map its 3D shape. Drawing from patent filing US 2026/0358116 A1.
A projector sweeps a line of light across an object while a sensor tracks how the light bends to map its 3D shape.All 16 drawings ↓
Publication number
US 2026/0358116 A1(US20260358116A1)
Applicant
Sony Semiconductor Solutions Corporation
Filed · Published
Jun 3, 2025 · Nov 12, 2026
Inventors
Michael GASSNER, Marc OSSWALD
Status when we published
Waiting for an examiner
Document
13 claims
US classification
356/603
Examiner
PEREZ-GUZMAN, CARLOS GABRIEL (Art Unit 2877)
Parent application
National Stage Entry of PCT/EP2023/080927 (filed Nov 17, 2023)(PCTEP2023080927)

What Sony's change-sensing depth camera does

Imagine wearing a headset and waving your hands around to move virtual objects. For that to work, the headset has to know how far away your fingers are many times a second, without draining the battery.

Sony's patent describes a depth sensor that flashes light in a rapid sequence of patterns onto whatever it is looking at, such as your hand. Instead of recording full pictures, its camera only reports the pixels where the brightness changed. Each flicker of the pattern creates a recognizable burst of changes, and the system uses the timing of those bursts to work out how far away each part of your hand is.

The clever part is what happens between flashes. Ordinary room light also causes changes the sensor can pick up, so the device can keep estimating distance while its own light is off. That means less light to power and a faster stream of updates.

From the filing · CLAIM 1
… deciding for each of the predetermined solid angles whether or not to illuminate the respective predetermined solid angle by projecting light into it …

Translation: It chooses whether to shine light onto specific small zones.

How the sensor reads light flashes as depth codes

The device has three parts. A projector divides its view into a set number of slices (the filing's example uses eight) and, for each flash, decides slice by slice whether to shine light into it. It repeats this with different on and off combinations, so in the example five flashes give every slice its own five-digit code.

The receiver is an event camera: each pixel stays silent until the light it sees changes by more than a set threshold, then reports an event (its position, a timestamp, and whether it got brighter or dimmer). The control unit gathers all events in a time window, matches each pixel's sequence of events to the known codes, and uses triangulation (geometry based on the known spacing between projector and camera) to work out distance.

Room light also triggers events. When the projector is dark, the unit treats every event as coming from room light and builds a flat 2D view. When it is lit, it treats events as coming from the projector. A predictor module, which the filing says can use neural networks (software trained on examples), blends both and keeps a running estimate of the object, so depth keeps updating with the projector off.

Further claims add a second camera for stereo vision, and the filing says the pattern light can be infrared so it stays invisible.

From the filing · THE ABSTRACT
… detects reflected light intensities from the object, including light from the projected patterns and ambient light …

Translation: It measures both the projected light bouncing back and the surrounding room light.

Why this matters for hand tracking and AR

For you, the payoff is hand tracking and depth sensing that cost less battery. The filing lists headsets for augmented and virtual reality, phones that use depth for AR and games, face capture for video calls and avatars, and factory cameras checking parts on fast conveyor belts. Sony says the single-camera design cuts parts, power use and calibration work, and the event approach avoids storing every pixel of every frame, which reduces memory and delay.

The filing also describes the control unit switching the projector on only when it needs more accuracy, for example when you reach toward a nearby virtual object in an AR scene, and leaving it off while a rough depth estimate will do. It is a design on paper, and the text gives no measured savings.

Sony's 47th filing we've tracked since July in the AR glasses race builds on earlier applications like foveated rendering and hand passthrough fading.

Source: US 2026/0358116 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Sony patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 16 sheets

16 drawing sheets from US 2026/0358116 A1 · click any drawing to enlarge

Parts that report light changes at individual sensor pixels, drawing sheet 1 from US 2026/0358116 A1
Sheet 1 Parts that report light changes at individual sensor pixels
Circuit inside a pixel that signals sudden brightness changes, drawing sheet 2 from US 2026/0358116 A1
Sheet 2 Circuit inside a pixel that signals sudden brightness changes
Reading out regular image data alongside detected brightness events, drawing sheet 3 from US 2026/0358116 A1
Sheet 3 Reading out regular image data alongside detected brightness events
Projecting a single moving light line to gauge surface depth, drawing sheet 4 from US 2026/0358116 A1
Sheet 4 Projecting a single moving light line to gauge surface depth
Using several projected lines at once to speed up scanning, drawing sheet 5 from US 2026/0358116 A1
Sheet 5 Using several projected lines at once to speed up scanning
Handling ambient sunlight and timed flash code sequences, drawing sheet 6 from US 2026/0358116 A1
Sheet 6 Handling ambient sunlight and timed flash code sequences
Separating projected light signals from ambient light changes, drawing sheet 7 from US 2026/0358116 A1
Sheet 7 Separating projected light signals from ambient light changes
Dedicated wavelength pixels and step-by-step depth updates, drawing sheet 8 from US 2026/0358116 A1
Sheet 8 Dedicated wavelength pixels and step-by-step depth updates
Show the other 8 sheets
Adding a second sensor creates 3D depth from two angles, drawing sheet 9 from US 2026/0358116 A1
Sheet 9 Adding a second sensor creates 3D depth from two angles
Tiled light patterns scan faces and rooms on phones, drawing sheet 10 from US 2026/0358116 A1
Sheet 10 Tiled light patterns scan faces and rooms on phones
Tracking hand gestures in smart glasses and on factory lines, drawing sheet 11 from US 2026/0358116 A1
Sheet 11 Tracking hand gestures in smart glasses and on factory lines
How the camera turns light changes into 3D shapes, drawing sheet 12 from US 2026/0358116 A1
Sheet 12 How the camera turns light changes into 3D shapes
Stacking the camera chips together saves space, drawing sheet 13 from US 2026/0358116 A1
Sheet 13 Stacking the camera chips together saves space
Three ways to stack sensor pixels above control circuits, drawing sheet 14 from US 2026/0358116 A1
Sheet 14 Three ways to stack sensor pixels above control circuits
Connecting 3D cameras into a car's main computer network, drawing sheet 15 from US 2026/0358116 A1
Sheet 15 Connecting 3D cameras into a car's main computer network
Where sensors fit on a car to cover blind spots, drawing sheet 16 from US 2026/0358116 A1
Sheet 16 Where sensors fit on a car to cover blind spots
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.