Get the newsletter
Nvidia · Automotive · Filed Jun 3, 2026 · USPTO published Oct 1, 2026 · Oct 1 release

Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate

Getting a car's interior camera to reliably know where a driver is looking is harder than it sounds, and Nvidia just filed a patent for a clever way to automate the tedious calibration process that makes it possible.

A 3D perspective view of the gaze target projector, showing its base, support arm, and projection device with lenses and sensors. Drawing from patent filing US 2026/0301433 A1.
A 3D perspective view of the gaze target projector, showing its base, support arm, and projection device with lenses and sensors.All 17 drawings ↓
Publication number
US 2026/0301433 A1(US20260301433A1)
Applicant
NVIDIA Corporation
Filed · Published
Jun 3, 2026 · Oct 1, 2026
Inventors
Martin HEMPEL, Nishant PURI, Anshul JAIN, Chun-Wei CHEN, Dae Jin KIM, Frederic VATNSDAL
Status when we published
Waiting for an examiner
Document
20 claims
US classification
382/103
Parent application
Continuation of 18/176,327 (filed Feb 28, 2023)(18176327)

How Nvidia trains a car's camera to follow your eyes

Ever tried to explain to someone exactly where you're pointing, only to have them look at the wrong spot? Teaching a car's cabin camera to track a driver's eyes has exactly that problem, and on a much larger scale.

Car safety systems that watch whether you're looking at the road, drifting off, or staring at your phone depend on cameras calibrated to a very precise understanding of the cabin's geometry. Right now, getting that calibration right typically means a laborious manual setup. Nvidia's patent describes a smarter approach: project a small dot of light onto any surface inside the cabin, have a test driver look at it, and let the system automatically record exactly where the dot landed in 3D space. Do that dozens or hundreds of times across the whole interior, and you've built a rich, accurate set of labeled training examples without a human having to measure and log each one by hand.

The practical payoff is that eye-tracking systems inside vehicles could be trained and recalibrated faster and more accurately, which matters every time a new car model, dashboard shape, or seating configuration enters the picture.

From the filing · CLAIM 1
cause a sequence of gaze targets to be projected over an interior surface of an ego-machine; determine, for each gaze target of the sequence of gaze targets, a position in a three-dimensional (3D) space corresponding to a location of a projection of a respective gaze target; …

Translation: The system shines lights inside the vehicle and calculates their exact physical coordinates.

How the projected dot becomes labeled training data

The patent describes a calibration rig designed to work inside a vehicle cabin. A projector mounted at a known fixed position fires a beam of light that lands as a visible dot on whatever interior surface it hits, whether that's a curved dashboard, a narrow door panel, or an irregular headliner.

Because the projector's position is known precisely, the system can calculate the 3D coordinates (the exact location in space, not just a flat 2D image position) of wherever the dot lands. A camera then captures images of a test occupant looking at each projected dot in sequence. Those images are automatically tagged with the corresponding 3D coordinates, producing what engineers call ground truth data, meaning labeled examples where the system knows with confidence exactly what the camera was seeing and where the occupant's eyes were directed.

Those labeled images then feed into training an in-cabin monitoring model (the AI that will later watch real drivers). The patent also describes using this same projection-and-capture loop to adjust the camera's own calibration parameters, correcting for things like slight shifts in mounting position or lens distortion.

  • A gaze-target projector sweeps a sequence of dot positions across the cabin interior.
  • The system computes the 3D position of each projected dot automatically.
  • A camera captures the test occupant's face and eyes while they look at each dot.
  • Each image is labeled with the dot's 3D coordinates, creating training and calibration data.
From the filing · THE ABSTRACT
Because a beam of light may be used to produce the projected gaze target, the projected gaze target may be displayed at a projection point on the surface of the cabin interior, even if the surface at the projection point is curved, small, or an irregular shape.

Translation: Light can be projected onto any bumpy or curved interior surface to serve as a target.

What this means for driver-attention safety systems

Driver monitoring is becoming a legal requirement in many markets, including the European Union's new General Safety Regulation, which mandates attention-detection systems in new vehicles. The accuracy of those systems depends directly on how well the cabin cameras are calibrated. A camera that doesn't know the precise geometry of this specific car's interior will make more errors about whether you are watching the road.

Nvidia keeps filing on in-cabin sensing and autonomous-vehicle perception, and this patent fits squarely into that work. Automating the calibration data-collection step reduces a significant cost and time burden for automakers, potentially making better-tuned driver monitoring available across a wider range of vehicle models rather than only premium ones where manual setup budgets are generous.

Nvidia's 78th filing we've tracked since May in our self-driving sensing race follows work like tighter boxes around objects and 3D intersection mapping.

Source: US 2026/0301433 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Nvidia patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 17 sheets

17 drawing sheets from US 2026/0301433 A1 · click any drawing to enlarge

Gaze training data collection system., drawing sheet 1 from US 2026/0301433 A1
Sheet 1 Gaze training data collection system.
Gaze target projector device., drawing sheet 2 from US 2026/0301433 A1
Sheet 2 Gaze target projector device.
Gaze target controller and projector., drawing sheet 3 from US 2026/0301433 A1
Sheet 3 Gaze target controller and projector.
Target coordinate mapping function., drawing sheet 4 from US 2026/0301433 A1
Sheet 4 Target coordinate mapping function.
Projector calibration system., drawing sheet 5 from US 2026/0301433 A1
Sheet 5 Projector calibration system.
Vehicle interior with gaze targets., drawing sheet 6 from US 2026/0301433 A1
Sheet 6 Vehicle interior with gaze targets.
Occupant's face with eye gaze., drawing sheet 7 from US 2026/0301433 A1
Sheet 7 Occupant's face with eye gaze.
Gaze target illuminating panel., drawing sheet 8 from US 2026/0301433 A1
Sheet 8 Gaze target illuminating panel.
Show the other 9 sheets
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 9
Sheet 9
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 10
Sheet 10
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 11
Sheet 11
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 12
Sheet 12
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 13
Sheet 13
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 14
Sheet 14
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 15
Sheet 15
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 16
Sheet 16
Nvidia Patents a Light-Projection System to Keep Driver Gaze Cameras Accurate patent drawing, sheet 17
Sheet 17
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.