Get the newsletter
Nvidia · AI / ML · Filed Mar 30, 2026 · USPTO published Aug 13, 2026 · Aug 13 release

Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering

Nvidia has filed a patent for a system that uses AI to relight people or objects in video in real time, keeping the effect looking consistent frame to frame instead of flickering like older approaches.

Video frames showing a person under different lighting conditions alongside the extracted albedo and geometry maps used to adjust the lighting. Drawing from patent filing US 2026/0237124 A1.
Video frames showing a person under different lighting conditions alongside the extracted albedo and geometry maps used to adjust the lighting.All 56 drawings ↓
Publication number
US 2026/0237124 A1(US20260237124A1)
Applicant
NVIDIA Corporation
Filed · Published
Mar 30, 2026 · Aug 13, 2026
Inventors
Ting-Chun Wang, Ming-Yu Liu, Koki Nagano, Sameh Khamis, Jan Kautz
Status when we published
Waiting for an examiner
Document
1 claim
US classification
345/581
Parent application
Continuation of 17/862,818 (filed Jul 12, 2022)(17862818)

What Nvidia's AI video relighting actually does

Every time a video call app tries to improve how you look on camera, it has to make a lighting decision on every single frame, dozens of times per second. If those decisions don't agree with each other, you get a flickering, unstable effect that looks worse than no correction at all.

Nvidia's patent describes a system that uses neural networks trained partly on computer-generated synthetic images to apply a lighting effect to people or objects in video. The key addition is a component that specifically ensures the lighting stays consistent from one frame to the next, so the result looks smooth rather than jittery.

In plain terms: you point a camera at someone, tell the system what kind of light you want, and it adjusts the video to match, without the result looking like a broken strobe effect. That last part, the stability, is what separates this from earlier attempts.

From the filing · CLAIM 1
… one or more neural networks include one or more sub-networks to provide temporal stability of the lighting effect between the frames.

Translation: The system uses specialized AI layers to ensure that lighting changes look smooth and do not flicker as the video plays.

How the network keeps lighting stable across frames

Neural network-based relighting is not new, but keeping the effect stable across a moving video sequence is the hard part. Nvidia's patent addresses this directly by building temporal stability (frame-to-frame consistency) into the network architecture itself, not as an afterthought.

The system works roughly like this:

  • The neural network is trained using synthetically generated images of objects or people, meaning computer-rendered scenes where the lighting is known precisely. This gives the model a controlled training ground it could never get from real-world footage alone.
  • At inference time (when it's actually running on video), the network applies a desired lighting effect to each frame.
  • One or more sub-networks are dedicated specifically to enforcing temporal stability, meaning they compare adjacent frames and ensure the lighting doesn't jump or flicker between them.

The claim covers a processor running this whole pipeline on video sequences, not just still images. That distinction matters: still-image relighting is a solved problem at this point; video relighting that holds up under motion is considerably harder and much more commercially useful.

From the filing · THE ABSTRACT
… one or more neural networks are used to cause a lighting effect to be applied to one or more objects within one or more images based, at least in part, on synthetically generated images of the one or more objects.

Translation: The technology uses computer generated models to calculate how light should realistically fall on people in a video.

What this means for video calls and virtual production

For anyone who has used a video call app with a virtual background or a beauty filter, you have probably noticed that these effects can look jittery when you move. That is exactly the failure this patent targets. A stable, AI-driven relighting system would let video conferencing apps, streaming tools, or film production software apply virtual lighting that actually holds up, looking like the light was really there instead of being pasted on frame by frame.

Nvidia is well positioned to build this into hardware and software it already sells to creators, enterprise customers, and broadcasters. The synthetic-training approach is also notable because it sidesteps the enormous cost of capturing real video under thousands of lighting conditions. This kind of AI imaging work sits squarely in the stream of Big Tech patent news around neural rendering and computational video production that has been accelerating across the industry.

Source: US 2026/0237124 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Nvidia patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 56 sheets

56 drawing sheets from US 2026/0237124 A1 · click any drawing to enlarge

Neural network architecture for image relighting, drawing sheet 1 from US 2026/0237124 A1
Sheet 1 Neural network architecture for image relighting
Refinement process for facial details, drawing sheet 2 from US 2026/0237124 A1
Sheet 2 Refinement process for facial details
Visual demonstration of lighting adjustments, drawing sheet 3 from US 2026/0237124 A1
Sheet 3 Visual demonstration of lighting adjustments
Flowchart of the training process, drawing sheet 4 from US 2026/0237124 A1
Sheet 4 Flowchart of the training process
High-level steps for applying lighting, drawing sheet 5 from US 2026/0237124 A1
Sheet 5 High-level steps for applying lighting
Network system architecture, drawing sheet 6 from US 2026/0237124 A1
Sheet 6 Network system architecture
Hardware structures for training, drawing sheet 7 from US 2026/0237124 A1
Sheet 7 Hardware structures for training
Machine learning training framework, drawing sheet 8 from US 2026/0237124 A1
Sheet 8 Machine learning training framework
Show the other 48 sheets
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 9
Sheet 9
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 10
Sheet 10
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 11
Sheet 11
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 12
Sheet 12
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 13
Sheet 13
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 14
Sheet 14
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 15
Sheet 15
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 16
Sheet 16
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 17
Sheet 17
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 18
Sheet 18
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 19
Sheet 19
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 20
Sheet 20
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 21
Sheet 21
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 22
Sheet 22
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 23
Sheet 23
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 24
Sheet 24
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 25
Sheet 25
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 26
Sheet 26
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 27
Sheet 27
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 28
Sheet 28
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 29
Sheet 29
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 30
Sheet 30
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 31
Sheet 31
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 32
Sheet 32
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 33
Sheet 33
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 34
Sheet 34
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 35
Sheet 35
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 36
Sheet 36
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 37
Sheet 37
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 38
Sheet 38
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 39
Sheet 39
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 40
Sheet 40
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 41
Sheet 41
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 42
Sheet 42
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 43
Sheet 43
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 44
Sheet 44
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 45
Sheet 45
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 46
Sheet 46
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 47
Sheet 47
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 48
Sheet 48
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 49
Sheet 49
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 50
Sheet 50
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 51
Sheet 51
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 52
Sheet 52
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 53
Sheet 53
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 54
Sheet 54
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 55
Sheet 55
Nvidia Patents Technology That Changes Lighting on People in Video Without Flickering patent drawing, sheet 56
Sheet 56
Patent filing page

Watchlists this filing belongs to

All watchlists →