Get the newsletter
Nvidia · AI / ML · Filed Oct 14, 2025 · USPTO published Aug 13, 2026 · Aug 13 release

Nvidia Patents Software That Detects Which Way Objects Face in Photos

Knowing which way an object is pointing in a photo sounds simple, but it's one of the harder problems in computer vision. Nvidia has patented a neural network approach that reads object orientation directly from images, with applications from robot arms to autonomous vehicles.

Physical objects shown in various rotational positions and orientations. Drawing from patent filing US 2026/0237177 A1.
Physical objects shown in various rotational positions and orientations.All 71 drawings ↓
Publication number
US 2026/0237177 A1(US20260237177A1)
Applicant
NVIDIA Corporation
Filed · Published
Oct 14, 2025 · Aug 13, 2026
Inventors
Jonathan Tremblay, Ming-Yu Liu, Dieter Fox, Philip Ammirato
Status when we published
Waiting for an examiner
Document
21 claims
US classification
706/15
Parent application
Continuation of 16/667,708 (filed Oct 29, 2019)(16667708)

What Nvidia's object-orientation detector actually does

Imagine you're watching a robot try to pick up a coffee mug off a table. For a human, figuring out which way the handle is pointing takes a fraction of a second. For a machine looking at a flat camera image, it's a surprisingly hard puzzle: a 2D photo doesn't automatically tell you which direction something is rotated in 3D space.

Nvidia's patent covers a system that trains a neural network (a type of AI that learns from examples) to solve exactly that puzzle. Feed it an image, and it tells you how an object is oriented, not just where it is. That information is the difference between a robot arm that can grab a screwdriver correctly and one that fumbles.

This kind of orientation detection matters anywhere machines need to interact with physical objects: warehouse robots, surgical tools, self-driving cars reading traffic signs, or augmented-reality apps that need to overlay graphics on real-world items at the right angle.

From the filing · THE ABSTRACT
Apparatuses, systems, and techniques to determine orientation of an objects in an image. In at least one embodiment, images are processed using a neural network trained to determine orientation of an object.

Translation: Nvidia is using artificial intelligence to figure out the direction an object is pointing in a digital photograph.

How the neural network figures out which way an object faces

The patent describes a system that takes an image as input and uses a neural network to output the orientation of an object in that image. Orientation here means rotation in three-dimensional space, often expressed as angles describing how far an object is tilted, turned, or rolled relative to a reference frame.

The core idea is to train the network on labeled examples where the correct orientation is already known, so the model learns the visual patterns that correspond to specific rotations. This is called supervised learning: you show the network thousands of images tagged with ground-truth orientation data until it can generalize to new images it hasn't seen.

The patent is written at a high level of abstraction, covering:

  • Processing images with a neural network trained for orientation tasks
  • Outputting orientation predictions for detected objects
  • Applying this across different object categories and imaging conditions

The inventors, who include researchers with backgrounds in robot manipulation and synthetic data generation, have previously published academic work on training perception models using photorealistic synthetic images (computer-generated training data that mimics real photos), which likely informs the approach described here.

What this means for robotics and computer vision

For robotics in particular, knowing an object's orientation is as important as knowing its location. A warehouse robot that can only tell a box is there but not which face is up will fail at the basic job of stacking. Nvidia, which supplies the GPUs and AI platforms that power many of the world's robot-training pipelines, has an obvious business interest in owning foundational perception patents that sit upstream of those applications.

The timing also fits with Nvidia's public push into physical AI and humanoid robotics. Orientation estimation is one of the building blocks covered regularly among new tech patents in the robotics and computer-vision space, and Nvidia staking out this territory at the neural-network level could matter as robot adoption accelerates.

Source: US 2026/0237177 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Nvidia patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 71 sheets

71 drawing sheets from US 2026/0237177 A1 · click any drawing to enlarge

Generator and discriminator network architecture, drawing sheet 1 from US 2026/0237177 A1
Sheet 1 Generator and discriminator network architecture
Physical objects in different orientations, drawing sheet 2 from US 2026/0237177 A1
Sheet 2 Physical objects in different orientations
Training pipeline with perturbation steps, drawing sheet 3 from US 2026/0237177 A1
Sheet 3 Training pipeline with perturbation steps
Pose generation and scoring process, drawing sheet 4 from US 2026/0237177 A1
Sheet 4 Pose generation and scoring process
Difference score graph for images, drawing sheet 5 from US 2026/0237177 A1
Sheet 5 Difference score graph for images
Difference score graph at seventy degrees, drawing sheet 6 from US 2026/0237177 A1
Sheet 6 Difference score graph at seventy degrees
Rotated square shapes in different positions, drawing sheet 7 from US 2026/0237177 A1
Sheet 7 Rotated square shapes in different positions
Output pose versus ground truth plots, drawing sheet 8 from US 2026/0237177 A1
Sheet 8 Output pose versus ground truth plots
Show the other 52 sheets
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 9
Sheet 9
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 10
Sheet 10
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 11
Sheet 11
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 12
Sheet 12
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 13
Sheet 13
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 14
Sheet 14
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 15
Sheet 15
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 16
Sheet 16
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 17
Sheet 17
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 18
Sheet 18
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 19
Sheet 19
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 20
Sheet 20
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 21
Sheet 21
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 22
Sheet 22
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 23
Sheet 23
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 24
Sheet 24
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 25
Sheet 25
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 26
Sheet 26
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 27
Sheet 27
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 28
Sheet 28
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 29
Sheet 29
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 30
Sheet 30
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 31
Sheet 31
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 32
Sheet 32
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 33
Sheet 33
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 34
Sheet 34
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 35
Sheet 35
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 36
Sheet 36
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 37
Sheet 37
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 38
Sheet 38
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 39
Sheet 39
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 40
Sheet 40
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 41
Sheet 41
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 42
Sheet 42
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 43
Sheet 43
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 44
Sheet 44
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 45
Sheet 45
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 46
Sheet 46
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 47
Sheet 47
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 48
Sheet 48
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 49
Sheet 49
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 50
Sheet 50
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 51
Sheet 51
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 52
Sheet 52
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 53
Sheet 53
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 54
Sheet 54
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 55
Sheet 55
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 56
Sheet 56
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 57
Sheet 57
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 58
Sheet 58
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 59
Sheet 59
Nvidia Patents Software That Detects Which Way Objects Face in Photos patent drawing, sheet 60
Sheet 60

Sheets 61 to 71 are in the full USPTO filing.

Patent filing page

Watchlists this filing belongs to

All watchlists →