Get the newsletter
Sony · Camera · Filed Mar 25, 2026 · USPTO published Oct 1, 2026 · Oct 1 release

Sony Patents a Fix for AI Image Enhancement That Breaks Down in Extreme Lighting

AI upscaling is great at making low-resolution images look sharper, but it tends to fall apart when a scene is unusually bright or unusually dark. Sony has filed a patent describing a fix: briefly recolor a frame to look more like the images the AI was trained on, run it through the upscaler, then recolor it back.

A diagram illustrates the process of converting an input frame into an output frame using a machine learning model for image enhancement. Drawing from patent filing US 2026/0303982 A1.
A diagram illustrates the process of converting an input frame into an output frame using a machine learning model for image enhancement.All 11 drawings ↓
Publication number
US 2026/0303982 A1(US20260303982A1)
Applicant
Sony Interactive Entertainment Inc.
Filed · Published
Mar 25, 2026 · Oct 1, 2026
Inventors
Dai Matsunaga, Takashi Amada, Wataru Kawamata, Nobuyuki Yasue
Status when we published
Waiting for an examiner
Document
11 claims
US classification
382/274
Parent application
Claims priority from a provisional application 63779313 (filed Mar 28, 2025)

What Sony's brightness-aware upscaling actually does

A video game renders a sun-drenched desert, then cuts to a pitch-black dungeon. Both look very different from the average training image an AI upscaler was built on, so the upscaler guesses wrong and the result looks blurry or wrong.

Sony's patent describes a system that, before handing a frame to an AI upscaler, measures how bright or dark that frame is and nudges its color values toward what the AI expects. The AI upscales the adjusted frame, then a second step nudges everything back to the original brightness level. The user sees a sharper image without the washed-out or crushed look that can happen when an AI gets input that looks nothing like its training data.

The whole process is designed to work in real time. The adjustment going in and the reversal coming out are mirror operations, so no brightness information is lost and the final image reflects exactly what the game originally intended.

From the filing · CLAIM 1
… performing, for the first processed frame, distribution transformation that transforms the luminance distribution of the pixels contained in the first processed frame into luminance distribution close to that of the pixels contained in a learning input frame on a basis of the first parameter to generate a second processed frame …

Translation: Adjusts the image brightness to match what the AI model expects to see before trying to upscale it.

How the luminance transform wraps around the AI upscaler

The system works in four stages, wrapping around a standard AI resolution-upscaling model (called the resolution conversion section in the patent).

  • Measure brightness: The system analyzes the luminance distribution (roughly, the spread of dark-to-light pixel values) of the incoming low-resolution frame and calculates a parameter that summarizes how bright or dark it is overall.
  • Distribution transformation: Using that brightness parameter, the system reshapes the frame's pixel values so they more closely resemble the training frames the AI upscaler was built on. Think of it as color-grading the image into the AI's comfort zone. This produces a second, adjusted frame.
  • AI upscaling: That adjusted frame is fed to the AI upscaler, which generates a higher-resolution version. Because the input now looks like the AI's training data, the AI makes better predictions.
  • Inverse transformation: The upscaled frame is then color-graded in reverse, using the same brightness parameter in reverse, to restore the original scene's intended look at the higher resolution.

The key constraint the patent enforces is that all pixel values involved are in linear light space (meaning the numbers are proportional to actual physical brightness, not gamma-encoded as most consumer screens expect). That keeps the math for the forward and reverse transforms consistent and lossless.

From the filing · THE ABSTRACT
… inputs the second processed frame to a resolution conversion section to generate a third processed frame having an estimated number of pixels each of which has a pixel value having a linear relation with luminance …

Translation: Feeds the adjusted image into the AI upscaler to add more pixels and increase the resolution.

What this means for PlayStation graphics quality

AI upscaling, whether through Sony's own PlayStation upscaling tech or rivals like Nvidia's DLSS and AMD's FSR, is increasingly how games hit high resolutions without needing proportionally more GPU power. The practical weakness is that all of these systems are trained on a finite library of reference images, and any frame that looks very different from that library (extremely high dynamic range, very dark interiors, bloom-heavy outdoor shots) can produce artifacts.

If Sony bakes this correction stage into its upscaling pipeline, it could mean more consistent image quality across a wider variety of game environments, including the edge cases (explosions, night levels, HDR sunsets) where current upscalers visibly struggle. For players, the direct benefit is fewer moments where the background looks oddly soft or smeared compared to what the raw rendering would have produced.

Sony's 15th filing we've tracked in the AI photo editing race since July builds on work seen in the ghost-frame fix and the missing-person fill-in: using AI to correct what cameras get wrong.

Source: US 2026/0303982 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Sony patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 11 sheets

11 drawing sheets from US 2026/0303982 A1 · click any drawing to enlarge

Image processing system components, drawing sheet 1 from US 2026/0303982 A1
Sheet 1 Image processing system components
Image frame conversion process, drawing sheet 2 from US 2026/0303982 A1
Sheet 2 Image frame conversion process
Machine learning model with supplementary information, drawing sheet 3 from US 2026/0303982 A1
Sheet 3 Machine learning model with supplementary information
Frame processing with motion compensation, drawing sheet 4 from US 2026/0303982 A1
Sheet 4 Frame processing with motion compensation
Object rendering and input frames, drawing sheet 5 from US 2026/0303982 A1
Sheet 5 Object rendering and input frames
Pixel interpolation grid, drawing sheet 6 from US 2026/0303982 A1
Sheet 6 Pixel interpolation grid
Image histogram examples, drawing sheet 7 from US 2026/0303982 A1
Sheet 7 Image histogram examples
Image processing workflow, drawing sheet 8 from US 2026/0303982 A1
Sheet 8 Image processing workflow
Show the other 3 sheets
Sony Patents a Fix for AI Image Enhancement That Breaks Down in Extreme Lighting patent drawing, sheet 9
Sheet 9
Sony Patents a Fix for AI Image Enhancement That Breaks Down in Extreme Lighting patent drawing, sheet 10
Sheet 10
Sony Patents a Fix for AI Image Enhancement That Breaks Down in Extreme Lighting patent drawing, sheet 11
Sheet 11
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.