Get the newsletter
Sony · Memory & storage · Filed Jun 10, 2026 · USPTO published Oct 1, 2026 · Oct 1 release

Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files

Sony has patented a way to shrink the memory footprint of video encoding by flipping image data before running the math, instead of storing a separate set of large lookup tables for every transform variation.

A block of image data is processed with horizontal and vertical transforms, showing resulting waveform shapes. Drawing from patent filing US 2026/0303868 A1.
A block of image data is processed with horizontal and vertical transforms, showing resulting waveform shapes.All 102 drawings ↓
Publication number
US 2026/0303868 A1(US20260303868A1)
Applicant
SONY CORPORATION
Filed · Published
Jun 10, 2026 · Oct 1, 2026
Inventors
Takeshi TSUKUBA
Status when we published
Waiting for an examiner
Document
8 claims
US classification
375/240.12
Parent application
Continuation of 19/040,607 (filed Jan 29, 2025)(19040607)

What Sony's pixel-flipping compression method actually does

Modern video compression works by finding the difference between what the encoder predicted a frame would look like and what it actually looks like. That "prediction residual" then goes through heavy math to squeeze it down into a much smaller file. The problem is that different types of content need different versions of that math, and storing all those versions eats up a lot of memory inside the chip doing the work.

Sony's patent describes a shortcut: instead of keeping a big library of different math tables, the encoder can flip the prediction residual horizontally, vertically, or both before running the math, then use a single base table for everything. The flipping is tracked with simple flag bits so the decoder knows how to reverse the process on the other end.

The result is that you get the same compression quality but the hardware needs far less memory to pull it off. That matters most in tight, power-sensitive devices where every byte of memory has a cost.

From the filing · CLAIM 1
… set horizontal identification data for identifying whether to flip a prediction residual of an image in a horizontal direction and set vertical identification data for identifying whether to flip the prediction residual in a vertical direction …

Translation: The system decides whether to flip parts of the image data horizontally or vertically before compressing it.

How the permutation step replaces extra transform matrices

Video encoders break each frame into blocks and compare them to a prediction of what that block should look like. The leftover difference, called a prediction residual, is then run through an orthogonal transform (a mathematical operation, similar to a Fourier transform, that converts the residual into frequency components that compress well).

Different content types call for different transform "types," and each type traditionally requires its own transformation matrix stored in memory. As the number of supported transform types grows, so does the memory bill.

Sony's approach replaces many of those extra matrices with a permutation operation: a controlled flip of the residual block in the horizontal direction, the vertical direction, or both. Two small identification flags record which flip (if any) was applied. The encoder then runs a single base transform matrix on the (possibly flipped) residual instead of switching to a different matrix.

The decoder reads the flags and reverses the flip after decoding, so the reconstructed image is identical to what a full multi-matrix approach would produce. The design sits naturally inside existing codec pipelines (it targets formats like those in the VVC/H.266 family) without changing the structure of the compressed bitstream in ways that would break compatibility.

From the filing · THE ABSTRACT
… suppression of an increase in a memory capacity required for orthogonal transform and inverse orthogonal transform …

Translation: The method aims to prevent video compression from using up too much computer memory.

What this means for video encoders and streaming hardware

For hardware encoders inside cameras, streaming sticks, and broadcast equipment, memory is one of the main cost and power constraints. A compression chip that needs less on-chip memory to hold transform tables can be made smaller and cheaper, or can use the freed-up memory for something else like buffering more frames.

For everyday viewers, the impact is indirect: if this approach lands in production silicon, it could mean higher-quality video encoding in lower-cost or lower-power devices, from streaming boxes to video-call hardware. The patent targets encoding and decoding equally, so both ends of a video pipeline could benefit.

Sony's memory and storage filings we've tracked since August now include a third application, joining one on compressing 3D scans and one on faster LiDAR recovery.

Source: US 2026/0303868 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Sony patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 102 sheets

102 drawing sheets from US 2026/0303868 A1 · click any drawing to enlarge

Transform candidate sets for prediction., drawing sheet 1 from US 2026/0303868 A1
Sheet 1 Transform candidate sets for prediction.
Transform types and basis functions., drawing sheet 2 from US 2026/0303868 A1
Sheet 2 Transform types and basis functions.
Transform sets for intra prediction., drawing sheet 3 from US 2026/0303868 A1
Sheet 3 Transform sets for intra prediction.
Types of transforms in a lookup table., drawing sheet 4 from US 2026/0303868 A1
Sheet 4 Types of transforms in a lookup table.
Lookup table size for transform sizes., drawing sheet 5 from US 2026/0303868 A1
Sheet 5 Lookup table size for transform sizes.
Lookup table sizes for different precisions., drawing sheet 6 from US 2026/0303868 A1
Sheet 6 Lookup table sizes for different precisions.
Image block transform waveform shapes., drawing sheet 7 from US 2026/0303868 A1
Sheet 7 Image block transform waveform shapes.
Transform types by waveform shape., drawing sheet 8 from US 2026/0303868 A1
Sheet 8 Transform types by waveform shape.
Show the other 52 sheets
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 9
Sheet 9
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 10
Sheet 10
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 11
Sheet 11
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 12
Sheet 12
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 13
Sheet 13
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 14
Sheet 14
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 15
Sheet 15
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 16
Sheet 16
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 17
Sheet 17
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 18
Sheet 18
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 19
Sheet 19
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 20
Sheet 20
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 21
Sheet 21
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 22
Sheet 22
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 23
Sheet 23
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 24
Sheet 24
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 25
Sheet 25
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 26
Sheet 26
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 27
Sheet 27
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 28
Sheet 28
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 29
Sheet 29
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 30
Sheet 30
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 31
Sheet 31
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 32
Sheet 32
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 33
Sheet 33
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 34
Sheet 34
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 35
Sheet 35
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 36
Sheet 36
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 37
Sheet 37
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 38
Sheet 38
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 39
Sheet 39
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 40
Sheet 40
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 41
Sheet 41
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 42
Sheet 42
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 43
Sheet 43
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 44
Sheet 44
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 45
Sheet 45
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 46
Sheet 46
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 47
Sheet 47
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 48
Sheet 48
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 49
Sheet 49
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 50
Sheet 50
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 51
Sheet 51
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 52
Sheet 52
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 53
Sheet 53
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 54
Sheet 54
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 55
Sheet 55
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 56
Sheet 56
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 57
Sheet 57
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 58
Sheet 58
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 59
Sheet 59
Sony Patents a Method to Reduce Memory Demands When Shrinking Video Files patent drawing, sheet 60
Sheet 60

Sheets 61 to 102 are in the full USPTO filing.

Patent filing page

Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.