Get the newsletter
AMD · AI / ML · Filed Jun 9, 2026 · USPTO published Oct 1, 2026 · Oct 1 release

AMD Patents a Technique to Cut Memory Traffic During AI Chip Processing

Moving data around inside a chip burns more power than the math itself. AMD's latest patent targets that hidden cost by rethinking how neural networks shuffle numbers in and out of memory.

A 3D block of data is processed through convolution and pooling layers, illustrating how source pixels are transformed into output. Drawing from patent filing US 2026/0300709 A1.
A 3D block of data is processed through convolution and pooling layers, illustrating how source pixels are transformed into output.All 13 drawings ↓
Publication number
US 2026/0300709 A1(US20260300709A1)
Applicant
ATI Technologies ULC
Filed · Published
Jun 9, 2026 · Oct 1, 2026
Inventors
Sateesh Lagudu, Lei Zhang, Allen Rush
Status when we published
Waiting for an examiner
Document
20 claims
US classification
706/25
Parent application
Continuation of 17/571,045 (filed Jan 7, 2022)(17571045)

What AMD's memory-reduction trick actually does

A chip sits inside a phone or a smart camera, trying to run an AI model. Most of the energy it burns doesn't come from doing the AI math. It comes from constantly fetching and storing numbers in a separate memory chip, over and over again.

AMD's patent describes a way to cut down that back-and-forth. Instead of pulling data from memory in small chunks and writing results back after every tiny calculation, the system groups the work into compact three-dimensional blocks, does as much as it can on each block while it's already loaded in fast local memory, and only writes the final summed result back to slower external memory.

For you, the upside would be an AI feature, think object detection, image recognition, or voice processing, that runs on a battery-powered device longer without draining the battery as fast. The target here is the kind of low-power chip found in edge devices, not a data-center server.

From the filing · CLAIM 1
… add convolution output data together across the first plurality of channels prior to writing the convolution output data to the external memory.

Translation: The chip combines data from multiple channels before saving it back to the main memory.

How AMD slices data into 3D blocks to dodge memory bottlenecks

The patent centers on convolutional neural network (CNN) inference, which is the step where a trained AI model actually processes new data (a photo, an audio clip, a sensor feed) rather than learning from examples.

CNNs process input organized into channels. Think of channels like layers in an image: red, green, and blue are three channels in a standard photo. The chip needs to run a convolution operation (a mathematical sliding-window calculation) across all those channels, and traditionally that means constantly reading from and writing to external memory (a separate RAM chip that is slower and more power-hungry than on-chip storage).

The AMD approach works in three steps:

  • Partition input data across all channels into 3D blocks, sized to minimize how often the chip has to go back to external memory.
  • Load one block at a time into fast internal (on-chip) memory and run the convolution math there.
  • Accumulate (add together) the convolution results across channels before writing anything back out, so only a single final number goes to external memory instead of many intermediate ones.

The key insight is the accumulation step. By summing across channels on-chip first, the system slashes the volume of data that ever touches the slower external bus.

From the filing · THE ABSTRACT
… partitions the input data from the plurality of channels into 3D blocks so as to minimize the external memory bandwidth utilization for the convolution operation being performed.

Translation: Data is chopped into three dimensional blocks to save valuable memory traffic during processing.

What this means for low-power AI chips in everyday devices

Memory bandwidth, how fast and how often a chip can read and write to external RAM, is one of the main limits on running AI at low power. Cutting those trips down means the same calculation costs less energy, which matters most in devices running on batteries or with tight thermal limits.

AMD has been filing around low-power AI inference since at least 2024, and this patent fits that direction. If techniques like this land in a real product, the practical effect for you would be longer battery life on a device that runs local AI tasks, or the ability to run a more capable AI model on hardware that previously couldn't handle it. The patent is filed under ATI Technologies, AMD's GPU subsidiary, so the most likely home for this work is a graphics or AI accelerator chip, not a general-purpose CPU.

AMD's 42nd patent we've tracked since May in our AI chip wars watch builds on one merging AI and graphics and one trimming AI math data.

Source: US 2026/0300709 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time AMD patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 13 sheets

13 drawing sheets from US 2026/0300709 A1 · click any drawing to enlarge

AI chip system components., drawing sheet 1 from US 2026/0300709 A1
Sheet 1 AI chip system components.
GPU architecture with memory., drawing sheet 2 from US 2026/0300709 A1
Sheet 2 GPU architecture with memory.
Neural network layers., drawing sheet 3 from US 2026/0300709 A1
Sheet 3 Neural network layers.
Convolution computation for channels., drawing sheet 4 from US 2026/0300709 A1
Sheet 4 Convolution computation for channels.
Convolution computation for features., drawing sheet 5 from US 2026/0300709 A1
Sheet 5 Convolution computation for features.
Data blocks for processing., drawing sheet 6 from US 2026/0300709 A1
Sheet 6 Data blocks for processing.
Neural network processing layers., drawing sheet 7 from US 2026/0300709 A1
Sheet 7 Neural network processing layers.
3D data blocks and processing., drawing sheet 8 from US 2026/0300709 A1
Sheet 8 3D data blocks and processing.
Show the other 5 sheets
AMD Patents a Technique to Cut Memory Traffic During AI Chip Processing patent drawing, sheet 9
Sheet 9
AMD Patents a Technique to Cut Memory Traffic During AI Chip Processing patent drawing, sheet 10
Sheet 10
AMD Patents a Technique to Cut Memory Traffic During AI Chip Processing patent drawing, sheet 11
Sheet 11
AMD Patents a Technique to Cut Memory Traffic During AI Chip Processing patent drawing, sheet 12
Sheet 12
AMD Patents a Technique to Cut Memory Traffic During AI Chip Processing patent drawing, sheet 13
Sheet 13
Patent filing page

More in AI assistant & agent

All 436 AI assistant & agent patents →

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.