Get the newsletter
Nvidia · Chip · Filed Mar 31, 2025 · USPTO published Oct 1, 2026 · Oct 1 release

Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks

Nvidia is patenting a system that lets a GPU do the prep work for sending data over a network, a job that normally falls on a separate dedicated chip. The idea: flood that prep work across thousands of GPU cores in parallel instead of queuing it up one piece at a time.

A system architecture shows how a user application, network interface, and GPU application interact for network sending tasks. Drawing from patent filing US 2026/0301109 A1.
A system architecture shows how a user application, network interface, and GPU application interact for network sending tasks.All 17 drawings ↓
Publication number
US 2026/0301109 A1(US20260301109A1)
Applicant
NVIDIA Corporation
Filed · Published
Mar 31, 2025 · Oct 1, 2026
Inventors
Elena Agostini
Status when we published
Approved; patent expected soon
Document
20 claims
US classification
345/501
Examiner
MUSHAMBO, MARTIN (Art Unit 2615)

What Nvidia's GPU-as-network-helper actually does

A warehouse shipping dock has one person stamping and labeling every outgoing box before a fleet of trucks can leave. That bottleneck slows everything down, even when the trucks are sitting idle. Your computer's networking chip faces the same problem every time it has to prepare large chunks of data for transmission.

Nvidia's patent describes moving that stamping-and-labeling job onto the GPU. Instead of a single specialized chip preparing each data packet one after another, the GPU breaks the work into smaller pieces and handles all of them at the same time, using the same parallel computing muscles it normally flexes for AI or graphics.

Once the GPU finishes preparing those pieces, it hands them back to the network chip with a notification that they're ready to send. The network chip then just transmits, without having to do the slow prep work itself.

From the filing · THE ABSTRACT
Apparatuses, systems, methods, and techniques to process a work request (e.g., a Work Queue Element (WQE)) using graphics processing unit (GPU) resources. In at least one embodiment, the GPU detects one or more work requests to be processed, retrieves the work request(s), and processes the work request(s) in parallel.

Translation: The system uses the graphics chip to handle network tasks simultaneously.

How the GPU splits and posts work queue elements

The patent centers on a structure called a Work Queue Element (WQE), which is essentially a set of instructions telling a network interface controller (NIC) what data to send and how. Normally the NIC, a chip separate from the GPU, processes these instructions itself, one job at a time or in limited batches.

Here, the GPU intercepts an incoming WQE before the NIC ever sees it. It then uses its many parallel processing cores to expand that single WQE into multiple smaller WQEs, each covering a slice of the original data. All of this splitting and preparation happens simultaneously across the GPU's cores, not sequentially.

The completed batch of WQEs is placed into a queue pair (QP), a two-way communication channel the NIC monitors. The GPU then sends the NIC a notification that the queue is loaded and ready. The NIC reads the queue and starts transmitting without having to do the heavy prep work.

The claim specifically covers:

  • Obtaining the original WQE on the GPU side
  • Generating multiple WQEs from it, in parallel
  • Posting those WQEs to a queue pair the NIC can access
  • Notifying the NIC that the work is ready

What this means for data centers and AI networking

In data centers and AI clusters, GPUs spend enormous amounts of time moving data between machines, and the networking chip that handles that movement can become a bottleneck. If the GPU can prepare network jobs in parallel rather than waiting for a single chip to do it sequentially, overall throughput could rise without adding more hardware.

This is particularly relevant as several Nvidia filings on GPU-network integration this year suggest the company is working to blur the line between compute and networking in its data center stack. For anyone running large AI training jobs, faster and more parallel data movement directly translates to shorter training times and lower costs.

Nvidia's 46th filing we've tracked in the AI chip wars since July adds to a run that includes one on skipping redundant video frames and one on catching circuit congestion early.

Source: US 2026/0301109 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Nvidia patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 17 sheets

17 drawing sheets from US 2026/0301109 A1 · click any drawing to enlarge

GPU handling network sending tasks., drawing sheet 1 from US 2026/0301109 A1
Sheet 1 GPU handling network sending tasks.
Computing system with GPU and network., drawing sheet 2 from US 2026/0301109 A1
Sheet 2 Computing system with GPU and network.
Data transmission process flow., drawing sheet 3 from US 2026/0301109 A1
Sheet 3 Data transmission process flow.
GPU processing work queue entries., drawing sheet 4 from US 2026/0301109 A1
Sheet 4 GPU processing work queue entries.
Client-server GPU network communication., drawing sheet 5 from US 2026/0301109 A1
Sheet 5 Client-server GPU network communication.
GPU fetcher memory and thread groups., drawing sheet 6 from US 2026/0301109 A1
Sheet 6 GPU fetcher memory and thread groups.
Thread block processing work data., drawing sheet 7 from US 2026/0301109 A1
Sheet 7 Thread block processing work data.
GPU poster queue operations., drawing sheet 8 from US 2026/0301109 A1
Sheet 8 GPU poster queue operations.
Show the other 9 sheets
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 9
Sheet 9
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 10
Sheet 10
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 11
Sheet 11
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 12
Sheet 12
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 13
Sheet 13
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 14
Sheet 14
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 15
Sheet 15
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 16
Sheet 16
Nvidia Patents a System That Uses the GPU to Handle Network Sending Tasks patent drawing, sheet 17
Sheet 17
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.