This watchlist tracks patents on the plumbing of AI chips: memory bottlenecks, task scheduling, data compression, and coordination across multiple chips. Together, they show that competition in AI hardware is shifting toward how chips move and share data, rather than raw computational speed.
394 filings · tracking since May 2026 · latest Nov 2026 · updates weekly
based on all tracked filings in this watchlist · refreshes every week
This fight is over who controls the hardware tricks that make AI run faster, use less memory, and waste less power on chips of all sizes. Every company here is filing ways to squeeze more out of the same silicon.
Samsung and Qualcomm carry the most weight by filing count, with Samsung leading the group and Qualcomm close behind.
a dated entry each week this watchlist moves · older entries stay archived
Nvidia leads this week with five filings, mostly around making AI chatbots faster and sharing work across chips more efficiently. Microsoft and Samsung also filed, focusing on cutting energy use and giving AI only the computing power it actually needs.
This week's filings center on making AI chips faster and more flexible without rebuilding the AI from scratch. Google leads with two filings, while Microsoft, IBM, Qualcomm, Samsung, and Intel each add their own angle on cutting waste and improving speed.
Nvidia leads this week with eight filings, mostly focused on making AI chatbots reply faster and fitting more memory closer to the math. Qualcomm and Intel also filed, targeting phones, headsets, and chips that recover from interruptions.
Google leads this week with four filings covering camera AI, memory handling, faster text tools, and number processing on chips. Nvidia and Samsung each added two filings focused on cutting wasted time and keeping AI running smoothly under heavy use.
AMD and Qualcomm led this week with the most filings, covering memory savings, chip reliability, and network limits. The dominant theme is squeezing AI into tighter spaces, whether on phones, chips, or data centers, using less memory and power.
This week's filings center on squeezing more AI speed out of existing hardware while cutting power and memory waste. Intel and Nvidia led the pack, with Intel focused on smarter chip efficiency and Nvidia on splitting and sharing GPU workloads.
AMD leads this week with four filings covering how chips share memory and manage their own work. Google and Microsoft also filed several patents around running AI more efficiently on devices and smaller chips.
Qualcomm and Samsung led this week with the most filings, focusing on splitting AI work across chips and managing memory under pressure. Power sharing, data rerouting, and running leaner AI on phones were the clearest common threads.
Samsung and Intel led this week's filings, with Samsung focused on compressing and streamlining how AI reads and stores data, and Intel on routing tasks to the right chip faster. The common thread across most companies is doing more AI work with less power and fewer steps.
Nvidia leads this week with four filings focused on how code runs across processors and how to skip unnecessary work at runtime. Intel and Sony each added two filings, with Intel focused on cutting wasted space and memory in AI chip design, and Sony on managing power and connections between chips.
This week's filings center heavily on making AI chips faster while using less power, covering everything from smarter memory handling to shrinking math shortcuts. Intel and Samsung led the pack in volume, while Nvidia and Qualcomm each pushed hard on cutting wasted work during AI processing.
Most filings this week focus on helping chips do more AI work while using less memory and power. Qualcomm filed the most patents, covering memory sharing, data compression, and keeping calculations fast.
counts from tracked filings · focus read from each company’s own filings
20 or more filings in the last 8 weeks · 6 to 19 · under 6
the fights inside the fight · each with its three newest filings · new filings join every week
Qualcomm 12, Nvidia 9, Samsung 9
Several companies are filing patents on ways to compress AI models so they run on devices with less memory and power, without losing accuracy.
Nvidia 13, Qualcomm 6, Intel 5
Companies are racing to file patents on ways to break AI tasks into pieces and spread them across different chips, processors, or even separate devices.
AMD 14, Intel 11, Qualcomm 6
A large cluster of patents targets the core arithmetic inside AI chips, finding ways to run calculations using fewer steps, smaller numbers, or pre-calculated shortcuts so chips burn less energy.
Intel 6, Samsung 5, Qualcomm 2
Patents in this thread focus on predicting what data a chip will need next and loading it early so the processor never sits idle waiting.
Google 2, Amazon 2, Nvidia 2
Several companies are filing patents on systems that decide in real time whether to run AI on your device or send it to a remote server, and how to hand work back and forth quickly.
Samsung 21, Qualcomm 10, Intel 8
This thread covers patents on how chips store, move, and access data without creating bottlenecks that slow AI down.
Qualcomm 5, AMD 4, Google 3
These filings decide how much power a chip gets, when it sleeps, and how it avoids overheating.
AMD 8, Nvidia 7, Intel 6
Patents on deciding which task runs first and on which part of the chip, so nothing sits idle.
Qualcomm 8, Nvidia 5, Sony 4
Cameras and video feeds produce far more pixels than an AI chip needs. These filings skip unchanged frames, blank pixels and repeated work so image and video AI runs on less memory.
Samsung 4, Intel 1, Apple 1
Instead of copper wires, these filings move data between chips and memory on beams of light.
AMD 2, IBM 1, OpenAI 1
Patents on keeping an AI model, or a chip's safety system, sealed off from software that could copy or crash it.
Each piece of the input gets its own level of math precision, trading speed and accuracy as needed.
Light-based links sit right beside the processor and memory, inside one package.
Decimal and whole-number math run in the same block of memory, so data never has to move between parts.
The numbers going into the network are squeezed on the fly, so the same chip can do more work.
every tracked filing, month by month · counts are USPTO pre-grant publications, one per publication number (an application, not a granted patent)
US 2026/0349824 A1
Confirms the chip wars extend beyond hardware design to the grid itself: coordinating compute across geographically dispersed data centers to match fluctuating renewable power supply, trading latency for energy efficiency.
US 2026/0349820 A1
Within the chip supply crunch, this patents a way to distribute training work across idle consumer hardware rather than concentrating it in data centers, directly easing pressure on scarce GPU availability during off-peak device usage.
US 2026/0350380 A1
Confirms the multi-chip coordination problem deepens mid-inference: as context windows grow, static chip assignments fail, so dynamic regrouping becomes necessary to keep memory pressure from stalling the system.
US 2026/0352570 A1
The chip wars include competition over what runs where: cloud, edge, or the router itself. Qualcomm's filing moves AI inference onto routers by solving the coordination problem between local processing and network traffic on a shared processor.
US 2026/0350353 A1
Distributing attention operations across multiple chips reduces the memory bottleneck when processing long sequences, letting each processor handle a portion of the lookback work rather than replicating it.
US 2026/0350352 A1
Batching multiple requests per chip reduces synchronization waits between distributed inference passes, freeing hardware to interleave chatbot queries instead of stalling on coordination overhead.
US 2026/0350374 A1
A chatbot's few oversized numbers can wreck the shortcuts that make it fast. Microsoft's patent gives every row and column its own reference point so the shortcut survives.
US 2026/0350343 A1
Pipelined memory loading lets graphics cards overlap computation and data fetching, reducing idle time when model size exceeds available VRAM. The approach directly targets the memory bottleneck that forces stops between processing stages.
US 2026/0349953 A1
Direct hand-off between processing layers cuts the round trips to shared memory that create latency in sequential inference. Confirms the chip wars are shifting toward specialized memory paths rather than general-purpose architectures.
US 2026/0350397 A1
The chip allocation problem here extends beyond memory and coordination: Samsung proposes using a predictor model to right-size compute resources at runtime, matching chip allocation to actual workload demands rather than peak-case provisioning.
US 2026/0343778 A1
Distributed switching at the hardware level cuts out the central routing bottleneck, reducing both power consumption and physical footprint in multi-chip AI systems.
US 2026/0340367 A1
Quantizing filters down to binary values creates a fixed set of possible patterns per layer. Intel's approach replaces repeated computation with lookup tables, trading math cycles for memory reads and reducing the stored footprint of each quantized model.
US 2026/0340418 A1
Memory access scheduling on mobile AI chips: Samsung's patent proposes algorithms to minimize round trips between fast on-chip cache and slower external memory, reducing latency and power consumption per inference cycle.
US 2026/0340369 A1
Efficient model deployment across chip variants removes the retraining burden when format mismatches arise. Qualcomm's layer-by-layer quantization approach suggests a path around the coordination costs that currently lock trained models to specific hardware.
US 2026/0339665 A1
Memory coordination across distributed tile processors requires separate channels: one for neighbor-to-neighbor data flow, another for broadcast instructions. Google's grid design keeps local handoffs from congesting the global command path.
US 2026/0339634 A1
Task scheduling across chips wastes cycles on redundant low-level operations. Google's approach uses AI to prune instruction sequences for common operations like sorting, keeping only faster variants that preserve correctness.
US 2026/0340074 A1
Analog in-memory compute chips drift during operation. IBM's approach corrects stored weights post-training rather than retraining, keeping the energy savings intact while compensating for cell imprecision.
US 2026/0330261 A1
Stacking the processor directly atop memory eliminates the long data fetch that causes chatbot latency, while fixed routing paths between chip components bypass shared storage bottlenecks that create scheduling delays.
US 2026/0330225 A1
Memory constraints have driven most compression work; this patent targets the transformer architecture itself, showing how to prune attention layers while preserving model coherence.
US 2026/0330206 A1
Pipelining computation through on-chip buffers to cut memory round-trips between neural network layers, reducing latency per token generation in large language models.
US 2026/0330205 A1
Direct wiring between processing stages eliminates intermediate trips to shared memory, confirming that the bottleneck sits in data movement rather than compute speed itself.
US 2026/0329964 A1
A switching fabric that routes adapter data directly to GPUs bypasses the memory bottleneck by letting the interconnect layer manage which customizations reach compute at any moment, rather than forcing everything through limited on-chip caches.
US 2026/0330199 A1
Hardwired data paths between processing layers eliminate the central memory bottleneck that slows word-by-word generation in large language models, routing each layer's output directly to its successor rather than through shared buffers.
US 2026/0329965 A1
Packing two weight values into a single memory slot cuts the data load burden on phone chips by eliminating real-time reorganization overhead, directly attacking the memory bottleneck that constrains on-device AI performance.
US 2026/0329963 A1
Multiplication units on mobile chips already run fast; this patent converts sequential accumulation operations into single multiplies to free up bandwidth elsewhere in the memory hierarchy during real-time computer vision tasks.
US 2026/0330116 A1
Parallel verification of sorting circuits shrinks proof time from 12 hours to 27 minutes by comparing hardware and software implementations directly rather than exhaustive state enumeration, reducing the iteration cycle for GPU design changes.
US 2026/0329966 A1
Within the memory bottleneck problem, this confirms OpenAI is pursuing stationary weights: keeping model parameters fixed in compute units while input data flows through, rather than shuttling weights back and forth to external memory.
US 2026/0329641 A1
Memory bottlenecks appear when multiple AI tasks queue for the same camera frame. Qualcomm's patent lets different inference jobs run at their own speeds by sharing a cached frame copy, reducing both latency and wasted compute cycles.
US 2026/0329803 A1
Distributed small math blocks sidestep repeated memory fetches during token generation, cutting latency for sequential output in large language models.
US 2026/0329589 A1
Dynamic data routing around a shared memory pool cuts down idle time when thousands of compute units compete for access. Confirms the shift toward baking the scheduling problem into silicon rather than leaving it to software.
US 2026/0329584 A1
Checkpointing large matrix operations mid-execution allows the chip to resume after interrupts without recomputing, directly reducing the idle and restart cycles that plague multi-chip AI workloads under contention for memory and scheduler resources.
US 2026/0330207 A1
Memory bandwidth has been the acknowledged bottleneck throughout the AI chip wars; Samsung's approach embeds compute directly in DRAM to eliminate the round trip entirely, collapsing data movement into the operation itself.
US 2026/0331108 A1
A scheduler assigns priority ranks to competing assistants on a single device, letting the system allocate memory and compute cycles by user preference rather than random contention.
US 2026/0320291 A1
Embedding common word pairs into lookup buckets before the main inference pass cuts redundant computation, directly reducing the memory-to-compute ratio that starves parallel processors during language tasks.
US 2026/0320432 A1
Extends the coordination layer beyond task routing: Intel proposes auditing hardware health and integrity across distributed chips before processing begins, catching tampering or degradation that could poison downstream AI outputs.
US 2026/0319830 A1
Memory bottlenecks have proven hardest to crack when the main processor stalls during garbage collection. Google offloads this reference-chasing work to dedicated helper hardware, letting the primary chip stay productive while cleanup happens in parallel.
US 2026/0319769 A1
Confirms the memory bottleneck problem: phones must repeatedly flush and reload AI models for sequential tasks, even when the same routine repeats. Google's approach keeps a full camera burst workflow resident on chip to avoid the reload tax.
US 2026/0319741 A1
Grouping identical values before multiplication cuts the operation count from tens of thousands to just 15, reducing both energy use and latency in the multiply-accumulate cycles that dominate AI inference.
US 2026/0319938 A1
Selective lower-precision arithmetic during inference. Microsoft's approach isolates which model layers tolerate reduced numerical resolution, mapping a path toward cheaper inference without retraining the full model.
US 2026/0320481 A1
Buffering checkpoints to fast memory before writing to disk reduces idle time during training runs, attacking the coordination delays that force entire chip clusters to pause between compute cycles.
US 2026/0319838 A1
Queuing decisions under memory pressure rely on a cost-benefit calculation that weighs response quality against storage constraints, shifting some requests to slower storage when GPU memory fills up during concurrent inference.
US 2026/0319843 A1
The memory bottleneck problem gets a data translation layer: when graphics cores and specialist processors on the same chip use incompatible formats, Nvidia's approach lets them share cached work without forcing each engine to convert on the fly.
US 2026/0319775 A1
Fusing consecutive operations into single kernel calls reduces intermediate data stored to memory, directly cutting the transfer overhead that dominates compute time on modern AI accelerators.
US 2026/0310502 A1
Dynamic workload migration between heterogeneous processors, including GPUs, reduces idle time when one chip type saturates while others remain available.
US 2026/0310664 A1
Constant-size memory buffer instead of linear growth with sequence length cuts the core cost driver for long-context inference on hardware with tight VRAM.
US 2026/0310353 A1
AMD's batching approach directly targets the memory bottleneck in image recognition models, showing a path to run inference on standard hardware by processing data incrementally rather than loading entire models into cache at once.
US 2026/0310946 A1
Extends the coordination layer by routing requests upstream based on computational weight, not just queuing them uniformly. Moves the scheduling decision earlier, before requests reach inference chips.
US 2026/0310929 A1
Shared memory buffers for draft candidates during inference cut redundant storage of context across parallel decoding paths, compressing a 27.4 GB footprint to 2.7 GB in one benchmark.
US 2026/0312661 A1
Phones broadcast their available compute capacity to cell towers before accepting signal-forecasting tasks, letting networks avoid overloading devices already juggling multiple workloads on shared silicon.
US 2026/0311794 A1
A spare column of processing blocks lets manufacturers disable defective units without scrapping the entire chip, reducing yield loss in high-defect manufacturing environments where AI chips are produced at smaller geometries.
US 2026/0311057 A1
Compressed intermediate results flow between servers during computation rather than after, cutting idle time when one chip waits for another to finish its portion of a distributed inference task.
US 2026/0310516 A1
Apple's patent describes a phone that tells the cell network how many AI jobs it can run at once, and which jobs go first when it is overloaded.
US 2026/0312885 A1
Embedding inference capacity directly in network switches cuts latency by processing requests at the edge rather than routing them to remote data centers, addressing the coordination overhead between distributed AI systems.
US 2026/0311068 A1
Within the memory bottleneck problem, this filing targets the specific waste of parallel expert models. Storing deltas instead of full copies could free up significant chip memory for actual computation.
US 2026/0310960 A1
Predictive thermal throttling shifts workload distribution forward in time, moving tasks off cores before heat spikes rather than after. This targets the scheduling layer that determines which processor does what work and when.
US 2026/0310941 A1
Within the memory bottleneck problem, Qualcomm proposes pre-allocating buffer space for the full response rather than expanding it incrementally as tokens generate, reducing the coordination overhead between memory allocation and computation during inference.
US 2026/0311285 A1
Masking network card failures at the hardware level lets distributed training continue without forcing software restarts and rollbacks, directly reducing the coordination overhead that slows multi-chip workloads.
US 2026/0310596 A1
Confirms the memory bottleneck fix runs deeper than chip-to-chip coordination: AMD's approach gives individual processing units their own memory pools so multiple tasks can execute in parallel rather than queue serially.
US 2026/0300709 A1
The memory bottleneck has dominated this watchlist: most AI chip power goes to shuffling data rather than computing. AMD's approach reduces those fetch-and-store cycles by batching operations differently, cutting the round trips between processor and memory.
US 2026/0299806 A1
Dynamic reallocation of reserved memory pools based on runtime usage patterns addresses the fixed-partition waste problem that hampers multi-task efficiency on high-throughput chips.
US 2026/0303867 A1
Within the memory bottleneck problem, Sony's approach shifts compression work from storage to computation, deriving codec tables dynamically rather than pre-loading them. This matters especially for edge devices where silicon real estate is scarce.
US 2026/0300428 A1
Memory bottlenecks have driven chip makers toward fused operations; AMD's combined math-and-cleanup instruction extends that approach by collapsing reformatting overhead into the compute step itself.
US 2026/0300006 A1
Within task scheduling, this exposes the GPU's internal work distribution as programmable rather than fixed, letting applications optimize their own parallelism instead of accepting the hardware's default choices.
US 2026/0296410 A1
Adds a path around the attention mechanism's floating-point cost by using integer math instead, directly confronting the compute bottleneck in real-time inference on edge hardware.
US 2026/0299943 A1
Shared memory pools between thread groups let GPUs run matrix operations without duplicating data across thousands of parallel processes, directly reducing the idle compute cycles that plague current distributed math tasks.
US 2026/0300186 A1
The memory bottleneck gets sharper when processors load data destined for the trash heap. Intel's controller predicts which fetches will go unused, freeing cache space for data that computations actually need.
US 2026/0300701 A1
Segregating parameters by distribution shape before compression allows different quantization strategies per group, directly targeting the memory bottleneck that limits multi-chip coordination and throughput in large model inference.
US 2026/0300185 A1
Memory lookup delays rank high in the bottleneck category. Intel's prefetching approach signals confidence that speculative address grabbing can beat the performance hit of TLB misses.
US 2026/0300680 A1
Amazon's compression approach fits the memory bottleneck problem by keeping weights in compressed form during inference, reducing the data movement costs that slow down chip-to-memory cycles.
US 2026/0300178 A1
The chip's two-phase approach to inference, full cores for the initial lookup burst, then power-down to fewer cores for sequential token generation, targets the energy waste that dominates on-device AI.
US 2026/0300089 A1
Encrypted storage with embedded error-correcting codes lets AI models detect and repair hardware bit flips during inference without performance overhead, moving reliability upstream from software checks to the silicon itself.
US 2026/0303119 A1
Header fields that record per-number size allow variable-width storage instead of fixed allocations, cutting wasted space in the memory bottleneck that slows multi-chip coordination.
US 2026/0299960 A1
The chip's ability to dynamically reassign tile IDs mid-computation directly targets the scheduling bottleneck: encrypted workloads can now rebalance across tiles without pausing, rather than locking into fixed configurations at startup.
US 2026/0299946 A1
Dynamic precision scaling lets a single chip switch between high and low math accuracy based on immediate sensor demands, trading off compute speed against result quality in real time rather than locking in one tradeoff at design time.
US 2026/0299955 A1
Memory latency has been the bottleneck holding back AI chip performance. Intel's approach predicts memory values before the processor requests them, reducing the fetch delays that compound across billions of operations in AI workloads.
US 2026/0299227 A1
Optical interconnect replaces electrical signaling between chips and memory, bypassing the heat and latency costs of copper wires in multi-chip coordination.
US 2026/0301109 A1
Offloading network packet preparation to GPU cores in parallel rather than routing through a dedicated network processor, reducing coordination overhead when moving data between chips in multi-GPU systems.
US 2026/0301396 A1
Frame-skipping logic reduces redundant computation in video pipelines by filtering static scenes before they reach the main AI processor, lowering power consumption in edge camera systems.
US 2026/0299881 A1
Varying numeric precision token-by-token lets inference run at automotive latencies without sacrificing the accuracy that safety-critical driving tasks demand.
US 2026/0300779 A1
Offloading data formatting to the network interface card keeps GPUs from stalling while waiting for cleaned input, shifting preprocessing from compute resources to the connector layer.
US 2026/0299533 A1
Quantizing neural network inputs on the fly lets inference hardware move more data per cycle, reducing the power cost of running decision models on edge chips rather than offloading to centralized processors.
US 2026/0300712 A1
Low-precision arithmetic during addition and subtraction has blocked compression gains in prior approaches. Nvidia's patent describes hardware that performs these operations in reduced precision, unblocking compression depth for the rest of the model.
US 2026/0301107 A1
Within the memory bottleneck problem: merging AI and graphics onto one die lets both engines access shared memory directly, cutting the data shuttle delays between separate chips.
US 2026/0300819 A1
Checkpointing and rapid server substitution during distributed training runs. Cuts the restart penalty when hardware fails mid-job, relevant to coordination costs across multi-chip clusters.
US 2026/0300167 A1
Memory bottlenecks have pushed vendors toward compression. Microsoft's method keeps precision by encoding chunks against shared reference tables, reducing storage without sacrificing accuracy.
US 2026/0288543 A1
Predictive frequency scaling embedded on-chip cuts the reaction lag that forces throttling: the system forecasts thermal and power constraints from live workload signals rather than waiting for temperatures to spike.
US 2026/0289339 A1
Where coordination across multiple chips creates routing bottlenecks, Nvidia's AI model predicts congestion hotspots during design rather than after layout is locked in.
US 2026/0288485 A1
The chip's power scheduler currently relies on reactive guessing; Google proposes moving to predictive allocation by embedding a lightweight model on the processor itself.
US 2026/0289390 A1
Within the memory bottleneck problem: Qualcomm targets the storage and transfer costs of model updates by patching weights incrementally instead of replacing entire files.
US 2026/0288531 A1
Automatic tensor partitioning across heterogeneous processors eliminates manual per-chip optimization, letting identical AI code run efficiently on mobile, laptop, and server hardware without hardware-specific rewrites.
US 2026/0288468 A1
Selective computation on sparse input data cuts idle power draw in voice-activated chips, a direct efficiency gain when processors must remain always-listening but mostly dormant.
US 2026/0288661 A1
Memory bottlenecks have dominated the watchlist so far. AMD's filing shows a potential workaround: repurposing idle cache as temporary AI workspace rather than building dedicated buffers.
US 2026/0288585 A1
Swapping AI model state to disk during inference lets phones run generative models without permanently reserving large memory blocks, directly addressing the memory bottleneck that forces most devices to offload AI work to the cloud.
US 2026/0289719 A1
Horizontal strip processing reduces peak memory demand by processing image data as it streams in rather than buffering complete frames, directly attacking the memory bottleneck that delays results on device-side AI inference.
US 2026/0288514 A1
GPU idle time from CPU handoffs is a known bottleneck in AI workloads; AMD's approach lets the chip self-schedule task queues, reducing coordination overhead between processors.
US 2026/0288358 A1
Confirms the chip-to-chip coordination problem runs deeper than software scheduling: AMD is redesigning the physical memory layout so adjacent processors can read and write each other's data without routing through a congested central bus.
US 2026/0288334 A1
Placing a memory block between processor clusters with dual access ports reduces latency when two independent processing groups need to share working data without routing through slower hierarchical caches.
US 2026/0288469 A1
Streaming model layers to edge devices in chunks instead of loading the full model cuts peak memory demand, directly addressing the memory bottleneck that prevents large AI models from running on resource-constrained chips.
US 2026/0288216 A1
Within the multi-chip coordination problem, Sony proposes eliminating a dedicated wake-up wire by encoding startup signals into existing data lines, reducing physical routing overhead in densely packed AI accelerators.
US 2026/0278456 A1
Data compression corrupts model weights unevenly, and Qualcomm's approach prioritizes repairs on the most error-sensitive parameters first, directly addressing the quality degradation that has made compression a bottleneck for on-device AI deployment.
US 2026/0278365 A1
Variable input sizes force chips to idle or stall between batches. Intel's patent optimizes scheduling so chips stay busy regardless of data chunk dimensions.
US 2026/0278354 A1
Extends the data compression track with a method to preserve model accuracy during block-level quantization, addressing quality loss when shrinking neural networks for mobile deployment.
US 2026/0278378 A1
Faster memory speeds up multi-chip AI work only if data movement itself doesn't become the bottleneck. AMD's patent uses selective compression during off-chip transfers to cut bandwidth demands without the overhead of compressing everything.
US 2026/0278037 A1
Matrix multiplication speed constrains AI chip throughput, and Intel's filing reveals a chip that learns to partition numeric grids more efficiently, automating optimization work currently done by hand at design time.
US 2026/0277821 A1
Memory chips handling their own address translation reduces round trips to the main processor, attacking the data shuttle bottleneck that drains power in mobile AI workloads.
US 2026/0278422 A1
Nvidia's filing schedules work by predicting what comes next instead of reacting to the current queue, placing jobs before bottlenecks form.
US 2026/0277810 A1
Vertical stacking of heterogeneous processors in a single package reduces the physical distance data must travel between compute cores and memory, directly cutting the latency that creates bottlenecks when coordinating work across specialized chip types.
US 2026/0277834 A1
Confirms the shift toward task scheduling through hardware splits: Samsung's dual-processor design lets inference jobs run concurrently rather than sequentially, moving the bottleneck from software queuing to physical chip layout.
US 2026/0277616 A1
Qualcomm adds a dependency-aware scheduling layer to the task scheduling problem, allowing out-of-order execution while respecting critical instruction sequences that cannot be reordered.
US 2026/0278406 A1
Predictive resource staging sidesteps the wait-and-allocate bottleneck by frontloading capacity decisions based on agent workflow patterns, directly addressing how multi-task coordination costs accumulate when servers react instead of prepare.
US 2026/0277615 A1
Reordering independent operations within dependency constraints speeds execution without stalling downstream tasks, directly addressing the scheduling bottleneck when coordinating work across AI accelerator cores.
US 2026/0277784 A1
Sparse matrix compression via selective zero-skipping lets chips store and retrieve only non-zero values, cutting the memory and bandwidth waste that comes from moving mostly-blank data across multiple processors.
US 2026/0277605 A1
The memory bottleneck shows up here as a throughput problem: Qualcomm's design batches multiple calculations into single instructions, reducing the overhead of moving data in and out of the chip rather than shrinking the memory itself.
US 2026/0278386 A1
Overlapping two network phases instead of queuing them sequentially cuts idle time in text generation, directly confronting the scheduling bottleneck that makes autoregressive models wait between processing and token output.
US 2026/0277467 A1
Memory bottlenecks get worse when chips can't shed overload to neighbors. Samsung's system lets saturated memory chips request capacity from idle resources nearby, turning static allocations dynamic.
US 2026/0277478 A1
Predictive rerouting of memory requests detects contention between data streams before bottlenecks form, moving traffic to idle chips rather than forcing sequential access to saturated ones.
US 2026/0277289 A1
Modern chips cram in performance cores, efficiency cores, and AI processors all at once, and deciding how much power each one gets is a genuinely hard math problem. Qualcomm has filed a patent for a system that hands out power in weighted "credits," adjusting on the fly when some cores are idle.
US 2026/0277446 A1
Within the memory bottleneck track, Samsung's switch moves data traffic away from congested chips in real time, shifting focus from static allocation to dynamic load balancing during operation.
US 2026/0278351 A1
A single hardware instruction that fuses two separate math operations cuts the computation cycles needed for SoftMax calculations, one of the most frequent bottlenecks in AI inference on Nvidia's processors.
US 2026/0279420 A1
Dynamic clock scaling in the memory controller reduces parasitic power draw when the chip services long latency operations, directly attacking the coordination overhead between processors and memory, a key bottleneck in multi-chip systems under heavy load.
US 2026/0279419 A1
Per-wire timing correction isolates memory signal drift instead of applying blanket adjustments across all connections, cutting read errors at high speeds where sync loss compounds.
US 2026/0277765 A1
Runtime resource reallocation based on observed task behavior directly counters the memory bottleneck problem by shifting compute dynamically rather than front-loading it.
US 2026/0278026 A1
Prompt caching cuts redundant computation across requests, directly attacking the memory bottleneck that slows inference on long contexts.
US 2026/0268148 A1
Smaller AI chips could run large models without needing access to the original training data, reducing both memory demands and the logistics of dataset sharing across devices.
US 2026/0268996 A1
Faster AI inference means chips spend less time idle, so memory errors go undetected longer. Qualcomm's approach catches failures during whatever downtime remains, keeping data integrity intact as workloads intensify.
US 2026/0268146 A1
Collapsing multiple processing layers into a single operation keeps intermediate data in fast cache memory instead of shuttling it back to slower storage, directly shrinking the memory bottleneck that slows multi-chip AI systems.
US 2026/0267891 A1
Data compression across transformer layers: Samsung's two-pass method filters low-relevance sentences before full processing, reducing the token volume that demands expensive attention operations on long documents.
US 2026/0267843 A1
Memory bottlenecks in recommendation models stem from lookup tables too large for system RAM. Samsung's approach moves embedding vectors to specialized storage with direct GPU access, eliminating the fetch-and-wait cycle that starves compute resources.
US 2026/0268651 A1
Pipelining inference across multiple chips removes the serial dependency chain that forces each layer to wait for the previous one to complete.
US 2026/0268872 A1
Keeping distributed chip clusters synchronized across power state transitions. Apple's approach uses a dedicated broadcast layer so waking components can resync with current system state without full handshakes between every pair of chips.
US 2026/0268634 A1
Cuts the data footprint for on-device visual matching by encoding image features into compact codes, reducing what needs to move between the chip's memory and processor during real-time recognition tasks.
US 2026/0268142 A1
Data compression via pruning hits the memory bottleneck directly. Xilinx's dual-signal approach automates weight trimming across distributed inference, reducing the on-chip storage demands that currently force data movement between processors.
US 2026/0270197 A1
Data coordination across multiple chips hits a specific problem: managing predictable congestion waves during distributed training. Microsoft's central scheduler spreads traffic across network paths in advance, preventing bottlenecks before they form.
US 2026/0267939 A1
Cutting attention's math load directly shrinks the compute budget for vision inference, which matters because attention scales with image complexity and currently dominates the work inside these models.
US 2026/0269843 A1
Data decompression method selection has been a software bottleneck; Samsung's filing moves that decision into hardware, letting chips automatically pick the right unpacking approach based on storage location rather than slowing down for software lookups.
US 2026/0267692 A1
Task scheduling across heterogeneous processors gains a concrete use case: Intel's system routes graphics workloads between integrated and discrete chips based on thermal and power constraints, automating decisions that currently rely on fixed rules.
US 2026/0267512 A1
Memory bottlenecks drive up hardware costs when every layer of an AI model runs on premium chips. Microsoft's approach routes less critical computation through cheaper processors, keeping only the highest-value operations on expensive silicon.
US 2026/0267687 A1
Task scheduling between compute and memory hits a bottleneck when compilers guess the operation order. Intel's approach uses a learned model to optimize sequencing instead of relying on heuristics.
US 2026/0270448 A1
Data compression in video processing cuts what AI chips must ingest by filtering frames before they reach the processor, reducing the memory-to-compute bottleneck on resource-constrained devices.
US 2026/0267655 A1
Faster AI means switching execution modes mid-operation instead of picking one strategy upfront. Intel's filing shows hardware that detects phase changes and resets processor behavior automatically.
US 2026/0267369 A1
Data compression in AI chips moves from algorithmic tricks to hardware caching: Intel's lookup table approach pre-stores computation results to cut repeated math, trading memory space for power and latency gains.
US 2026/0260115 A1
Dynamic batch sizing before computation begins eliminates the fixed allocation overhead that leaves memory half-empty or overflowed during image processing tasks on AI chips.
US 2026/0259715 A1
Task scheduling across CPU and GPU cores gains a dynamic angle: rather than pre-compiled work division, the CPU can translate and offload GPU instructions during execution, eliminating idle time between processors.
US 2026/0262196 A1
Thermal management in stacked processors: Microsoft's modular heat sink design enables coolant flow across multiple axes simultaneously, addressing the constraint that single-direction cooling can't match modern chip density.
US 2026/0260105 A1
Specialized multiplication units shrink by reusing circuitry across multiple operations, letting Intel pack more compute into the same die area and lower the per-operation cost of running inference at scale.
US 2026/0259808 A1
Coordination across multiple chips requires simultaneous visibility into processor states. Nvidia's parallel query system eliminates sequential checking delays that make real-time monitoring impractical at scale.
US 2026/0260091 A1
Predicting model architecture constraints before training lets engineers skip the costly trial-and-error cycle of testing dozens of designs on target hardware, moving the chip-to-model fit upstream.
US 2026/0260144 A1
Faster data loading into quantum processors could preserve more of the speed gains quantum hardware promises, by parallelizing a translation step that currently runs sequentially and consumes significant resources.
US 2026/0259731 A1
Repurposing existing vector CPU instructions as matrix operations eliminates the need for custom silicon, offering a software-only path around the memory and compute bottlenecks that plague general-purpose processors running AI workloads.
US 2026/0259730 A1
Faster AI inference means cutting wasted computation in attention mechanisms. Nvidia's compiler identifies masked-out matrix cells before runtime, eliminating calculations the model would skip anyway.
US 2026/0259594 A1
Power consumption compounds the memory bottleneck problem. Sony's approach powers down memory sections immediately after use rather than leaving them live, directly cutting wasted energy in densely packed chip designs.
US 2026/0259716 A1
Chips stay idle less when a single compiled program automatically distributes work across CPU and GPU without manual rewrites.
US 2026/0260631 A1
Cutting the control wiring between AI chips from N lines down to one lets system designers pack more memory and processors into the same physical space, directly easing the coordination bottleneck across multiple chips.
US 2026/0252840 A1
Memory reuse across output channels cuts the arithmetic operations required per AI inference, reducing both latency and power draw in edge processors.
US 2026/0252488 A1
Memory bandwidth waste from speculative caching drains performance on multi-chip AI systems. Samsung's approach predicts actual data access patterns per application, reducing the false loads that fragment fast storage across distributed inference tasks.
US 2026/0252502 A1
Cache coherency across multiple processors demands a coordination layer that tracks which chips hold stale copies of shared data. Samsung's patent automates this synchronization to prevent processors from operating on outdated memory values.
US 2026/0254975 A1
Within the memory bottleneck problem, this constrains where video encoder reference data can live, keeping fetches local to single chips rather than cross-chip, reducing coordination overhead.
US 2026/0254974 A1
Dividing memory blocks to avoid split fetches between fast and slow storage shrinks latency in video encoding, a key bottleneck as AI inference demands coordinated access across distributed chip hierarchies.
US 2026/0252386 A1
Task scheduling on a single chip: Apple's approach preserves context when switching between concurrent AI workloads, suggesting the company is optimizing for efficient multitasking rather than dedicated processors per function.
US 2026/0252160 A1
Cutting voltage to idle memory banks rather than powering them down completely reduces the wake-up lag that would otherwise slow performance, directly addressing the memory power drain that degrades battery life across millions of devices.
US 2026/0252152 A1
Extends the coordination problem beyond task scheduling to thermal management: keeping multiple AI models running simultaneously requires real-time power arbitration, not just workload distribution.
US 2026/0252384 A1
Memory bank conflicts force GPU threads to stall when they compete for the same data location. Intel's approach routes task scheduling to prevent simultaneous access to individual banks.
US 2026/0252387 A1
Automatic memory slot reclamation from stalled tasks prevents the cascading slowdown that hits multi-chip systems when one processor can't offload work to others, addressing a key coordination problem in distributed AI inference.
US 2026/0252889 A1
Task scheduling across distributed chips slows training when weight updates serialize billions of calculations. Nvidia's approach parallelizes this step by having multiple chips compute simultaneously rather than sequentially.
US 2026/0252278 A1
The memory bottleneck in multi-chip systems has pushed toward optical interconnects. Apple's light-based routing sidesteps the electrical wire constraints that plague distributed server memory, moving the coordination problem from copper to fiber.
US 2026/0252396 A1
Data compression in image processing: Nvidia's approach filters redundant pixels before computation enters the pipeline, reducing the math workload for downstream hardware.
US 2026/0252460 A1
Faster historical data ingestion across distributed workers means AI systems could move past single-machine bottlenecks during training, directly cutting the time needed to prepare models on long time-series datasets.
US 2026/0252664 A1
Faster softmax computation cuts power consumption during the probability-scoring step that happens billions of times across inference. Confirms the chip wars are shifting toward optimizing the inner loops of transformer math, not just memory bandwidth.
US 2026/0252352 A1
If Intel's approach works at scale, chips could resume interrupted memory operations without restarting, freeing up the stalled compute cycles that currently pile up waiting for data to arrive from scattered memory banks.
US 2026/0252953 A1
Task scheduling under resource contention: Nvidia's approach monitors real-time chip load and reconfigures model architecture dynamically rather than queuing or degrading performance.
US 2026/0254641 A1
Decrypting data at the memory chip itself rather than on the main processor cuts the data movement between components, directly easing the memory bottleneck that slows AI workloads.
US 2026/0252498 A1
Isolating cached data between programs adds a hardware layer against timing-based attacks, confirming that cache arbitration is becoming a competitive feature in multi-tenant chip designs.
US 2026/0253562 A1
Faster data movement between chips could come from using light beams across transparent displays as a processing medium, sidestepping the conventional electrical pathways that create memory bottlenecks in multi-chip systems.
US 2026/0252525 A1
Decompressing data inside memory rather than shuttling it to a distant processor cuts the energy cost of the memory bottleneck, a core constraint in stacking more AI work onto mobile devices.
US 2026/0252663 A1
Faster matrix multiplication reduces inference latency directly, meaning AI models respond quicker without needing more chips or memory bandwidth to handle the workload.
US 2026/0253255 A1
Data compression in vision pipelines cuts storage by skipping redundant frame analysis. Confirms the chip wars are pushing deep into the sensor layer, not just core compute.
US 2026/0252661 A1
Data routing between specialized compute units constrains throughput on dense AI chips. Nvidia's circuit-level partition scheme routes matrix operations to matched hardware blocks, reducing idle cycles and data movement overhead across the chip.
US 2026/0253407 A1
Reducing what gets stored in memory rather than compressing it after the fact means AI video systems could run on devices with tighter memory budgets. This shifts the bottleneck from storage capacity to the speed of filtering decisions.
US 2026/0252662 A1
Parallel matrix ops within a single instruction reduce the compute cycles needed per AI calculation, directly loosening the memory bottleneck that forces chips to stall while waiting for data to arrive.
US 2026/0255054 A1
An always-on sensor chip wakes the camera controller and main processor in parallel rather than sequentially, eliminating the boot delay that slows photo capture on devices with dormant cores.
US 2026/0252560 A1
Memory bandwidth limits data lookups on CPUs alone. Microsoft's approach splits the work by having the CPU filter data first, then passes the trimmed set to the GPU for parallel searching, reducing total bandwidth demand.
US 2026/0252394 A1
Dynamically resizing models based on chip load lets AI inference pull back during bottlenecks instead of forcing peak compute every time, easing the memory and scheduling crunch when multiple tasks compete.
US 2026/0254870 A1
Data routing between chips can bypass the shared bus when point-to-point communication is detected, reducing congestion that slows multi-chip inference workloads.
US 2026/0244442 A1
A conversion circuit embedded in the processor eliminates the software translation step between incoming data formats and what the AI engine expects, reducing latency and power waste before computation begins.
US 2026/0244402 A1
OpenAI's filing runs both decimal and whole-number math in the same compute block, so data doesn't shuttle between separate units.
US 2026/0244577 A1
Swapping between two address-mapping schemes based on task type lets in-memory processing bypass the scrambling overhead that slows it down on conventional workloads, directly easing the memory bottleneck when computation moves closer to data.
US 2026/0246931 A1
Data compression has been a bottleneck in AI chip design, and Sony's filing shows how synchronization between parallel encoding threads can prevent slowdowns when multiple processors work on image compression simultaneously.
US 2026/0244503 A1
AMD's filing splits a calculation across several chips on demand, treating coordination between chips as a scheduling job.
US 2026/0244403 A1
Memory bottlenecks shrink when chips stop moving zero values through their pipelines at all. OpenAI's design catches zeros before multiplication, cutting both data movement and computation waste.
US 2026/0246665 A1
Qualcomm's filing has individual devices report how much data they can compress, so a network can spread AI work across them efficiently.
US 2026/0244906 A1
Intel's filing has the chip itself decide which calculations to skip, so less data gets processed in the first place.
US 2026/0244705 A1
Letting separate processor clusters apply their own scaling factors to matrix operations cuts the accuracy loss from forced quantization while avoiding the silicon cost of duplicating full conversion hardware.
US 2026/0244630 A1
The memory bottleneck thread gets a direct solution: moving computation into the storage itself rather than shuttling data across the chip to a processor.
US 2026/0244482 A1
The memory bottleneck thread gains a hardware-level solution: rather than processors waiting their turn at shared memory, the memory chip itself manages task switching and state preservation, moving coordination from software layers into silicon.
US 2026/0246131 A1
The chip-to-chip coordination bottleneck: Samsung routes signals through existing solder bumps rather than adding separate wiring, cutting parasitic losses in inter-chip communication.
US 2026/0245613 A1
Embedding compute directly in memory arrays cuts the energy cost of shuttling data between separate processor and storage units, addressing the memory bottleneck that drains power in dense AI workloads.
US 2026/0244860 A1
Storing the key-value cache during generation forces a memory-per-token tax that grows with sequence length. IBM's compression method prunes this cache on the fly, cutting the storage load before it stalls inference speed on long documents.
US 2026/0244987 A1
Memory compression already drives the chip wars. Google's filing shows a path forward: custom bit widths that break free from fixed power-of-two formats, letting engineers dial precision per layer instead of forcing every calculation into standard sizes.
US 2026/0244254 A1
Dynamic power allocation based on workload priority reduces idle consumption during low-intensity tasks, directly addressing the energy waste that constrains multi-chip AI training efficiency.
US 2026/0244973 A1
The memory-sharing architecture here sidesteps the coordination bottleneck by letting cores access neighboring cache directly, cutting the latency that kills error correction speed in distributed quantum systems.
US 2026/0244483 A1
A dedicated scheduling engine in hardware eliminates the software overhead when high-priority tasks arrive, shrinking latency in multi-chip AI systems where coordination delays compound across distributed processors.
US 2026/0246480 A1
The memory bottleneck thread gains a practical filter: Qualcomm's method identifies which data values actually compress well before wasting cycles on the rest, cutting wasted effort in moving model weights between storage and compute.
US 2026/0244404 A1
OpenAI's filing switches between decimal and whole-number math partway through a calculation, cutting the data moved between chip and memory.
US 2026/0244498 A1
Automatic routing between quantum and classical processors moves the integration problem from user code into infrastructure, similar to how AWS already distributes conventional workloads across multiple machine types.
US 2026/0244903 A1
Fusing requantization into the data path itself rather than treating it as a separate pipeline stage cuts the conversion overhead that normally stalls sequential model execution on mobile processors.
US 2026/0244473 A1
Memory bottlenecks have pushed compute into storage itself. Qualcomm's translation layer lets multiple tasks virtualize a single in-memory processor, removing the serialization bottleneck that forces chips to choose between speed and coordination.
US 2026/0244488 A1
The coordination problem across heterogeneous hardware gets a concrete solution here. Intel's automatic workload distribution removes the manual engineering step that currently leaves chips underutilized in mixed-processor servers.
US 2026/0236679 A1
Faster AI responses depend on predicting which model weights the main chip needs next. This coprocessor prefetches data into cache, reducing the stall time between token generations.
US 2026/0236325 A1
Task scheduling across device boundaries requires routing decisions in real time. Microsoft's offload die automates which model layers run locally and which ship to cloud, reducing the latency penalty of splitting computation.
US 2026/0237372 A1
Data compression in audio processing: splitting noise cancellation into fast and efficient tracks lets chips skip full computation cycles and only run high-power operations when sound conditions change.
US 2026/0236809 A1
Data compression via quantization lets AI models run on phone chips by reducing mathematical precision while preserving accuracy, extending the chip wars into consumer devices where memory and power constraints are even tighter than data centers.
US 2026/0236402 A1
AI video processing needs to shed stored frames selectively rather than halt entirely. Qualcomm's method ranks frame snapshots by relevance, dumping redundant ones to keep models running on device.
US 2026/0238834 A1
Memory bottlenecks in AI training rely on sequential decompression of compressed images. Qualcomm's method parallelizes that decompression step, letting multiple image chunks decompress at once so processors stay busy rather than waiting for data.
US 2026/0236467 A1
Memory bottlenecks force choices between speed and capacity. Intel's system automates this by dynamically moving model layers between fast and slow storage at runtime, letting devices run larger models without redesigning hardware.
US 2026/0236744 A1
Splitting inference workloads between nearby devices lets a phone handle AI tasks its chip alone cannot process locally, avoiding cloud latency.
US 2026/0238784 A1
AI video restoration on phones has been bottlenecked by power consumption; breaking the filtering into sequential lightweight operations lets mobile chips deliver visual quality without exhausting the battery.
US 2026/0236190 A1
Memory interface translation has been a persistent friction point in multi-memory systems. Samsung's solution embeds a dedicated processor to handle protocol conversion between heterogeneous memory types, reducing the latency tax of asynchronous handshakes.
US 2026/0236839 A1
Memory access patterns during recommendation training consume enormous bandwidth. Samsung's method reorganizes how lookup data moves between storage and processors, reducing the fetch overhead that currently dominates training time.
US 2026/0236732 A1
Routing delays between processor sections drain energy even at microscopic scales. Google's patent embeds a dedicated dispatcher into the chip itself to shunt math operations directly to their target units without software overhead.
US 2026/0237056 A1
Chip localization on circular wafers requires the inspection AI to map physical position before defect detection. Samsung's polar coordinate approach solves this by establishing spatial reference before analysis begins.
US 2026/0237022 A1
Data compression methods for maintaining temporal context across video frames reduce memory footprint in real-time inference, letting AI upscalers preserve multi-frame dependencies without sacrificing speed on edge hardware.
US 2026/0236763 A1
Faster inference means cheaper model serving at scale. Nvidia's draft-verify approach lets a smaller model propose token candidates before the main model validates them, cutting compute per output without sacrificing quality.
US 2026/0236298 A1
Task scheduling across competing processes keeps graphics smooth by letting the display process jump ahead when it needs shared resources, rather than waiting for background apps to finish.
US 2026/0236776 A1
Uneven memory use during training wastes space on dormant connections. IBM's approach identifies which neurons actually matter and reserves memory for those, freeing up space that typically goes unused.
US 2026/0236396 A1
Offloading memory translation from the processor to a dedicated controller frees up CPU cycles for compute work, directly attacking the memory bottleneck that slows down AI inference on edge devices.
US 2026/0236755 A1
Data compression introduces unpredictable errors across different inputs. Qualcomm's approach pinpoints which layers degrade most and applies layer-specific corrections without retraining the model.
US 2026/0236306 A1
Distributing model storage across separate nodes reduces what any single machine must hold in memory, attacking the memory bottleneck that forces companies to buy expensive unified systems today.
US 2026/0237209 A1
Better video compression in AI chips means less data shuttling between memory and processors, directly easing the memory bottleneck that slows multi-chip AI systems.
US 2026/0236083 A1
Better power prediction means chips burn less energy waiting for heavy tasks that never come, directly cutting the battery drain that comes from over-provisioning.
US 2026/0236753 A1
Faster AI inference on a single chip means less time waiting for math results. Xilinx's lookup tables let the chip skip repeated calculations of activation functions, cutting latency where models spend most of their compute time.
US 2026/0228560 A1
Dynamic hyperparameter adjustment during inference reduces the need for separate model versions tuned to different workloads, consolidating what the field has approached as a chip coordination problem into software control.
US 2026/0228532 A1
Memory bottlenecks continue to define AI chip design constraints. Samsung's patent targets KV cache growth during inference, showing how selective retention of attention data could let models run on memory-constrained devices without retraining.
US 2026/0228004 A1
Memory bandwidth constraints have forced chip designers to choose between raw speed and efficiency. Xilinx's approach lets a single chip dial down only when export rules actually require it, keeping performance where the math allows.
US 2026/0228001 A1
Intel's filing shrinks the numbers in a common AI calculation to 4 bits and expands them on the fly, with no new hardware needed.
US 2026/0230089 A1
Staged conversion with single rounding point cuts accumulated errors during format shifts, a basic lever for preventing precision loss across long calculation chains on multi-chip systems.
US 2026/0227959 A1
Memory bandwidth has been the watchlist's throughline; this filing shows how on-chip parallelism can shrink the data movement required for a single operation.
US 2026/0228002 A1
A single hardware instruction that performs data normalization eliminates the multi-step software conversions that currently consume chip cycles between calculations, reducing the intermediate memory traffic that slows down AI workloads.
US 2026/0228085 A1
Tracking state through power cycles cuts the overhead of reinitializing all chip subsystems at once, shrinking the latency spike when devices wake.
US 2026/0228008 A1
Offloading decompression to a separate hardware engine keeps the main processor free for calculations, addressing the data preparation bottleneck that slows throughput in multi-chip AI systems.
US 2026/0228097 A1
Automated calibration across process variation lets a single tuning profile work on chips with different electrical characteristics, shrinking the coordination burden in high-volume production.
US 2026/0228302 A1
The coordination problem deepens: AMD's method prevents GPU cores from sitting idle by pipelining calculations across separate core groups, shifting focus from memory bottlenecks to synchronization costs within a single chip.
US 2026/0228094 A1
Qualcomm's filing keeps chips coordinating through a failed connection, avoiding restart delays that spread across a whole chip package.
US 2026/0228280 A1
Memory bottlenecks have dominated this watchlist; Apple's compression method via lookup tables suggests the path forward isn't shrinking the weights themselves but reducing how often the chip retrieves them from storage.
US 2026/0228135 A1
Selective eviction from the KV cache lets models drop old context without forcing expensive reloads of recently used data, directly addressing the memory pressure that limits how long AI conversations can run.
US 2026/0228052 A1
Specialized cores sit idle while general-purpose ones bottleneck on AI workloads. Automatic routing keeps accelerator hardware fed with matching tasks, reducing scheduler overhead.
US 2026/0229302 A1
Sending voltage pulses through resistor grids to compute multiplication directly in hardware sidesteps the energy cost of shuttling data between memory and processors, one of AI chip design's recurring constraints.
US 2026/0228605 A1
Qualcomm's filing spreads the layers of an AI model across several processors to avoid a single bottleneck.
US 2026/0228552 A1
Heterogeneous chip pairing routes inference and training to specialized processors, reducing idle time on general-purpose silicon during large model development.
US 2026/0228007 A1
Samsung's filing adds dedicated hardware inside one processor core so memory updates overlap with other work, cutting idle time.
US 2026/0227955 A1
Memory bottlenecks force chips to pick between speed and precision. This filing shows how to switch between integer and floating-point math dynamically, letting chips avoid slow data movement while keeping calculations accurate.
US 2026/0219882 A1
Embedding computation directly into cache memory eliminates repeated data shuttling between storage and processors, reducing the energy cost of moving information around the chip rather than processing it.
US 2026/0219841 A1
When AI models train on low-precision math to save power and time, tiny rounding errors pile up and degrade accuracy. Nvidia's new patent proposes injecting controlled randomness into the scaling step to fight that drift.
US 2026/0219942 A1
AMD's filing rearranges data ahead of time to match how the hardware reads it, cutting the wasted steps that slow AI training.
US 2026/0222245 A1
Dynamic power gating of network ports based on traffic prediction directly targets the energy overhead of inter-chip communication, where idle connections waste power across the switching fabric connecting multiple AI accelerators.
US 2026/0220011 A1
Memory bottlenecks have dominated this watchlist; Samsung's patent adds a specific fix by pre-staging training data in cache to eliminate compute idle time during the load-and-format stages that currently stall GPU cores.
US 2026/0219838 A1
Memory bottlenecks have pushed chip designers toward computation shortcuts. Xilinx trades multipliers for lookup tables, converting a power drain into a storage problem that favors dense memory architectures.
US 2026/0220225 A1
Qualcomm's filing keeps calculations accurate when chips use compressed numbers, so the math doesn't degrade on low-power devices.
US 2026/0220463 A1
Adaptive compression that lets deployers trade model size for accuracy on demand addresses the compression granularity problem: instead of one fixed compressed version, this approach generates multiple operating points along the size-quality spectrum.
US 2026/0219926 A1
Memory bottlenecks persist partly because power goes to both subsystems equally. AMD's approach dynamically reallocates power from memory to processors during compute spikes, treating the power budget as fluid rather than fixed.
US 2026/0220915 A1
A selection layer that routes user-chosen models to a dedicated inference chip, rather than locking devices to a single factory-installed model. Solves the coordination problem of matching variable software (the model) to fixed hardware (the chip).
US 2026/0220446 A1
Pipelining model layers across chips so each processor handles one stage sequentially eliminates repeated trips to external memory, reducing the bandwidth bottleneck that slows multi-chip inference.
US 2026/0220867 A1
Memory bottlenecks on mobile chips force selective computation: this patent skips redundant AI work between frames, letting interpolation handle the cheaper frames while key-frame processing absorbs the real load.
US 2026/0220454 A1
Nvidia's filing compresses AI data using randomized scaling instead of one uniform setting, which could cut the data moved between chips and memory.
US 2026/0220929 A1
Memory overhead in vision models gets trimmed here: the patent removes a classification token that AI chips process even when the task doesn't require categorization, cutting wasted computation.
US 2026/0220226 A1
Letting programmers manually adjust number scaling before computation pushes back against accumulated rounding errors in compressed-number arithmetic, a direct way to manage precision loss across the data compression challenge.
US 2026/0220449 A1
Google's filing pools memory across sections of a chip with coordinated access, instead of giving each section its own separate buffer.
US 2026/0220525 A1
Task scheduling across chips gets more concrete here: IBM moves from static division rules to adaptive partitioning that responds to actual hardware constraints and model structure in real time.
US 2026/0220340 A1
AMD's filing adds in-order message delivery between the parts of a single chip.
US 2026/0220439 A1
Caching intermediate results across repeated inference steps cuts redundant computation in image generation pipelines, directly reducing the memory and processing cycles that bottleneck multi-chip AI workloads.
US 2026/0219786 A1
The memory-bottleneck problem gets a physical solution: Samsung embeds processors directly in the memory package to cut data movement distances and the energy cost that follows.
US 2026/0220456 A1
Data compression moves upstream: Intel wants to prune models on the control chip before they ever reach the accelerator, cutting transfer time and memory costs in the handoff between server and specialized hardware.
US 2026/0220461 A1
Skipping multiplication operations on zero and near-zero values reduces the actual compute load a chip must handle, directly shrinking the memory and power demands that constrain multi-chip AI systems.
US 2026/0219950 A1
Detecting user frustration from repeated queries lets schedulers prioritize requests based on satisfaction signals rather than arrival order alone, shifting task ordering from pure queue management to behavioral feedback.
US 2026/0222831 A1
Splitting model layers between device and network based on what each can handle locally cuts memory overhead and lets phones run larger models without exhausting batteries.
US 2026/0220227 A1
Dual-mode matrix multiplication on fixed data eliminates the transpose operation that normally requires copying and repositioning values across the chip, cutting a major movement bottleneck in forward and backward propagation.
US 2026/0220041 A1
Splitting inference into a prefill stage that builds the KV cache and a decode stage that generates tokens lets the system discard intermediate attention data, shrinking memory footprint during the computationally cheaper second phase.
US 2026/0211749 A1
Apportioning power consumption across concurrent GPU workloads lets data centers bill tenants accurately and identify which jobs are energy hogs.
US 2026/0212440 A1
A software abstraction layer lets developers coordinate multi-machine training runs without writing low-level networking code, shifting the coordination burden from application developers to the infrastructure itself.
US 2026/0212450 A1
Moving image data between chips via embedded routing instructions lets the interconnect hardware handle stitching automatically, bypassing the software overhead that usually coordinates multi-camera feeds.
US 2026/0211480 A1
Predictive thermal throttling uses recent workload history to cut clock speed before temperature spikes, eliminating the lag between heat buildup and system response.
US 2026/0212160 A1
Predictive frequency scaling cuts the delay between incoming AI workload and power adjustment, moving from reactive throttling to proactive chip tuning based on job patterns.
US 2026/0211839 A1
Local memory coherence across chip boundaries demands constant synchronization overhead. Intel's design automates cache bookkeeping between chips, reducing the coordination work that would otherwise fall to software scheduling layers.
US 2026/0212210 A1
Automatic partitioning of neural network layers across heterogeneous processors removes manual configuration bottlenecks when distributing training workloads, shifting the coordination problem from human engineers to runtime algorithms.
US 2026/0211972 A1
Merging matrix multiplication and accumulation into a single pipeline stage cuts round-trip delays between compute units, directly shrinking the memory-access overhead that slows multi-chip AI inference.
US 2026/0211710 A1
Within the task scheduling layer, this reveals how to move work between chips without losing state, solving the coordination problem when one path gets blocked.
US 2026/0211724 A1
Task scheduling across cores determines which processor handles each workload, directly affecting power consumption. Samsung's method scores cores on suitability to route work efficiently and reduce energy waste.
US 2026/0211825 A1
Direct paths between processing units for certain AI math operations bypass the standard routing layer, lowering latency and energy costs when heavy computational tasks communicate with specialized accelerators.
US 2026/0211967 A1
Qualcomm's filing approximates some math operations to cut energy use without losing accuracy.
US 2026/0211973 A1
Nvidia's filing overlaps data streams so processors never stall between batches, hiding wait times behind ongoing work.
US 2026/0211971 A1
Fusing matrix multiplication and rotary position encoding into a single kernel operation eliminates the intermediate memory write-read cycle that currently forces data out to slower storage between these back-to-back computations in language model inference.
US 2026/0211676 A1
Within the power-efficiency track, Intel's FP8 hardware design shows a vendor-specific bet on reduced precision as the path forward rather than algorithmic workarounds.
US 2026/0212170 A1
Dynamic model resizing based on available device resources addresses the memory bottleneck by letting a single AI model adjust its footprint rather than requiring separate lightweight and full versions.
US 2026/0203368 A1
Faster matrix multiplication through lookup tables shrinks the compute cost per inference, directly attacking the memory-bandwidth bottleneck that slows multi-chip AI systems.
US 2026/0205564 A1
Memory bandwidth during image rendering slows when compression treats all pixels equally. Samsung's approach varies compression strength by screen position, reducing the data shuttled between processor and memory.
US 2026/0203851 A1
Data reshaping on AI chips typically requires chained operations; Nvidia's single-instruction collapse reduces the overhead that slows down image processing pipelines.
US 2026/0203641 A1
Task scheduling across weak chips prevents redundant models from consuming scarce memory and compute simultaneously. Google's coordinator ensures edge devices running multiple AI workloads don't spawn duplicate processes that would cripple performance.
US 2026/0203568 A1
Offloading work between a power-hungry processor and an efficient one without routing everything through shared memory could shrink the coordination overhead that currently forces chips to choose between speed and battery life.
US 2026/0204274 A1
AI audio models could train on consumer hardware if they stop caching every intermediate result and regenerate them as needed, freeing up the memory that currently forces training onto expensive server clusters.
US 2026/0204060 A1
Data compression in neural networks gains ground through deduplication of near-identical filter kernels, reducing memory footprint without architectural changes to the model itself.
US 2026/0203367 A1
Parallel execution of matrix and vector math reduces idle time on the processor, since different calculation types no longer have to queue behind each other. This directly confronts the coordination problem between specialized circuits on a single chip.
US 2026/0203372 A1
Faster AI inference means models can process more data before hitting memory limits, directly attacking the coordination problem of distributing compute across chips.
US 2026/0204056 A1
Faster image processing means AI chips can handle vision tasks without choking on the comparison work that usually demands extra memory bandwidth. This patent shows a way to spread that load across the chip's spatial layout instead of serializing it.
US 2026/0203562 A1
Shrinking the numerical precision of deployed models cuts both computation and memory footprint, directly easing the data movement bottleneck that slows multi-chip AI systems.
US 2026/0203249 A1
Task scheduling across CPU and accelerator resources becomes flexible when cores can migrate between them rather than stay locked in separate domains, letting workload demands drive allocation instead of fixed hardware boundaries.
US 2026/0203103 A1
Better scheduling of which model sections load into fast memory cuts idle time when multiple specialized AI functions run sequentially on a single chip, directly attacking the memory bottleneck problem across the AI chip timeline.
US 2026/0203220 A1
Memory bandwidth limits how fast GPUs can run AI workloads. Nvidia's system reduces redundant fetches by detecting when multiple threads request identical data and consolidating those requests, lowering power consumption in the process.
US 2026/0203016 A1
Data format flexibility within a single multiplier unit reduces redesign costs when AI workloads shift between precision requirements.
US 2026/0203615 A1
Memory bottlenecks on edge devices require shrinking the working dataset an AI model needs during inference. Qualcomm's approach merges consecutive processing steps into single fused operations, reducing the intermediate data that must stay resident on chip.
US 2026/0203373 A1
Faster inference on edge devices becomes possible if softmax, the calculation that ranks outputs in every AI model, can run without draining power. This filing shows a direct path to shipping capable AI locally instead of routing queries to distant servers.
US 2026/0203371 A1
Offloading cryptographic operations to idle matrix engines means AI chips could handle privacy tasks without dedicated crypto hardware, reducing die space and power overhead in accelerators optimized for training.
US 2026/0203583 A1
Dynamic model pruning during inference addresses the power-efficiency bottleneck by letting AI models shed unnecessary computation layers when thermal or battery constraints hit, keeping performance within acceptable bounds rather than forcing full shutdown.
US 2026/0203558 A1
Redundant multiplication in convolution operations drains chip efficiency. Samsung's approach predicts which calculations yield zero before execution, freeing hardware cycles for productive work instead of wasting them on null results.
US 2026/0203139 A1
Better GPU utilization across chips reduces the power wasted on idle hardware, a key bottleneck when coordinating work across a multi-chip cluster running AI models.
US 2026/0195404 A1
Intel's filing reorganizes how numbers are stored so the core AI math pulls only the data it needs, cutting wasted transfer.
US 2026/0195633 A1
Predictive prefetching of database records into cache memory eliminates round-trip delays by staging likely-needed data before queries arrive, reducing stalls from storage access latency.
US 2026/0195137 A1
Within the coordination problem: Samsung's approach to latency hiding lets a processor switch away from stalled requests rather than block entirely, reducing the idle time that compounds when multiple chips coordinate across memory hierarchies.
US 2026/0195574 A1
Within the memory bottleneck problem, this filing proposes compute-in-memory as a solution: shift calculations into the storage layer itself rather than ferrying data back to the processor repeatedly.
US 2026/0195093 A1
Within the memory-and-speed bottleneck, this patent targets compute itself. By replacing multiplication operations with table lookups, Intel sidesteps the energy cost of arithmetic entirely, trading silicon space for clock cycles.
US 2026/0195959 A1
Memory efficiency joins the watchlist alongside scheduling and coordination: Intel's approach eliminates wasted slots when low-precision values don't align with standard memory widths, directly reducing the bandwidth crunch that hampers multi-chip AI systems.
US 2026/0197476 A1
Compressing intermediate calculation results on-chip and decompressing them on demand buys memory space without moving data off-chip, directly addressing the storage bottleneck that forces choices between model size and inference speed.
US 2026/0195266 A1
Memory bottlenecks have forced chips to shuttle lookup tables back and forth between processor and storage. Samsung embeds these tables directly in memory, eliminating that round trip entirely.
US 2026/0196268 A1
A computing bit cell that performs arithmetic operations inside the memory itself eliminates the energy cost of shuttling data between storage and processor, directly confronting the memory bottleneck that dominates power consumption in AI workloads.
US 2026/0195579 A1
Fusing layer normalization into the matrix multiplication operation itself cuts the arithmetic overhead that recurs across every training step, removing a bottleneck that compounds across billions of operations.
US 2026/0195176 A1
Autonomous task scheduling on accelerators reduces idle cycles by letting chips pull work when ready rather than wait for CPU handoffs, directly addressing coordination delays between processors.
US 2026/0198350 A1
Memory and power delivery have separate demands. By embedding capacitors in the chip's wiring layer itself, Qualcomm cuts the distance power travels, reducing the voltage noise that degrades performance.
US 2026/0194390 A1
Performing analog multiplication directly in the pixel array cuts data movement to the main processor, addressing the memory bottleneck that limits real-time AI inference on edge devices.
US 2026/0195401 A1
Reformulating softmax to avoid expensive exponentials cuts the compute time for one of AI's most repetitive operations, easing the load on resource-constrained inference chips.
US 2026/0195405 A1
Extreme quantization to one or two bits per number cuts the arithmetic workload in processor pipelines, directly addressing the compute bottleneck that forces current AI chips to spend cycles moving data between memory and execution units.
US 2026/0195576 A1
Memory bottlenecks slow training partly because stabilization checks run repeatedly inside each layer. Nvidia's method performs these checks less often, cutting memory traffic without destabilizing the math.
US 2026/0194956 A1
Dynamic scaling of interconnect bandwidth based on real-time workload demand cuts idle power waste in multi-chip systems, a key lever for improving energy efficiency in AI accelerators beyond just faster processing.
US 2026/0195128 A1
Embedding computation inside memory cells themselves eliminates the data shuttle between processor and storage, directly shrinking the bandwidth bottleneck that the watchlist tracks across multi-chip AI systems.
US 2026/0195187 A1
Nvidia's filing routes tasks based on the measured connection speed between specific pairs of chips, instead of assuming every link is equally fast.
US 2026/0195175 A1
The coordination problem gets concrete: keeping expensive accelerators fed means pushing data prep onto cheaper general processors in real time, not sequentially.
US 2026/0197477 A1
Offloading early-stage AI processing to edge devices shrinks the data stream sent between chips, directly attacking the memory bottleneck that plagues distributed inference systems.
US 2026/0195593 A1
Predictive scheduling that identifies and eliminates circular data movements during reshape operations, shrinking the idle time chips spend shuffling memory instead of computing.
US 2026/0195064 A1
Memory contention among multiple workloads has emerged as a coordination bottleneck; IBM's approach predicts and pre-allocates scratch space to prevent the scramble that slows chips under load.
US 2026/0197857 A1
A prioritization layer that lets the network tell the phone which AI tasks matter most when multiple demands compete for the same wireless bandwidth and processor cycles.
US 2026/0195270 A1
Interposer chips with built-in memory controllers let processors access distant storage without saturating the local interconnect, shifting the bottleneck from proximity to bandwidth management across the multi-chip system.
US 2026/0195293 A1
Memory bottlenecks have centered on moving data between chips and main storage. Samsung's filing shows a path around that: letting processors feed results directly to each other during computation, rather than shuttling everything back through a central hub.
US 2026/0190356 A1
Dummy structures around memory contact points prevent mechanical stress from warping stacked chip layers during manufacturing and operation, directly addressing the reliability problem that arises when multiple HBM dies must maintain perfect alignment.
US 2026/0187458 A1
Coordination across multiple chips moves from centralized scheduling to peer-to-peer negotiation, eliminating the bottleneck that slows distributed training.
US 2026/0186832 A1
Direct memory access between thread groups cuts out the supervisor step, letting GPU workers exchange intermediate results without routing through shared caches or main memory. This directly reduces the serialization delays that plague multi-chip AI workloads.
US 2026/0187523 A1
Runtime feedback loops let the chip optimize its own voltage and frequency settings mid-operation, shifting the tuning problem from factory conditions to actual workloads, a way to squeeze efficiency gains without redesigning the silicon itself.
US 2026/0184345 A1
Memory isolation on a single die prevents cascading failures when one task crashes, keeping safety-critical functions intact during multi-workload operation.
US 2026/0190357 A1
A dummy die cap with reduced width lets resin cure evenly across stacked memory, preventing the warping that degrades electrical connections in high-bandwidth chips used for AI inference.
US 2026/0187422 A1
Prefetching model weights based on predicted token sequences cuts memory stalls by loading only active parameters ahead of execution, directly confronting the latency tax that makes inference slow on bandwidth-constrained devices.
US 2026/0187425 A1
Within the coordination-across-chips subplot, neuromorphic routing reduces the computational load of pathfinding by distributing it across spiking neurons, sidestepping the serial bottleneck of conventional processors.
US 2026/0186822 A1
Intel's filing learns which moves of tasks between processors actually pay off, building that feedback into how work gets routed.
US 2026/0186937 A1
A chip that learns the rhythm of incoming device signals can sleep deeper between interrupts, cutting the idle power drain from processors stuck in shallow standby states waiting for unpredictable wake calls.
US 2026/0189301 A1
Parallel optical links replace single high-speed converters, distributing data across many simultaneous light paths to reduce the power and latency costs of inter-chip communication in multi-chip AI systems.
US 2026/0186852 A1
Reordering how training data gets packaged across processors prevents the fastest chips from stalling while slower ones catch up, directly improving utilization in multi-chip systems.
US 2026/0186951 A1
Mapping chip memory states back to model layers lets engineers identify which neural network component produced wrong outputs during execution.
US 2026/0187254 A1
Memory protection joins the coordination problem: AMD encrypts models in transit between processor regions to stop software theft, adding a security layer to how data moves across chip architecture.
US 2026/0186776 A1
Memory bandwidth emerges as the core constraint across these filings. AMD's approach cuts redundant scale-factor reads, directly attacking the data-movement overhead that slows vector operations in neural networks.
US 2026/0187532 A1
Memory bottlenecks get worse when chips process zeros that sparse models contain. This filing proposes skipping them in hardware rather than compressing them away beforehand.
US 2026/0187313 A1
Predicting performance bottlenecks in real time shifts the burden from users guessing what to upgrade to hardware that identifies its own constraints, a foundation for dynamic resource allocation in AI accelerators.
US 2026/0186789 A1
Embedding an AI tuning loop directly in the chip itself sidesteps the need for external optimization software, letting the processor self-adjust memory bandwidth and power states in real time based on workload feedback.
US 2026/0186523 A1
Voltage scaling destabilizes memory during power transitions, so Microsoft's method synchronizes frequency and voltage changes to prevent data corruption when chips shift operating states.
US 2026/0187184 A1
Replicating in-flight data to fill unused compute slots lets the chip keep all its processing units fed rather than leaving gaps when workload geometry mismatches available hardware.
US 2026/0186777 A1
Memory bandwidth remains the core constraint in multi-chip AI systems. AMD's dedicated BF16 circuitry reduces the data volume moving between chips and between chip and memory, directly easing the bottleneck that slows down distributed training.
US 2026/0187432 A1
Dual synchronized neural networks let the chip compare data streams in real time rather than sequentially, cutting latency when matching pairs of inputs like images or audio samples.
US 2026/0191101 A1
Optical interconnects built into the package base cut the distance data travels between processor and memory, reducing latency and power loss compared to traditional electrical signaling across longer board traces.
US 2026/0187332 A1
The coordination problem extends upstream: before chips can talk to each other, their internal wiring must be laid out efficiently, and Nvidia's automation system handles that geometric puzzle automatically rather than by hand.
US 2026/0177744 A1
A two-stage resonator design shrinks the optical receiver while keeping sensitivity high, addressing the real bottleneck: fitting fast light-to-electrical conversion into the tight spaces between processor cores.
US 2026/0178379 A1
Chips need to match workload intensity, not run at peak for every request. AMD's patent routes different AI tasks to different silicon based on power state, cutting waste when the battery runs low.
US 2026/0169318 A1
The chip-to-chip communication layer gets a new lever: dual waveguides let Samsung route light signals with finer control, potentially squeezing more data density into optical interconnects without the heat penalty of electrical paths.
US 2026/0170596 A1
Faster AI inference means removing software queuing layers that cause hardware to sit idle even when resources are available. Intel's direct scheduling system would let workloads reach compute units without waiting in the operating system's queue.
US 2026/0170083 A1
Filtering sparse matrices before computation reaches the arithmetic units cuts wasted cycles on meaningless data, a hardware-level efficiency gain that bypasses software-level sparsity handling.
US 2026/0169818 A1
Intel's filing feeds different kinds of processors work in the right order, so none of them sits idle waiting on another chip.
US 2026/0170600 A1
GPU memory latency kills throughput in real-time AI workloads. Intel's buffer sits between the media engine and compute core to serve data without the full round-trip to main memory, cutting both access time and power spent on fetches.
US 2026/0172330 A1
Network switches performing intermediate calculations during data movement replaces the centralized aggregation step, shifting from a hub-and-spoke bottleneck model to distributed computation across routing infrastructure.
US 2026/0170315 A1
Faster inference means cheaper chips. Amazon's approach skips zero values entirely during computation, freeing up memory bandwidth for the calculations that actually matter in running trained models.
US 2026/0162021 A1
Hardware-native random forest evaluation cuts the software overhead that slows inference on general processors, shifting the bottleneck from CPU cycles to silicon gates, a bet that decision trees warrant their own silicon rather than borrowing GPU cycles.
US 2026/0161356 A1
Routing overhead in heterogeneous chip clusters can kill efficiency gains. Amazon's filing moves the routing logic into hardware rather than leaving it to software schedulers.
US 2026/0161941 A1
Hierarchical data routing lets servers prioritize fast local exchanges over slower cross-server transfers, reducing idle time when thousands of machines coordinate during training.
US 2026/0161598 A1
Faster AI inference hinges on moving data around efficiently. Samsung's prefetch approach cuts the idle time chips spend waiting for memory by predicting data needs a few steps ahead, reducing a major bottleneck in real-world model execution.
US 2026/0161454 A1
Splitting GPU compute into two tiers lets inference run on the efficient engine while the heavy engine stays dormant, directly lowering the battery drain that keeps mobile AI from becoming routine.
US 2026/0161540 A1
Memory placement emerges as the real constraint in chip design. Samsung bets that pre-organizing data layouts beats faster processors for overall speed.
US 2026/0162352 A1
AMD's filing controls which processor cores switch on at a fine level, turning power use into something the hardware can tune.
US 2026/0161215 A1
Power delivery bottlenecks force AI workloads across multiple GPUs to either crash or slow down. AMD's filing proposes load-balancing between cards so peak power demands stay within supply limits instead of stacking on top of each other.
US 2026/0161999 A1
Dynamic task migration between heterogeneous processors sidesteps the bottleneck of static workload placement, letting the system rebalance jobs in real time based on actual resource contention rather than upfront human prediction.
US 2026/0161473 A1
Chip scheduling under load requires knowing task signatures upfront. Samsung's filing bets that automatic classification of compute-heavy versus memory-heavy workloads can route each to the right core type without human tuning.
US 2026/0162703 A1
Embedding weighted sum calculations inside memory eliminates the data shuttling that drains power in standard AI chips, pushing the compute-memory bottleneck directly into the storage layer itself.
US 2026/0161327 A1
Faster AI inference means squeezing latency out of memory access patterns. Samsung's design lets the processor send higher-level requests instead of micromanaging every read and write, cutting the overhead that slows down real-time model execution.
US 2026/0161940 A1
Samsung's filing cuts wasted computing during AI training by skipping updates for inactive parts of the network and batching them for later.
US 2026/0161558 A1
Chip idle time from memory misalignment cuts into throughput. Samsung's design co-opts the actual request patterns of AI workloads to reshape memory organization, reducing fetch latency.
US 2026/0154525 A1
The chip-scheduling problem gets concrete here: Intel is betting that dynamic reconfiguration beats static hardware. Reshaping the processor array between layers avoids the waste of fixed architectures designed for peak demands across all layer types.
US 2026/0154004 A1
Spreading AI work across multiple chips only works if they can read shared data without copying it back and forth repeatedly. Samsung's patent puts a coordination layer between the chips and one common memory pool to cut that copying overhead.
US 2026/0154538 A1
Compressing activation tensors on-chip before they spill to memory reduces the conveyor-belt congestion that slows inference, betting that the math cost of shrinking data pays back faster than waiting for bandwidth-bound writes.
US 2026/0148470 A1
Keeping GPU workloads balanced across frames without waiting for driver updates cuts a real bottleneck in real-time graphics, where fixed scheduling policies often mismatch what's actually running on screen.
US 2026/0149571 A1
Customers could run vendor-optimized models at full speed while the weights stay encrypted, solving the tension between performance and IP protection in outsourced AI inference.
US 2026/0148157 A1
Amazon's filing automatically divides graphics chips among several AI projects running at once, so computing power doesn't sit unused.
US 2026/0140764 A1
Splitting neural workloads into smaller interruptible chunks lets the scheduler pause background inference mid-operation rather than wait for natural task boundaries, shrinking latency for time-critical requests on shared hardware.
US 2026/0133852 A1
Memory bottlenecks slow AI inference when weights travel from storage to compute. Intel's patent compresses weights in flight and decompresses them on arrival, shrinking the data pipe without extra latency.
This watchlist groups patent filings from Intel, Amazon, Samsung, AMD, and Xilinx that all touch AI chip hardware, from memory management to task scheduling to data compression. It's a running collection, not a single product line, so it grows as each company files new patents on how AI computing should work under the hood.
No. A patent filing describes an idea a company wants legal protection for, not a shipped product. Some of these filings, like Amazon's cryptographic key locking of model weights or Intel's reconfigurable chip array, describe directions the company is exploring rather than features you can buy today. Think of this watchlist as a signal of research priorities, not a product roadmap.
Intel, Amazon, Samsung, AMD, and Xilinx all appear regularly, with Amazon and Samsung showing up across several different sub-problems, from memory sharing to task routing to data compression. That spread suggests both companies are patenting broadly across the AI hardware stack rather than focusing on one narrow piece of the chip.
Several filings, from Intel's memory-waiting fix to Samsung's preloading and memory layout patents, target the same bottleneck: chips finishing their math faster than data can reach them. When a chip sits idle waiting for numbers to arrive, faster processors don't help, so companies are patenting ways to move and store data more efficiently instead.
Want this weekly breakdown for a company we don't cover? Patentlyze Pro →