Get the newsletter
Microsoft · AI / ML · Filed Mar 25, 2025 · USPTO published Oct 1, 2026 · Oct 1 release

Microsoft Patents a Method to Shield Sensitive Data While Running AI Models

When an AI model processes your medical records or financial data, every layer of that model touches something private. Microsoft has filed a patent for a system that figures out which layers of an AI need heavy security protection and automatically routes each one to the right piece of hardware.

An artificial intelligence model is partitioned and distributed across multiple hardware security domains for enhanced data protection. Drawing from patent filing US 2026/0300489 A1.
An artificial intelligence model is partitioned and distributed across multiple hardware security domains for enhanced data protection.All 12 drawings ↓
Publication number
US 2026/0300489 A1(US20260300489A1)
Applicant
Microsoft Technology Licensing, LLC
Filed · Published
Mar 25, 2025 · Oct 1, 2026
Inventors
Aditya Vasanth CHALLAPALLY
Status when we published
Company responded; back with the examiner
Document
20 claims
US classification
726/22
Examiner
POUDEL, SAMIKSHYA NMN (Art Unit 2436)

How Microsoft splits an AI's brain by data sensitivity

A doctor's office runs an AI that reads patient scans. The AI has dozens of internal steps, and only some of them actually touch raw patient data. The rest work on patterns so abstract that the original information is unrecoverable.

Microsoft's system looks at each step inside an AI model and asks: does this step handle truly sensitive input, or has the data been transformed enough that it's safe to run on less-guarded hardware? It then splits the model into groups of steps, called partitions, and assigns each group to the right computing hardware based on its security needs.

The goal is efficiency without sacrificing protection. Instead of running everything through expensive, heavily guarded hardware, you only do that for the parts of the AI that actually need it. The less sensitive layers can run on faster or cheaper components, and the whole system is matched automatically rather than by hand.

From the filing · CLAIM 1
… partitioning the neural network architecture into a partitioned neural network architecture that includes partitions comprising one or more layers of the neural network architecture based on the security requirements of each of the layers to be operated on selected hardware components from among the computing hardware components …

Translation: The system splits the AI model into pieces matched to the security level of each hardware part.

How the system maps layers and assigns security hardware

The system starts by building a map of the neural network, a diagram of every layer in the AI model, how they connect, and how data flows from one to the next. It notes which layers feed into which, and which layers depend on the output of earlier ones.

Next, it checks what computing hardware is available and sorts those components by their security domain (think of a security domain as a walled zone of hardware that has specific protections against snooping or tampering, enforced by physical chips, firmware, or both).

Then it applies rules to each layer to decide how sensitive that layer's work is:

  • Layers close to the input that receive raw sensitive data get the highest security classification.
  • Layers that produce abstract features (like edge patterns in an image or statistical signals) get a lower classification, because you can't reverse-engineer the original data from them.
  • The layer type and its position relative to the input layer both factor into that judgment.

Finally, the system partitions the model, grouping consecutive layers with similar security needs together, and assigns each group to a hardware component whose security level matches or exceeds what that group requires. The AI then runs across these partitioned components simultaneously or in sequence.

From the filing · THE ABSTRACT
Each partition includes a subset of the layers of the neural network architecture and each partition has different security requirements based on whether the layers in the partition are receiving sensitive input data or operating on data from which features of the sensitive input data can be reconstructed.

Translation: Different parts of the AI get different security based on how close they are to sensitive user data.

What this means for AI running on sensitive data

AI is moving into hospitals, banks, and government agencies, places where the data being processed is regulated and genuinely sensitive. Right now, the common answer is to run the entire AI inside a secure enclave, which is slow and expensive. Microsoft's approach, if it works as described, means only the parts of the model that need heavy protection get it, while the rest run normally. That could make privacy-preserving AI meaningfully faster and cheaper to deploy.

Claim 1 covers the whole pipeline: mapping the network, reading available hardware, classifying each layer's security needs, and partitioning accordingly. That's a broad functional claim. If granted, it could give Microsoft a foundational position over automated, hardware-aware security partitioning for AI models, covering a wide range of enterprise AI deployments.

Microsoft's 13th filing we've tracked since August in our on-device AI privacy watchlist follows work on catching data leaks and shrinking AI models.

Source: US 2026/0300489 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Microsoft patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 12 sheets

12 drawing sheets from US 2026/0300489 A1 · click any drawing to enlarge

Artificial intelligence model layers., drawing sheet 1 from US 2026/0300489 A1
Sheet 1 Artificial intelligence model layers.
Hardware security domains., drawing sheet 2 from US 2026/0300489 A1
Sheet 2 Hardware security domains.
Artificial intelligence model partitions., drawing sheet 3 from US 2026/0300489 A1
Sheet 3 Artificial intelligence model partitions.
Partitioned AI model across security domains., drawing sheet 4 from US 2026/0300489 A1
Sheet 4 Partitioned AI model across security domains.
Model partitioning framework., drawing sheet 5 from US 2026/0300489 A1
Sheet 5 Model partitioning framework.
Neural network mapping unit., drawing sheet 6 from US 2026/0300489 A1
Sheet 6 Neural network mapping unit.
Run-time partitioning framework., drawing sheet 7 from US 2026/0300489 A1
Sheet 7 Run-time partitioning framework.
Secure data transition between domains., drawing sheet 8 from US 2026/0300489 A1
Sheet 8 Secure data transition between domains.
Show the other 4 sheets
Microsoft Patents a Method to Shield Sensitive Data While Running AI Models patent drawing, sheet 9
Sheet 9
Microsoft Patents a Method to Shield Sensitive Data While Running AI Models patent drawing, sheet 10
Sheet 10
Microsoft Patents a Method to Shield Sensitive Data While Running AI Models patent drawing, sheet 11
Sheet 11
Microsoft Patents a Method to Shield Sensitive Data While Running AI Models patent drawing, sheet 12
Sheet 12
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.