Get the newsletter
Microsoft · AI / ML · Filed Mar 27, 2025 · USPTO published Oct 1, 2026 · Oct 1 release

Microsoft Patents an AI Coordinator That Picks the Right Helpers for Each Question

Most AI assistants treat every question the same way. Microsoft's new patent describes a smarter approach: a coordinator that reads your question, ranks a roster of specialized sub-agents, and only calls in the ones most likely to actually help.

A user interacts with a client application that sends a query to an AI service, which uses an agentic orchestrator and generative AI model to provide an aggregated response. Drawing from patent filing US 2026/0300782 A1.
A user interacts with a client application that sends a query to an AI service, which uses an agentic orchestrator and generative AI model to provide an aggregated response.All 7 drawings ↓
Publication number
US 2026/0300782 A1(US20260300782A1)
Applicant
Microsoft Technology Licensing, LLC
Filed · Published
Mar 27, 2025 · Oct 1, 2026
Inventors
Xiaofeng Zhu, Hemant Kumar, Yunshen Zhou, Ichiro Ota, Venkatasatya Premnath Ayyalasomayajula, Edward Onochie, Ridip De, Linda Angelica Albarran, Stephanie Marie Francoise Lucie Schuh, Issam Rashid, Md Mamunul Islam, Rishi Gupta
Status when we published
Waiting for an examiner
Document
20 claims
US classification
706/11

How Microsoft's AI dispatcher decides who answers your question

Right now, when you ask an AI assistant something, the whole system often has to sort through every tool and database it has access to, even the ones that have nothing to do with your question. That wastes time and can muddy the answer.

Microsoft's patent describes a "meta-orchestrator," essentially a dispatcher that sits above a team of specialized AI agents. Each agent handles a particular topic or task. When you send in a question, the orchestrator scores every agent on how relevant it is to your specific query, then forwards the question only to the agents that ranked high enough.

There's also a clever self-limiting mechanism. The system includes a "separator" entry in the ranking list. If your question doesn't clearly fall into any agent's area, the separator tells the system to stop adding agents rather than pulling in everything it has. The responses from the selected agents are then combined into a single answer sent back to you.

From the filing · CLAIM 1
… apply the query to an orchestrator to select a subset of agents to answer the query, the orchestrator applying a relevance ranking algorithm to the query and an agent description set including a description of each agent and a description of a separator class having a description of context outside of a domain of the plurality of artificial intelligence agents …

Translation: The system uses an orchestrator with a relevance ranking algorithm to choose the best helper agents for any given question.

Inside the separator-class ranking that filters out wrong agents

The system centers on three layers working together.

The orchestrator is the top-level coordinator. It receives a query and runs a relevance ranking algorithm (a scoring method that measures how well each candidate matches the question) against a list called the agent description set. That set contains a plain-text description of what each agent does, plus one special entry: the separator class.

The separator class is the key novelty here. Its description covers context that falls outside the domain of any real agent. When the orchestrator ranks all the entries, the separator's position in the ranked list tells the system exactly how many agents are genuinely relevant. Any agent that scores below the separator gets dropped from consideration automatically.

The selected agents each receive the original query independently and return their own responses. The host application then aggregates (combines) those responses into one unified reply for the user.

  • Query comes in from the client application
  • Orchestrator scores all agents plus the separator entry
  • Agents ranking above the separator are selected; the rest are ignored
  • Selected agents each answer the query in parallel
  • Aggregated response is returned to the user
From the filing · THE ABSTRACT
The orchestrator may dynamically select a number of the agents in the subset based on a ranking of the separator class, which is associated with a description of context outside of a domain of the plurality of artificial intelligence agents.

Translation: It can automatically decide how many helpers to use based on whether the question falls outside their expertise.

What multi-agent routing means for your everyday AI assistant

As AI products add more specialized tools, the question of which tool to call becomes its own hard problem. Calling too many wastes compute and can produce contradictory answers; calling too few means missing information the user needed. Microsoft's separator trick gives the system a principled way to draw that line automatically, without a human manually tuning how many agents to use for each type of question.

For products like Microsoft 365 Copilot, which already connects AI to email, documents, spreadsheets, and web search simultaneously, Microsoft has been filing around multi-agent AI orchestration since early 2025 a routing layer like this could mean faster, more focused answers rather than an AI that throws everything at the wall. The practical payoff for you would be responses that arrive more quickly and stay on topic.

Microsoft's 34th filing we've tracked since May in our AI teams of models watch, following a chain-of-networks video approach and role-specific meeting assistants.

Source: US 2026/0300782 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Microsoft patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 7 sheets

7 drawing sheets from US 2026/0300782 A1 · click any drawing to enlarge

AI service query and response, drawing sheet 1 from US 2026/0300782 A1
Sheet 1 AI service query and response
Agentic orchestrator ranking model, drawing sheet 2 from US 2026/0300782 A1
Sheet 2 Agentic orchestrator ranking model
Shared foundation model with tasks, drawing sheet 3 from US 2026/0300782 A1
Sheet 3 Shared foundation model with tasks
Agent interaction for assistant response, drawing sheet 4 from US 2026/0300782 A1
Sheet 4 Agent interaction for assistant response
Device with AI service components, drawing sheet 5 from US 2026/0300782 A1
Sheet 5 Device with AI service components
Client application device components, drawing sheet 6 from US 2026/0300782 A1
Sheet 6 Client application device components
Steps for AI agent selection, drawing sheet 7 from US 2026/0300782 A1
Sheet 7 Steps for AI agent selection
Patent filing page

More in AI assistant & agent

All 413 AI assistant & agent patents →

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.