Get the newsletter
Google · AI / ML · Filed Jun 1, 2026 · USPTO published Oct 1, 2026 · Oct 1 release

Google Patents a System That Learns When Its Voice Assistant's Follow-Up Questions Aren't Working

When you ask a voice assistant something ambiguous and it asks a confusing follow-up question, the whole conversation falls apart. Google is patenting a system that tracks when those follow-up questions fail and automatically upgrades them to something more useful.

An assistant device communicates with a cloud-based automated assistant to process user requests and manage data. Drawing from patent filing US 2026/0301740 A1.
An assistant device communicates with a cloud-based automated assistant to process user requests and manage data.All 4 drawings ↓
Publication number
US 2026/0301740 A1(US20260301740A1)
Applicant
GOOGLE LLC
Filed · Published
Jun 1, 2026 · Oct 1, 2026
Inventors
Matthew Sharifi, Victor Carbune
Status when we published
Waiting for an examiner
Document
18 claims
US classification
704/257
Parent application
Continuation of 18/244,762 (filed Sep 11, 2023)(18244762)

How Google's assistant decides to ask better questions

You're in the kitchen and you tell your Google Assistant to "play something relaxing" and it can't tell if you want music or a podcast. So it asks a clarifying question. That question is either helpful or baffling, depending on how it's delivered.

Right now, voice assistants mostly just ask again in plain speech: "Did you mean music or a podcast?" That works sometimes. But Google is filing a patent for a system that keeps score on whether plain-speech clarifications are actually solving the problem. If they're not, the assistant automatically switches to a richer format: think visual options on a screen, or audio examples, anything beyond just more words.

The key idea is that the assistant isn't guessing randomly. It's analyzing its own track record. When plain questions have a history of failing in similar situations, the system flags that and chooses a more helpful format instead.

From the filing · CLAIM 1
determining whether, in soliciting further user input for disambiguating between the first particular action and the second particular action, to provide a natural language (NL) only clarification prompt that is restricted to rendering NL, or to instead provide an enhanced clarification prompt that renders NL and renders output that is in addition to NL …

Translation: The system decides whether to ask a clarifying question using only speech or to also use a screen or other outputs.

How the failure metric triggers a richer clarification prompt

The patent describes a method for handling ambiguous voice commands in two stages: detecting the ambiguity, then deciding how to ask for clarification.

When a user says something that could mean two mutually exclusive things, the assistant must ask for more input. But instead of always defaulting to a plain-language question ("Did you mean X or Y?"), the system evaluates a failure metric: a score built from historical data about how often that type of plain-language clarification failed to resolve the ambiguity in past interactions.

  • If the failure metric is below a threshold, the assistant sticks with a plain-language question (cheaper to render, less disruptive).
  • If the failure metric meets or exceeds the threshold, the assistant switches to an enhanced clarification prompt that layers in additional output beyond speech, such as a visual selection menu or audio clips.

The system also factors in prior determinations: if the assistant has already decided to use enhanced prompts in a recent session, that history can influence the current choice. The underlying failure metric is continuously shaped by aggregate interaction data, not just a single user's history.

From the filing · THE ABSTRACT
… determine, based on processing the recognition, that the spoken utterance is ambiguous (i.e., is interpretable as requesting performance of a first particular action exclusively and is also interpretable a second particular action exclusively).

Translation: The assistant realizes it cannot understand a command because it points to two different actions at the same time.

What this means for people who argue with their smart speakers

For anyone who uses a smart speaker or a phone assistant daily, this is a fix for one of the most frustrating moments in that relationship: when the device asks you a question and you get confused. Plain verbal clarifications often fail because they add more words to an already murky situation.

the pattern in Google's assistant-interaction filings suggests the company is increasingly interested in making the assistant's failure modes smarter rather than just making the assistant less likely to fail in the first place. Whether this shows up in Google Home devices, Android phones, or in-car assistants, the practical result would be fewer dead-end exchanges where you end up just repeating yourself louder.

Google's 48th filing in voice and speech AI we've tracked since May follows an always-same-speed audio generator and a turn-detection voice system.

Source: US 2026/0301740 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Google patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 4 sheets

4 drawing sheets from US 2026/0301740 A1 · click any drawing to enlarge

Voice assistant system architecture., drawing sheet 1 from US 2026/0301740 A1
Sheet 1 Voice assistant system architecture.
Processing spoken commands., drawing sheet 2 from US 2026/0301740 A1
Sheet 2 Processing spoken commands.
Determining clarification prompts., drawing sheet 3 from US 2026/0301740 A1
Sheet 3 Determining clarification prompts.
Computer system components., drawing sheet 4 from US 2026/0301740 A1
Sheet 4 Computer system components.
Patent filing page

Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.