Google · Filed Sep 4, 2025 · Published Sep 3, 2026

Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart

Finding the right answer to a question sounds easy until you realize AI search systems routinely confuse near-identical phrasings and return the wrong result. Google's new patent targets exactly that failure mode, deep inside the training process.

A person interacts with a recommendation assistant on a laptop, receiving book suggestions based on their interests. Drawing from patent filing US 2026/0259794 A1.
A person interacts with a recommendation assistant on a laptop, receiving book suggestions based on their interests.
See all 24 drawings from this filing ↓
Publication number US 2026/0259794 A1 US20260259794A1
Applicant Google LLC
Filing date Sep 4, 2025
Publication date Sep 3, 2026
Inventors Zhe Dong, Peter Dornbach, Imed Zitouni, Gustavo Adolfo Hernandez Abrego, Fedor Moiseev, Enrique Alfonseca Cubero, Daniel Matthew Cer
US classification 714/763
Status when we published Waiting for an examiner (Jun 8, 2026)
Parent application is a National Stage Entry of PCTUS2023023831 (filed 2023-05-30)
Document 20 claims

What Google's search-retrieval training trick actually does

You're asking a customer-support chatbot a question, and it hands you an answer that almost fits, but not quite. The words were close enough to fool the system, even though a person would immediately spot the difference. This happens because the AI learned to match questions to answers in a way that's good on average but sloppy at the margins.

Google's patent describes a better way to train that kind of AI. During training, the system is deliberately shown examples from its own processing pipeline that look similar but mean different things, forcing it to get sharper at spotting the difference. The result is an AI that builds a clearer mental map of which questions belong with which answers.

The fix lives entirely inside the training phase, not in the finished product you'd interact with. But better training means more accurate results when you ask a search engine, a virtual assistant, or a support bot for help.

From the filing · CLAIM 1
… wherein the projection layer is shared by the dual encoder system; and an embedding space configured, based on the set of projections, to generate a question embedding and a response embedding …

Translation: The system uses a shared projection layer to turn text inputs into matching question and response formats.

How same-tower negatives reshape the AI's answer space

The system Google describes is called a dual encoder: two neural networks that run in parallel, one processing a question and the other processing a candidate answer. Each network converts text into a list of numbers (an embedding), and the system finds the best answer by finding the embedding closest to the question's embedding in a shared mathematical space.

The patent's core contribution is a training technique called same-tower negatives. During training, AI systems learn by seeing positive pairs (correct question-answer matches) and negative pairs (mismatches). Normally, negatives are pulled from a separate batch. Here, Google's system also draws negatives from within the same encoder tower, meaning examples that have already passed through the same processing steps and therefore look very similar to the correct answer.

This forces the model to be more discriminating. If it only ever practiced on obviously wrong answers, it would never learn to handle the hard cases. Same-tower negatives are the hard cases.

The technical setup also includes a shared projection layer (a final translation step that both encoder branches use equally), which helps keep the question side and the answer side of the model speaking the same mathematical language, making comparisons more consistent.

From the filing · THE ABSTRACT
The technology provides neural network models having dual encoder architectures. For instance, a token embedder layer section of a dual encoder is associated with a first input and a second input and generates token embeddings …

Translation: The AI model uses two separate paths to process and convert input text into basic numerical forms.

What this means for AI-powered search and chat assistants

Search and question-answering are everywhere now: in Google Search itself, in AI chat assistants, in enterprise document tools, in customer-support bots. All of them face the same core problem: distinguishing the right answer from answers that are merely close. A training improvement that sharpens that distinction, even modestly, pays off across millions of daily queries.

Google's sustained investment in retrieval model research reflects how central this problem is to its core business. This patent targets a specific, well-documented weakness in how dual-encoder models are trained, and the approach is grounded in a real gap rather than a theoretical edge case. Whether it produces a measurable improvement in shipping products depends on results Google has not published here.

Google's 22nd filing we've tracked since May in our AI guardrails race watch follows one mapping threat networks and one catching repeated database queries.

Editorial take

When a customer service bot hands someone the wrong answer because it confused two similar questions, that person hangs up frustrated, calls back, and ties up a human agent anyway. Multiply that across millions of daily interactions and the cost in wasted time, eroded trust, and failed resolutions becomes very real money.

Google's response is to make the model practice on the hardest cases during training, the ones where two questions look nearly identical but need different answers, so it builds sharper judgment before it ever meets a real user. That is a well-matched cure for a well-understood disease.

The honest limit is that sharper training signals produce incremental improvements, not transformations, and real-world questions are messier than any training set. But incremental improvements on a problem this widespread still move the needle on something companies pay for every single day.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Google patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings

24 drawing sheets from US 2026/0259794 A1 · click any drawing to enlarge

System and user interaction, drawing sheet 1 from US 2026/0259794 A1
Sheet 1 System and user interaction
Prior art transformer model, drawing sheet 2 from US 2026/0259794 A1
Sheet 2 Prior art transformer model
Question-answer embedding models, drawing sheet 3 from US 2026/0259794 A1
Sheet 3 Question-answer embedding models
Question-answer embedding models, drawing sheet 4 from US 2026/0259794 A1
Sheet 4 Question-answer embedding models
Question-answer embedding model, drawing sheet 5 from US 2026/0259794 A1
Sheet 5 Question-answer embedding model
Performance metrics table, drawing sheet 6 from US 2026/0259794 A1
Sheet 6 Performance metrics table
Performance comparison graph, drawing sheet 7 from US 2026/0259794 A1
Sheet 7 Performance comparison graph
Question-answer embedding distributions, drawing sheet 8 from US 2026/0259794 A1
Sheet 8 Question-answer embedding distributions
Show the other 16 sheets
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 9
Sheet 9
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 10
Sheet 10
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 11
Sheet 11
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 12
Sheet 12
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 13
Sheet 13
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 14
Sheet 14
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 15
Sheet 15
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 16
Sheet 16
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 17
Sheet 17
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 18
Sheet 18
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 19
Sheet 19
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 20
Sheet 20
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 21
Sheet 21
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 22
Sheet 22
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 23
Sheet 23
Google Patents a Training Fix That Helps AI Search Tell Similar Questions Apart patent drawing, sheet 24
Sheet 24
Browse all the drawings 24 drawing sheets
Patent filing page

Source. Full patent text and figures from the official USPTO publication PDF.
Reader comments

Be the first to weigh in

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.