Get the newsletter
Google · AI / ML · Filed Jun 16, 2026 · USPTO published Oct 1, 2026 · Oct 1 release

Google Patents an AI System That Applies Facial Expression Edits Across Any Photo

Every photo filter you've ever used works by eyeballing general visual rules. Google's new patent describes a system that instead studies specific examples of a facial expression, boils them down to a precise mathematical recipe, and then applies that recipe to any face, consistently.

An input image of a smiling face is transformed into an angry expression using an initial and then an optimized editing vector. Drawing from patent filing US 2026/0301464 A1.
An input image of a smiling face is transformed into an angry expression using an initial and then an optimized editing vector.All 6 drawings ↓
Publication number
US 2026/0301464 A1(US20260301464A1)
Applicant
Google LLC
Filed · Published
Jun 16, 2026 · Oct 1, 2026
Inventors
Maciej Pesko, Yunyingying Xu, Ronald Thomas Votel
Status when we published
Waiting for an examiner
Document
20 claims
US classification
345/619
Parent application
Continuation of 18/427,974 (filed Jan 31, 2024)(18427974)

What Google's expression-editing AI actually does to your photos

Every time a photo app lets you tweak a person's expression, it's doing something surprisingly imprecise: applying a broad, pre-baked effect that wasn't specifically tuned to the look you actually wanted. The results often feel off, like the smile doesn't quite match the face.

Google's patent describes a way to fix that at the training stage. You feed the system pairs of photos: an ordinary face alongside a version showing the target expression. The system studies those pairs, figures out what changed, and distills that change into a compact set of instructions called an editing vector. It then refines those instructions until they meet quality criteria, so the result is consistent and realistic rather than drifted or glitchy.

Once that recipe is locked in, it's used to build a whole training dataset automatically, teaching a separate AI model to apply the same expression to new faces it has never seen before. You end up with a model that can take any input portrait and give it a specific, repeatable expression style.

From the filing · CLAIM 1
obtaining an optimized overall editing vector representing a target expression photo editing effect, wherein the optimized editing vector has been optimized in accordance with one or more optimization criteria in an embedded style space; …

Translation: The system calculates a mathematical formula that defines how a specific facial expression should look.

How the system builds and optimizes an expression editing vector

The core invention is a pipeline with three linked stages.

Stage one: learning from examples. The system takes pairs of face images, one neutral and one showing a target expression. Each image is passed through a style space encoder, a neural network that converts the image into a compact numerical representation (called an embedding) capturing the face's visual style. The difference between the two embeddings, averaged across many pairs, becomes an initial editing vector: a set of numbers that describes, in the AI's internal language, what the expression change looks like.

Stage two: optimization. That initial vector is then refined. The system adjusts the numbers according to one or more optimization criteria (think of these as quality checks: does the result look realistic? Does the identity of the person hold up? Is the expression strong enough?). The output is an optimized overall editing vector that captures the effect more precisely than the raw average.

Stage three: dataset generation and model training. The optimized vector is applied to a large collection of input face embeddings, automatically producing a dataset of paired images. A machine learning model is then trained on that dataset to perform the expression edit on any new portrait. The trained model is the deliverable: something that can be deployed in a real photo editing product.

The claim is specifically about the deployment end of this pipeline, starting from an already-optimized vector and ending with a trained model ready to ship.

From the filing · THE ABSTRACT
… receiving a plurality of image pairs, each comprising an original face image and an expressive face image representative of a target expression photo editing effect, …

Translation: It starts by looking at examples of faces before and after a specific expression is applied.

What this means for AI photo editing tools

Photo editing features that touch faces are everywhere: in phone camera apps, social platforms, and creative tools. The hard part has always been consistency. A filter that looks great on one face can look wrong on another because it wasn't tuned carefully enough. Google's string of AI photo-editing filings points to an effort to make that tuning automatic and reproducible.

For users, a system like this could mean expression-based edits that hold up across a full album of portraits, not just a lucky single shot. For product teams building photo tools, it describes a way to manufacture training data for any expression style without hiring people to pose for thousands of example photos, which is both expensive and slow.

Google's 61st filing we've tracked since May in our AI photo editing watch adds to a run that includes a tap-to-reframe camera and a filter sharpening streamed video.

Source: US 2026/0301464 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Google patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 6 sheets

6 drawing sheets from US 2026/0301464 A1 · click any drawing to enlarge

Target expression dataset generation system., drawing sheet 1 from US 2026/0301464 A1
Sheet 1 Target expression dataset generation system.
Style space engine, difference editing vector., drawing sheet 2 from US 2026/0301464 A1
Sheet 2 Style space engine, difference editing vector.
Style space engine, linear separation., drawing sheet 3 from US 2026/0301464 A1
Sheet 3 Style space engine, linear separation.
Optimization engine, similarity losses., drawing sheet 4 from US 2026/0301464 A1
Sheet 4 Optimization engine, similarity losses.
Input image, expression editing., drawing sheet 5 from US 2026/0301464 A1
Sheet 5 Input image, expression editing.
Method for generating expression images., drawing sheet 6 from US 2026/0301464 A1
Sheet 6 Method for generating expression images.
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.