Get the newsletter
Google · AI / ML · Filed Jul 17, 2026 · USPTO published Nov 12, 2026 · This week's release

Google Files Patent for Fixing Group Photos by Borrowing Faces From Other Shots

Google's patent describes a way to fix a group photo by borrowing a better face, or a whole head, from another frame in the same burst. The twist is that it decides which kind of swap will look more natural.

A smartphone interface allowing a user to choose better facial expressions from alternative photos to fix a group portrait. Drawing from patent filing US 2026/0360049 A1.
A smartphone interface allowing a user to choose better facial expressions from alternative photos to fix a group portrait.All 13 drawings ↓
Publication number
US 2026/0360049 A1(US20260360049A1)
Applicant
Google LLC
Filed · Published
Jul 17, 2026 · Nov 12, 2026
Inventors
Jay TENENBAUM, Assaf ZOMET, Barel LEVY, Yaron BRODSKY, Shiran ZADA, Yael Pritch KNAAN, Ariel EPHRAT, Inbar MOSSERI, Avram GOLBERT
Status when we published
Waiting for an examiner
Document
20 claims
US classification
345/629
Parent application
Continuation of 18/906,015 (filed Oct 3, 2024)(18906015)

What Google's group-photo face swap actually does

The more people you squeeze into a group photo, the better the odds that somebody blinked, looked away, or got caught mid-sentence. Retaking the shot again and again only works until everyone's patience runs out.

This Google patent describes a way to fix the one good photo you have by borrowing from the others you took. You pick the best overall shot, then choose a better face for each person from the rest. The software swaps in a whole head or just the eyes and mouth, depending on which will look more natural.

The filing says earlier tools of this type left visible seams or leftover pixels from the original. Google's approach tries to hide those, so the final picture looks like it was taken in one moment.

From the filing · CLAIM 1
… determining to use a face editor based on a difference between a first angle of a target head of the subject in the target image and a second angle of a source head of the subject in the source image …

Translation: The system decides to fix a face when someone is looking the wrong way in a photo.

How Google picks between a face or head swap

The patent covers a photo tool with two kinds of editors. You start with a target photo (the shot you like best overall) and one or more source photos (other frames, often from a burst) where a person looks better. The claims center on the face editor, which gets used when the head angle in the target and source photos is close enough to match.

The face editor moves only things like eyes and mouths. It straightens the face to a standard pose, turns the face into a list of numbers that describes it (a latent-space vector), and copies the eye and mouth numbers from the source into the target. Then it redraws the face and tilts it back to its original pose. The filing leaves the nose alone, since a nose from a differently tilted head can look out of place.

When the angles differ more, the filing describes a head editor that replaces the whole head, hair included. It fills the neck and shoulders with a blend computed from both photos and repaints any background the old head uncovered. It skips this when heads are crowded together or one is blocked, which it can spot by comparing color histograms (a count of the colors in each picture).

For phones, the filing also describes a lightweight on-device model. It warps a dense face mesh (a grid of points mapped over the face) from the source onto the target, and a larger offline model cleans up artifacts and helps train the phone version.

Why your next group photo could need fewer retakes

If you've taken a group photo, you know the routine: shoot a dozen frames and hope. A tool like this would let you pick one frame and fix the person who blinked, using another frame from the same burst. The filing's mock-up even shows a Best Take button, with a choice of faces for each person in the shot.

For Google, the interesting part is the plan to run it on the phone itself. The filing says processing can happen on your device or on a server depending on your settings, and edits only go ahead with your permission. The real test is whether results look natural in hard cases like hats, crowded heads and big pose changes.

Google's 83rd filing we've tracked since May builds on video grown from one photo and erasing text from photos in our AI photo editing watchlist.

Source: US 2026/0360049 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Google patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 13 sheets

13 drawing sheets from US 2026/0360049 A1 · click any drawing to enlarge

How phones connect to a photo server to edit images, drawing sheet 1 from US 2026/0360049 A1
Sheet 1 How phones connect to a photo server to edit images
Hardware parts that run the photo editing app, drawing sheet 2 from US 2026/0360049 A1
Sheet 2 Hardware parts that run the photo editing app
Screens for choosing base photos and donor shots, drawing sheet 3 from US 2026/0360049 A1
Sheet 3 Screens for choosing base photos and donor shots
Swapping an awkward head angle with a better pose, drawing sheet 4 from US 2026/0360049 A1
Sheet 4 Swapping an awkward head angle with a better pose
A family snapshot with heads marked for replacement, drawing sheet 5 from US 2026/0360049 A1
Sheet 5 A family snapshot with heads marked for replacement
Matching bad expressions with better takes from other photos, drawing sheet 6 from US 2026/0360049 A1
Sheet 6 Matching bad expressions with better takes from other photos
Lining up replacement heads over the original poses, drawing sheet 7 from US 2026/0360049 A1
Sheet 7 Lining up replacement heads over the original poses
Filling in background gaps left behind swapped heads, drawing sheet 8 from US 2026/0360049 A1
Sheet 8 Filling in background gaps left behind swapped heads
Show the other 5 sheets
A finished photo after swapping in better expressions, drawing sheet 9 from US 2026/0360049 A1
Sheet 9 A finished photo after swapping in better expressions
How phones use AI to blend portraits on device, drawing sheet 10 from US 2026/0360049 A1
Sheet 10 How phones use AI to blend portraits on device
Swapping an awkward expression with a smile from another shot, drawing sheet 11 from US 2026/0360049 A1
Sheet 11 Swapping an awkward expression with a smile from another shot
Picking favorite faces from a burst of photos, drawing sheet 12 from US 2026/0360049 A1
Sheet 12 Picking favorite faces from a burst of photos
Choosing between swapping an entire head or just facial features, drawing sheet 13 from US 2026/0360049 A1
Sheet 13 Choosing between swapping an entire head or just facial features
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.