Get the newsletter
Sony · AI / ML · Filed Dec 12, 2025 · USPTO published Oct 1, 2026 · Oct 1 release

Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos

Getting a clean cutout of a person or object in a photo is harder than it looks, and Sony thinks two AI models working together can do it better than one alone.

Cameras capture a person, whose image is then processed into a 3D model and displayed on a screen or virtual reality headset. Drawing from patent filing US 2026/0301123 A1.
Cameras capture a person, whose image is then processed into a 3D model and displayed on a screen or virtual reality headset.All 15 drawings ↓
Publication number
US 2026/0301123 A1(US20260301123A1)
Applicant
SONY GROUP CORPORATION
Filed · Published
Dec 12, 2025 · Oct 1, 2026
Inventors
MASAKO KOMURO, YOSHIYUKI TAKAO
Status when we published
Waiting for an examiner
Document
12 claims
US classification
382/284
Parent application
National Stage Entry of PCT/JP2023/027189 (filed Jul 25, 2023)(PCTJP2023027189)

What Sony's two-model silhouette system actually does

You're trying to scan a friend in full 3D, and the software keeps including bits of the wall behind them or clipping off their shoulder. The problem is that no single method of figuring out where a person ends and the background begins is perfect in every situation.

Sony's patent describes a system that runs two separate approaches at once and then blends their results. One AI model looks at both the photo and a plain background image to spot what changed. A second method identifies objects by recognizing what they are. By merging these two outputs, the system can catch mistakes that either approach would make on its own.

The target use case is building 3D models from photos, where a sloppy cutout leaves messy edges on the final figure. Cleaner silhouettes mean cleaner 3D scans, whether that's for games, film production, or product photography.

From the filing · CLAIM 1
… merge processing unit configured to merge a first silhouette image output from a first learning model that takes, as input, a captured image in which a subject and a background appear and a background image in which the background appears …

Translation: This component combines cutout results from an AI that compares a photo against a clean background shot.

How the two silhouette outputs get merged into one

The patent centers on a merge processing unit that combines two independently generated silhouette images into one final result.

The first silhouette comes from a learned AI model (trained on image data) that takes two inputs: the actual photo of a subject against a background, and a reference photo of that same background without the subject. Because it can compare the two, it gets a strong signal about which pixels belong to the person or object and which belong to the scenery behind them.

The second silhouette is generated through object recognition, meaning the system looks at the photo and tries to identify and outline known categories of things (people, chairs, products, etc.). This approach doesn't need a clean background reference shot, but it can struggle with unusual poses or lighting.

  • Model 1 strength: precise edge detection when a background reference exists
  • Model 2 strength: object-aware, works even without a background-only shot
  • Merge unit: combines both outputs to cover each model's blind spots

The merged result is meant to feed into 3D model generation pipelines, where each camera angle needs a reliable silhouette to reconstruct the subject's shape in three dimensions.

From the filing · THE ABSTRACT
… an image processing device that extracts a silhouette of a subject from a captured image for use in generating a 3D model …

Translation: The system isolates people or objects in pictures so they can be turned into three dimensional objects.

What this means for 3D scanning and photo editing

For anyone building 3D scans, whether for movies, games, e-commerce product pages, or virtual try-on, cleaner subject cutouts directly mean less manual cleanup work. Right now, artists often spend time fixing jagged or incomplete edges by hand. A system that gets the outline right automatically saves real production hours.

On the consumer side, this kind of technology feeds into camera apps, video call background removal, and augmented reality features. Sony's track record in image-processing patents suggests the company sees this as infrastructure that could run across its camera hardware, PlayStation platform, and professional imaging tools. If the merge approach genuinely outperforms single-method cutouts, it becomes a useful building block across a wide range of products.

Sony's 17th filing we've tracked since July in the AI photo editing race, following one fixing extreme lighting and one keeping video frames consistent, shows how broadly the company is applying AI to image work.

Source: US 2026/0301123 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Sony patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 15 sheets

15 drawing sheets from US 2026/0301123 A1 · click any drawing to enlarge

Cameras capture a person., drawing sheet 1 from US 2026/0301123 A1
Sheet 1 Cameras capture a person.
Person's image and background., drawing sheet 2 from US 2026/0301123 A1
Sheet 2 Person's image and background.
Foreground/background difference processing., drawing sheet 3 from US 2026/0301123 A1
Sheet 3 Foreground/background difference processing.
Image segmentation examples., drawing sheet 4 from US 2026/0301123 A1
Sheet 4 Image segmentation examples.
Combining images for a silhouette., drawing sheet 5 from US 2026/0301123 A1
Sheet 5 Combining images for a silhouette.
Input image and silhouette output., drawing sheet 6 from US 2026/0301123 A1
Sheet 6 Input image and silhouette output.
Combining silhouette generation methods., drawing sheet 7 from US 2026/0301123 A1
Sheet 7 Combining silhouette generation methods.
Bone estimation and mask generation., drawing sheet 8 from US 2026/0301123 A1
Sheet 8 Bone estimation and mask generation.
Show the other 7 sheets
Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos patent drawing, sheet 9
Sheet 9
Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos patent drawing, sheet 10
Sheet 10
Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos patent drawing, sheet 11
Sheet 11
Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos patent drawing, sheet 12
Sheet 12
Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos patent drawing, sheet 13
Sheet 13
Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos patent drawing, sheet 14
Sheet 14
Sony Patents a Dual-AI Method for Cutting Subjects Out of Photos patent drawing, sheet 15
Sheet 15
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.