Samsung Patents a Photo Editor That Uses 3D Models to Reposition Subjects
Moving someone in a photo sounds simple until you see the hollow silhouette and smeared background they leave behind. Samsung is filing a patent for a system that uses a 3D model of the subject to handle those leftovers automatically.
What Samsung's 3D-powered photo retouch actually does
Ever tried to reposition a person in a photo, only to end up with a blurry mess where they used to stand? That gap, the empty space or stretched pixels, is the problem Samsung's new patent is aimed at.
The idea is to treat your subject not as a flat cutout but as a 3D object. When you move, resize, or rotate that person, the system recalculates how they should look from the new angle, then separately repairs the background where they used to be, or extends it if you're pushing them toward the edge of the frame.
The result is a single, merged image where both the subject and the background look like they belong together, without you having to touch up anything by hand. Samsung's steady stream of image-editing filings suggests this is part of a broader push to bake studio-quality retouching directly into its devices.
… perform image processing to change at least one of a size, a position, or an orientation of the first subject using a three-dimensional ( 3 D) model for the first subject, to generate a second subject image including a changed first subject …
Translation: It alters the subject using a 3D model to change its size, position, or orientation.
How the 3D model rebuilds subject and background together
The patent describes a pipeline with several distinct stages working in sequence.
First, the device separates the original photo into two layers: a subject image (the person or object you want to move) and a background image (everything else). This is similar to the cutout tools already found in many phone cameras, but it sets up the rest of the process.
Next, a 3D model is generated for the subject. Think of this like the phone building a rough mannequin of the person from the flat photo, enough to understand how they'd look if tilted or scaled differently. The system then applies your requested change, whether that's making the subject larger, shifting them left, or rotating them slightly, and renders a new 2D image of the subject from the adjusted angle.
Meanwhile, the background layer gets its own repairs:
- The hole left behind where the subject stood (called the subject exclusion area) is filled in.
- If the subject moves toward or beyond the original frame edge, an extended area is generated to fill the new canvas space.
Finally, the repaired background and the repositioned subject are composited into a single output image. The patent specifies that the background processing is directly tied to what changed with the subject, so the fill isn't generic; it's calculated to match the new composition.
… perform image processing on at least one of a subject exclusion region in the first background image or an extension region outside the first background image to generate a second background image including the changed background …
Translation: It fills in or expands the background where the subject used to be.
What this means for everyday photo editing on Galaxy devices
For anyone who edits photos on a phone, the practical payoff is less manual cleanup. Today, moving a subject even a few inches in post-processing usually requires separate tools: one to cut, one to fill the background, and another to blend the edges. Samsung's approach collapses those steps into one automated action tied to a single user input.
The 3D reconstruction angle is the part worth watching. Most current mobile photo editors treat repositioning as a 2D operation, stretching or cloning pixels without understanding what the subject actually looks like in space. If the 3D modeling step works reliably on typical phone photos, your edited shots could look far more natural, especially when you rotate a subject and their proportions need to shift accordingly.
This is the 19th Samsung filing we've tracked since July in our AI photo editing race watchlist, following applications like one that targets specific bright spots and one that drafts its own suggestions.
The frustration Samsung is solving here is specific: you have a photo from a trip or birthday where the framing is slightly off, someone is too small or too close to the edge, and cropping only makes it worse. This feature lets you move or resize a person in the photo, then automatically repaints whatever background got exposed in the process, so it looks like you simply stood in a better spot when you took it.
That matters because the photos people care most about are rarely the ones they can just retake.
Whether it actually delivers comes down to how it handles the messy real world: tricky lighting, people partially overlapping, cluttered backgrounds. That is exactly where automatic fixes tend to fall apart, and it is the only situation where someone would bother using this at all.
There are more where this came from
We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.
The drawings
16 drawing sheets from US 2026/0268623 A1 · click any drawing to enlarge
Want this weekly breakdown for a company we don't cover? Patentlyze Pro →