Microsoft Patents Video Call Backgrounds That Shift Like Real Rooms
Microsoft is working on video call backgrounds that aren't just static images, they move and shift in response to the viewer's position, making a flat photo feel like a real room with actual depth.
What Microsoft's moving video call backgrounds actually do
You're on a video call and your background is just a flat photo sitting perfectly still. It looks fine, but everyone can tell it's fake, because real rooms move when you shift in your seat.
Microsoft's new patent describes a system that takes an ordinary flat image and breaks it into separate layers by depth, putting the sofa closer and the bookshelf further back. As the person watching the call tilts or moves slightly, those layers shift against each other the same way a window and the street outside do when you move your head. The effect is called parallax, and your brain reads it instantly as real distance.
The system figures out which parts of the image belong to which depth, fills in any gaps those layers create when they slide around, and then watches where the viewer is looking so it knows when to shift everything. The result is a background that behaves more like a window into a real space than a photo pinned to a wall.
… performing image completion on a layer of the plurality of layers to add to the layer new image content that is not in the 2D image …
Translation: The system invents missing background details that were hidden behind the person in the original photo.
How Microsoft splits one photo into depth-layered slices
The patent describes a multi-step image processing pipeline that converts a single flat photo into an interactive, layered scene for use as a video call background.
First, the system runs image segmentation (dividing the photo into distinct objects, chairs, walls, plants) and then depth estimation (figuring out how far each object would be from a camera in a real room). Objects are grouped into a small number of depth layers, with closer things in front and distant things behind.
Because those layers now move independently, gaps appear at the edges when they shift. The patent calls for image completion, an AI-driven process that invents plausible new pixels to fill those gaps, so the background never shows a torn edge.
Finally, the system tracks the viewpoint orientation of the observer (the direction the person watching the call is facing, probably through their webcam or device sensors) and applies the parallax effect (the optical phenomenon where closer objects appear to move more than distant ones when you change position). The layers are repositioned in real time to match, creating the illusion of a three-dimensional space behind the video participant.
… the background behind a videoconference participant appears to be three-dimensional rather than static …
Translation: Your video call background looks like a real room instead of a flat picture.
What this means for your next Teams meeting background
For anyone who uses a virtual background on Teams or a similar app, the difference between a static photo and one that subtly moves is surprisingly large. Static backgrounds look like green-screen cutouts; a background with parallax depth reads closer to a real room. You'd notice it most in longer calls where the flatness of a fake background becomes distracting.
Microsoft's steady investment in Teams video quality means this fits a clear pattern. The harder question is whether the depth estimation and real-time layer shifting can run fast enough on ordinary laptops without burning through the battery or demanding a dedicated graphics chip. The patent covers the concept; the hardware constraints will decide whether it ever ships in a form most people actually use.
This is the 388th Microsoft filing we've tracked since May in our Microsoft coverage, adding to work like the three-direction cooling system and stopping glowing eyes in AR.
When you shift in your chair during a video call, the background behind you shifts too, the way a real room would from a slightly different angle. That small movement tells your brain you're looking at a place, not a cutout, and the person on the other end stops noticing your background and starts noticing you.
The hidden challenge is whether this works on a normal laptop already straining to run a call. The software has to track your movement, layer the image, and fill in missing pieces in real time, and if that process stutters, the effect becomes more distracting than a plain wall.
For anyone calling from a messy kitchen or a dim spare room, a background that actually looks believable changes how they come across, without buying new equipment or setting anything up.
There are more where this came from
We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.
The drawings
12 drawing sheets from US 2026/0270370 A1 · click any drawing to enlarge
Want this weekly breakdown for a company we don't cover? Patentlyze Pro →