Get the newsletter
Apple · AR / VR · Filed Jun 11, 2026 · USPTO published Oct 1, 2026 · Oct 1 release

Apple Patents a Way to Show Real Objects Appearing Around Your Avatar During Video Calls

When you sit down during a video call, a chair could appear under your avatar. Apple has filed a patent describing a system that pulls real-world objects into a 3D virtual meeting space, only when they're needed, and only as much as your privacy allows.

A person's avatar in a virtual room, with virtual versions of real-world objects from their physical environment. Drawing from patent filing US 2026/0301340 A1.
A person's avatar in a virtual room, with virtual versions of real-world objects from their physical environment.All 12 drawings ↓
Publication number
US 2026/0301340 A1(US20260301340A1)
Applicant
Apple Inc.
Filed · Published
Jun 11, 2026 · Oct 1, 2026
Inventors
Shih-Sang Chiu, Alexandre Da Veiga, David H Huang, Jonathan Perron, Jordan A. Cazamias
Status when we published
Waiting for an examiner
Document
20 claims
US classification
345/633
Parent application
Continuation of 18/367,490 (filed Sep 13, 2023)(18367490)

What Apple's physical-context avatar system actually does

A friend's avatar floats in a blank virtual room during your video call. She reaches for something, and there's no context for what she's doing or why. That awkward gap is what this Apple filing tries to fix.

The system watches for specific events in the real world and responds by adding matching objects to the 3D scene. If someone sits down, a chair shape appears beneath them. If they reach toward a table, a table shows up. If a dog barks off-camera, a cartoon dog might pop into view. The idea is that these additions tell the story of what the other person is actually doing, without revealing their entire room.

Privacy is built into the design. The patent is explicit that the information sent about any object must be limited so it doesn't expose private details of the other person's home or surroundings. You see enough to understand what's happening, not a full scan of someone's living room.

From the filing · CLAIM 1
… receiving information about characteristics of a context feature representing an object to provide the context, wherein the received information is limited to avoid revealing a private attribute of the physical environment of the remote user; …

Translation: Apple's system collects details about your room while purposely hiding your private items.

How the system detects conditions and renders context objects

The patent describes a method for contextual object injection inside a 3D virtual environment shared during a communication session (think a spatial video call, not a flat Zoom window).

Here's how the flow works:

  • A user's avatar is shown inside a virtual 3D space. The real person is sitting somewhere else entirely, in their own physical room.
  • The system monitors for specific trigger conditions, things like the person sitting down, reaching toward an object, turning their head toward a sound, or a detectable noise like a dog barking.
  • When a condition is met, the system retrieves data describing a context feature, a simplified representation of the relevant real-world object (a chair, a table, a cup, another person nearby).
  • That representation is added to the shared 3D view, so remote participants see it alongside the avatar.

Critically, the patent specifies that the information transmitted about any context object must be limited to avoid revealing private attributes of the physical space. So a chair might appear as a generic shape, not a photorealistic scan of the actual chair in the room.

The system appears to rely on sensors already present in a device like Apple Vision Pro (cameras, microphones, depth sensors) to detect the triggering events in real time.

From the filing · THE ABSTRACT
… a representation of a sitting surface may be shown based on detecting that the user is sitting down, representations of a table and coffee cup may be shown based on detecting that the user is reaching out to pick up a coffee cup, …

Translation: Virtual objects like chairs and coffee cups appear around your avatar based on your physical actions.

What this means for spatial computing and video presence

Spatial computing video calls, the kind Apple Vision Pro is built around, have an obvious problem: avatars look disconnected from reality when they float in empty space. Every time someone reacts to something in their physical room, the remote viewer loses the thread. This patent is a direct attempt to solve that.

The privacy angle is the part worth watching. the pattern in Apple's spatial computing filings shows a recurring concern about how much of your home a device can see and transmit. Building the privacy limit into the core claim, rather than as an afterthought, suggests Apple sees this as a design constraint from the start, not a policy patch applied later. For everyday users, that framing matters: the feature only works if people trust it enough to turn it on.

Apple's 72nd filing we've tracked in our AR glasses work since May builds on ideas like overlaying a redesigned room and adding simulated lighting to video.

Source: US 2026/0301340 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Apple patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 12 sheets

12 drawing sheets from US 2026/0301340 A1 · click any drawing to enlarge

Person photographing real-world objects., drawing sheet 1 from US 2026/0301340 A1
Sheet 1 Person photographing real-world objects.
Avatar in virtual room with objects., drawing sheet 2 from US 2026/0301340 A1
Sheet 2 Avatar in virtual room with objects.
Avatar with virtual objects and text., drawing sheet 3 from US 2026/0301340 A1
Sheet 3 Avatar with virtual objects and text.
Avatar with virtual objects and tablet., drawing sheet 4 from US 2026/0301340 A1
Sheet 4 Avatar with virtual objects and tablet.
Avatar with virtual objects and box., drawing sheet 5 from US 2026/0301340 A1
Sheet 5 Avatar with virtual objects and box.
Avatar with virtual objects and couch., drawing sheet 6 from US 2026/0301340 A1
Sheet 6 Avatar with virtual objects and couch.
Avatar with virtual objects and plant., drawing sheet 7 from US 2026/0301340 A1
Sheet 7 Avatar with virtual objects and plant.
Avatar with virtual objects and table., drawing sheet 8 from US 2026/0301340 A1
Sheet 8 Avatar with virtual objects and table.
Show the other 4 sheets
Apple Patents a Way to Show Real Objects Appearing Around Your Avatar During Video Calls patent drawing, sheet 9
Sheet 9
Apple Patents a Way to Show Real Objects Appearing Around Your Avatar During Video Calls patent drawing, sheet 10
Sheet 10
Apple Patents a Way to Show Real Objects Appearing Around Your Avatar During Video Calls patent drawing, sheet 11
Sheet 11
Apple Patents a Way to Show Real Objects Appearing Around Your Avatar During Video Calls patent drawing, sheet 12
Sheet 12
Patent filing page

Watchlists this filing belongs to

All watchlists →
Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.