Get the newsletter
Apple · AR / VR · Filed Jan 27, 2026 · USPTO published Aug 20, 2026 · Aug 20 release

Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls

When two people wearing AR headsets sit in the same room on the same video call, do the remote participants appear in the same positions for both of them? Apple has a patent describing exactly how to make sure they do.

Two headset users viewing a shared virtual space with floating caller windows and media controls. Drawing from patent filing US 2026/0245312 A1.
Two headset users viewing a shared virtual space with floating caller windows and media controls.All 26 drawings ↓
Publication number
US 2026/0245312 A1(US20260245312A1)
Applicant
Apple Inc.
Filed · Published
Jan 27, 2026 · Aug 20, 2026
Inventors
Gabrielle ECANOW, Jiwoo JANG, Tommy ROCHETTE, Connor A. SMITH, Kevin LEE, Shih-Sang CHIU, Joseph P. CERRA
Status when we published
Waiting for an examiner
Document
24 claims
US classification
345/419
Parent application
Claims priority from a provisional application 63760002 (filed Feb 18, 2025)

How Apple keeps remote faces consistent for everyone in the room

Today, if you and a colleague are both wearing AR headsets in the same conference room and join a video call, there is no guarantee that the floating virtual faces of your remote teammates appear in the same spots for each of you. That inconsistency can make it awkward to agree on who just spoke or where to direct a shared gesture.

Apple's new patent tackles that problem by letting the two headsets in the room coordinate. When something changes, like a remote participant getting promoted to a more prominent position because they started talking, one headset checks whether the change is significant enough to bother the other headset about. If it is, both devices update their layouts together. If it is not, each device holds its current view.

The goal is that both you and your seatmate see the same arrangement of remote people, so a shared gesture or glance across the table actually lands on the same virtual face for everyone.

From the filing · THE ABSTRACT
… maintaining visual consistency of a visual representation of one or more remote users in a three-dimensional environment within a multi-user communication session that includes a group of collocated users.

Translation: Keeping remote callers looking the same when multiple people share the same room.

How the sync decision gets made and sent to nearby devices

The patent describes a multi-device coordination method for mixed-reality video calls that involve at least two people physically sharing a space, each on their own headset or AR device, while also connected to remote participants.

Here is how the core logic works:

  • Prioritization data (a ranked score that determines which remote participants get more prominent display positions) is tracked continuously by the local devices.
  • When that score changes, such as when audio activity, speaker focus, or some other signal shifts, the device evaluates whether the change clears a threshold defined by one or more criteria.
  • If the threshold is met, the device recalculates the layout, updates its own display, and sends matching display data to the co-located device so both show the same new arrangement.
  • If the change is too small to clear the threshold, the device holds the existing layout and sends nothing, avoiding constant churn and visual distraction.

The patent also covers a related transition: moving a remote participant's representation from a flat virtual tile (think a floating video rectangle) into a full three-dimensional avatar within the shared environment. That shift can happen dynamically during a call as conditions change.

The filtering step, where small prioritization changes are ignored, is important. Without it, the layout would reorganize constantly and the coordination packets would flood the local network.

From the filing · CLAIM 1
updating presentation, via the one or more displays, of the plurality of virtual representations to have a second spatial arrangement, different from the first spatial arrangement; …

Translation: Rearranging where people appear in the virtual room based on new rules.

What this means for shared AR meeting spaces

For AR meetings to feel like real shared spaces, everyone in the room needs to perceive the same social geography. If your colleague's headset shows the remote CEO front and center while yours tucks that person off to the side, eye contact breaks down and spatial cues stop working. Apple's coordination logic is an attempt to solve that before it becomes a common complaint.

The filtering mechanism also hints at a practical design choice for Vision Pro-style environments where local Wi-Fi or wired connections carry the sync traffic. Sending a full layout update for every tiny priority fluctuation would waste bandwidth and cause visual jitter, so the threshold acts as a gatekeeper. This filing sits alongside the broader wave of latest Big Tech patents aimed at making shared AR spaces feel socially coherent rather than just technically connected.

Apple's 33rd filing we've tracked in our AR glasses watch since May continues the color-correction thread seen in the borrowed-camera fix and the on-screen reading approach.

Source: US 2026/0245312 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Apple patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 26 sheets

26 drawing sheets from US 2026/0245312 A1 · click any drawing to enlarge

Virtual reality headset, drawing sheet 1 from US 2026/0245312 A1
Sheet 1 Virtual reality headset
Device system architecture, drawing sheet 2 from US 2026/0245312 A1
Sheet 2 Device system architecture
Spatial positioning scenarios, drawing sheet 3 from US 2026/0245312 A1
Sheet 3 Spatial positioning scenarios
Shared group video views, drawing sheet 4 from US 2026/0245312 A1
Sheet 4 Shared group video views
Participant video tile layout, drawing sheet 5 from US 2026/0245312 A1
Sheet 5 Participant video tile layout
Participant tile arrangement views, drawing sheet 6 from US 2026/0245312 A1
Sheet 6 Participant tile arrangement views
Reordered participant tiles, drawing sheet 7 from US 2026/0245312 A1
Sheet 7 Reordered participant tiles
Highlighted participant window, drawing sheet 8 from US 2026/0245312 A1
Sheet 8 Highlighted participant window
Show the other 18 sheets
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 9
Sheet 9
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 10
Sheet 10
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 11
Sheet 11
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 12
Sheet 12
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 13
Sheet 13
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 14
Sheet 14
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 15
Sheet 15
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 16
Sheet 16
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 17
Sheet 17
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 18
Sheet 18
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 19
Sheet 19
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 20
Sheet 20
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 21
Sheet 21
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 22
Sheet 22
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 23
Sheet 23
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 24
Sheet 24
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 25
Sheet 25
Apple Patents a System to Keep Virtual Stand-Ins for Remote Callers Looking Consistent During Group Video Calls patent drawing, sheet 26
Sheet 26
Patent filing page

Watchlists this filing belongs to

All watchlists →