Apple Patents a Way to Let You Edit AR Documents Without Hijacking Your Collaborator's View
When you and a coworker are staring at the same virtual document in an AR headset and you want to make a quick edit, whose view wins? Apple has a patent for a system that answers that question cleanly.
What Apple's AR collaboration mode switch actually does
Every time two people look at the same document in a shared AR space, they see the exact same thing, which is great for presenting but terrible for editing. The moment you start making changes, the other person's view gets dragged along with yours, which is disorienting and often annoying.
Apple's new patent describes a system that handles this gracefully. When you're collaborating in a shared AR session, you and your partner are locked into the same view by default. But when you decide to make an edit, the system switches your headset into a personal editing mode. Your collaborator's view stays put while you make your changes on your own.
Once you're done, you can rejoin the shared view. The other person never has to watch the document spin and scroll around because you were reorganizing a paragraph. It's a small fix for a very real friction point that anyone who has screen-shared a document will recognize immediately.
while the computer system is in a collaboration session with two or more participants, wherein the collaboration session includes content that is configured to be edited in the collaboration session by the two or more participants …
Translation: Multiple people work together on a shared virtual document.
How the system splits synchronized and solo viewing
The patent describes a two-mode collaboration system designed for extended reality (AR/VR) environments like Apple Vision Pro.
Mode one is called spatially synchronized viewing. Both participants see an identical view of the shared content, positioned the same way in three-dimensional space. If one person pans around the document, the other person's view follows. This is useful for walking someone through a presentation or reviewing something together in real time.
Mode two kicks in when a participant requests to edit. The system detects an input (a gesture, tap, or similar signal) that signals intent to modify the content. At that point, the editing participant's display decouples from the shared view. Each person now has their own independent perspective on the content. The key detail: if the second participant moves or changes their view during this phase, the editing participant's view does not follow. They stay locked in their personal editing context.
The patent also covers a related scenario: adding new content to a three-dimensional environment during a real-time communication session (essentially, a live call in AR space). The system detects specific inputs requesting that content be added, then shares it into the session automatically.
… a computer system switches from spatially synchronized viewing to unsynchronized viewing when the user edits a document …
Translation: The system stops matching everyone's camera view so one person can edit privately.
What this means for working together in Apple Vision Pro
The problem this addresses is one that anyone who has used screen sharing or collaborative editing tools has felt: one person's navigation constantly disrupts everyone else's context. In a flat screen-sharing session, the annoyance is mild. In a full AR environment, where your view is your spatial reality, someone else dragging your perspective around is genuinely disorienting.
For Apple, this is directly relevant to Vision Pro's pitch as a serious productivity device. the pattern in Apple's spatial computing filings points toward making multi-user workflows feel as natural as sitting at the same table. A collaboration system that handles the edit-versus-watch tension thoughtfully makes the headset a more credible tool for actual work, not just demos.
Apple filed its 79th application we've tracked in our AR glasses research since May, building on work like predictive image fill and gaze-based sharpening.
Anyone who has tried to co-edit a document over a video call knows the specific frustration of watching someone else's scrolling yank your view at exactly the wrong moment. In a headset, where your field of vision and your sense of physical location are the same thing, that problem stops being a minor annoyance and becomes a real source of disorientation.
The fix here is appropriately sized: the moment one person starts editing, each user's view decouples automatically, so neither person is dragged through space by the other's movements. One person works freely, the other stays anchored, and no one has to negotiate it in the moment.
That instinct, matching the solution tightly to the actual cost of the problem, is what makes this worth taking seriously. Shared virtual spaces have real potential, but only if each person's sense of where they are stays under their own control.
There are more where this came from
We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.
The drawings
52 drawing sheets from US 2026/0299747 A1 · click any drawing to enlarge
Want this weekly breakdown for a company we don't cover? Patentlyze Pro →
Be the first to weigh in