Get the newsletter
Sony · AR / VR · Filed Jul 29, 2025 · USPTO published Aug 13, 2026 · Aug 13 release

Sony Patents Technology That Syncs AR and VR Views to Your Music

Sony has filed a patent for an AR or VR device that reads what you're listening to and changes what you see based on the music. It's a short claim, but it points at something genuinely new: a display that treats your ears as a visual input.

A person playing an electric guitar alongside textual lyric displays generated from audio cues. Drawing from patent filing US 2026/0237163 A1.
A person playing an electric guitar alongside textual lyric displays generated from audio cues.All 13 drawings ↓
Publication number
US 2026/0237163 A1(US20260237163A1)
Applicant
Sony Semiconductor Solutions Corporation
Filed · Published
Jul 29, 2025 · Aug 13, 2026
Inventors
Stefan UHLICH, Dunai FUENTES HITOS, Lev MARKHASIN, Justinas MISEIKIS, Diederik Paul MOEYS
Status when we published
Waiting for an examiner
Document
19 claims
US classification
345/633
Parent application
National Stage Entry of PCT/EP2024/054347 (filed Feb 21, 2024)(PCTEP2024054347)

What Sony's audio-reactive AR idea actually does

Imagine walking down the street with AR glasses and the visual overlay around you shifts its color, style, or intensity to match whatever song is playing in your headphones. That's the core idea in Sony's latest patent.

The filing describes electronics that can monitor current audio data, the music or sound you're actively hearing, and use that information to modify what you see in an AR or VR view. In plain terms: your visual world would react to your soundtrack.

Sony doesn't spell out exactly how far the changes go. The visual modifications could be as subtle as a color temperature shift or as dramatic as animated effects layered over your surroundings. The patent stakes out the broad principle, leaving the specifics open.

How the circuitry links audio data to AR/VR display changes

At its core, this patent covers an electronic device, a pair of AR glasses or a VR headset, whose internal circuitry is wired to analyze whatever audio the user is currently hearing and then adjust the displayed visual scene accordingly.

The key phrase is "current audio data." That means the system has to be monitoring audio in real time, not reacting to a preset playlist. This implies some on-device audio analysis happening continuously while you wear the device.

The claim covers both AR views (digital overlays on the real world, think heads-up displays or layered graphics over a live camera feed) and VR views (fully synthetic environments). Covering both suggests Sony wants a single framework that can work across its range of hardware, whether that's camera-passthrough AR glasses or a closed VR headset.

The patent doesn't define which audio properties drive the visual changes, tempo, pitch, genre, mood, loudness, or something else entirely. That vagueness is deliberate; broad claims let a patent cover more ground. The actual signal processing and the specific visual transformations would need to be worked out in engineering, and that work isn't described here.

What this means for wearable AR and music experiences

For consumers, the appeal is obvious: AR and VR displays today are largely static in their overlay logic. They show maps, notifications, or fixed graphical layers. A system that responds to music could make wearable AR feel more alive and personal, closer to a visual instrument than a heads-up display.

For Sony specifically, this filing sits at the intersection of two areas the company already has hardware in: audio (headphones, earbuds) and imaging sensors used in AR-capable devices. The patent is abstract enough that it's hard to connect it to a specific product roadmap, and Sony Semiconductor Solutions files as the applicant, meaning this comes from the chip and sensor side of the business rather than the consumer products side. Big Tech patent news covering AR hardware regularly surfaces filings like this one, where sensor and display teams stake out audio-visual fusion territory well before any headset ships.

Source: US 2026/0237163 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Sony patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 13 sheets

13 drawing sheets from US 2026/0237163 A1 · click any drawing to enlarge

System flowchart for media synchronization, drawing sheet 1 from US 2026/0237163 A1
Sheet 1 System flowchart for media synchronization
Object detection and analysis pipeline, drawing sheet 2 from US 2026/0237163 A1
Sheet 2 Object detection and analysis pipeline
Detected object attributes and coordinates, drawing sheet 3 from US 2026/0237163 A1
Sheet 3 Detected object attributes and coordinates
Audio event detection process flow, drawing sheet 4 from US 2026/0237163 A1
Sheet 4 Audio event detection process flow
Audio source separation and processing, drawing sheet 5 from US 2026/0237163 A1
Sheet 5 Audio source separation and processing
Rule-based text prompt generation, drawing sheet 6 from US 2026/0237163 A1
Sheet 6 Rule-based text prompt generation
Content replacement rule examples, drawing sheet 7 from US 2026/0237163 A1
Sheet 7 Content replacement rule examples
Conditioned image generation workflow, drawing sheet 8 from US 2026/0237163 A1
Sheet 8 Conditioned image generation workflow
Show the other 5 sheets
Sony Patents Technology That Syncs AR and VR Views to Your Music patent drawing, sheet 9
Sheet 9
Sony Patents Technology That Syncs AR and VR Views to Your Music patent drawing, sheet 10
Sheet 10
Sony Patents Technology That Syncs AR and VR Views to Your Music patent drawing, sheet 11
Sheet 11
Sony Patents Technology That Syncs AR and VR Views to Your Music patent drawing, sheet 12
Sheet 12
Sony Patents Technology That Syncs AR and VR Views to Your Music patent drawing, sheet 13
Sheet 13
Patent filing page

Watchlists this filing belongs to

All watchlists →