IBM Patents AR Captions That Reshape Themselves Around How You Read
IBM has filed a patent for AR captions that don't just sit there on your glasses: they watch how you're reading and change their size, speed, or position on the fly to keep you from falling behind.

- Publication number
- US 2026/0301602 A1(US20260301602A1)
- Applicant
- International Business Machines Corporation
- Filed · Published
- Jun 9, 2026 · Oct 1, 2026
- Inventors
- Jill S. Dhillon, Jennifer M. Hatfield, Tushar Agrawal, Jeremy R. Fox
- Status when we published
- Waiting for an examiner
- Document
- 20 claims
- US classification
- 434/112
- Parent application
- Continuation of 18/337,187 (filed Jun 19, 2023)(18337187)
What IBM's self-adjusting AR captions actually do
You're at a work presentation and the speaker is moving fast. You're wearing AR glasses that show captions, but the text is scrolling too quickly and you're losing chunks of what's being said.
IBM's patented approach would fix this by watching how you consume captions, not just whether you're looking at them. If you seem to be struggling, the system changes something: the font gets bigger, the words slow down, the caption block moves to a better spot in your field of view. All of this happens automatically, without you needing to pause and dig through settings.
For the roughly 1.5 billion people worldwide who live with some degree of hearing loss, this kind of adaptation could make the difference between following a conversation and guessing at it. Real-time caption adjustment based on actual reading behavior is the core idea here.
… monitoring user processing behavior associated with consumption of the captions; and dynamically modifying, in real time and based on the monitored user processing behavior, at least one presentation parameter of the captions …
Translation: The system watches how you read the captions and instantly adjusts how they look to help you understand better.
How the system tracks reading and rewrites the display
The patent describes a closed-loop system with four main stages that work continuously during a speech event.
- Audio capture and transcription: A microphone picks up a speaker's words and a speech-to-text engine converts them to written captions, as existing tools already do.
- Caption display on AR: Those captions appear on an augmented reality device, like smart glasses, overlaid on the real world in front of the user.
- Behavior monitoring: This is the novel part. The system tracks what it calls "user processing behavior" during caption consumption. That likely means eye-tracking data (where you're looking and for how long), reading pace, and possibly whether you're repeatedly glancing at the same text.
- Dynamic parameter modification: Based on what the system observes, it adjusts at least one presentation parameter in real time. The patent doesn't enumerate every possible parameter, but typical candidates include font size, text scroll speed, caption position, line length, or display contrast.
The feedback loop is continuous: the system keeps monitoring and keeps adjusting throughout the entire presentation, not just at a fixed interval. The goal is matching the display to the user's actual reading capacity in the moment, which can vary with fatigue, speaker pace, or topic complexity.
What this means for deaf and hard-of-hearing users
For people with hearing loss, captions are often the only channel carrying spoken information. When those captions move too fast, appear in a bad spot, or use small text in a cluttered visual field, comprehension breaks down fast. A static caption system designed for the average reader doesn't account for individual differences or changing conditions inside a single conversation.
If this approach works as described, it could make AR-based accessibility tools meaningfully more useful in high-stakes settings like lectures, medical appointments, or legal proceedings. IBM keeps filing on accessibility-driven AI suggests this is part of a broader pattern, though this specific patent is narrowly focused on the display layer rather than the speech recognition underneath it.
IBM's fifth filing we've tracked in the AR glasses race since July builds on earlier applications like one flagging factory defects and one sharing objects by gaze.
Source: US 2026/0301602 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.
Get our take in your Top Stories
Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time IBM patent news breaks.
We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.
The drawings · 2 sheets
2 drawing sheets from US 2026/0301602 A1 · click any drawing to enlarge

No comments yet