Get the newsletter
Sony · AI / ML · Filed Apr 3, 2026 · USPTO published Aug 13, 2026 · Aug 13 release

Sony Patents a System That Scores What Viewers Actually Watch On Screen

Sony has filed a patent for a system that uses cameras pointed at an audience to track where people's eyes land on a video, then produces a numerical score for how much attention each on-screen object actually received.

An audience engagement tracking system identifying on-screen characters, ranking them by viewer attention, and determining which pair has the best chemistry. Drawing from patent filing US 2026/0237091 A1.
An audience engagement tracking system identifying on-screen characters, ranking them by viewer attention, and determining which pair has the best chemistry.All 5 drawings ↓
Publication number
US 2026/0237091 A1(US20260237091A1)
Applicant
SONY GROUP CORPORATION
Filed · Published
Apr 3, 2026 · Aug 13, 2026
Inventors
ANUBHAV SRIVASTAVA, CHINMAY BHARADWAJ, GOPINATH RAMANANDA, SABYASACHI PAUL, MAHIMA RAO K
Status when we published
Waiting for an examiner
Document
8 claims
US classification
382/103
Parent application
Continuation of 18/348,333 (filed Jul 6, 2023)(18348333)

How Sony's gaze-tracking engagement score works

Ever wondered whether viewers are actually looking at the logo in your ad, or just zoning out at the background? That's the exact problem Sony's new patent is trying to solve.

The system works by watching the audience while they watch the video. A camera captures images of the viewers, an AI model figures out where each person's gaze is pointed, and that gaze data gets mapped back onto the video frame. Every on-screen object, a product, a face, a text overlay, gets an engagement score based on how many people looked at it and for how long.

The result is a dashboard-style output that shows which parts of a video actually grabbed attention and which parts went unnoticed. For anyone producing video content or placing ads inside it, that's a measurably different kind of feedback than view counts or skip rates.

From the filing · CLAIM 1
… receive a set of images of an audience viewing the received media content; estimate, based on application of a second machine learning model on the set of images, gaze data associated with the audience; map the estimated gaze data to the set of objects detected in the plurality of video frames …

Translation: The system uses cameras to watch you while you watch TV, tracking exactly where your eyes are looking on the screen.

How two AI models turn eye data into per-object scores

The patent describes an electronic device running two separate neural network (machine learning) models in sequence.

The first model processes the video itself, scanning each frame to identify and locate objects: a face, a brand logo, a product being demonstrated, any discrete element the frame contains. The second model processes images of the audience captured while they watch, estimating gaze coordinates (the x/y position on screen each viewer appears to be looking at).

Once both models have done their work, the system divides each video frame into a grid of segments (smaller zones of the image) and maps the gaze coordinates into those segments. Because it knows which objects occupy which segments, it can calculate how much collective viewer attention landed on each object over time. That produces a per-object engagement score.

The patent also references a content playability factor, a condition the system checks before deciding which video frames to analyze, though the filing does not fully specify what that condition entails. The final scores are rendered on a display device, suggesting a monitoring or analytics interface rather than something end-viewers would see.

From the filing · THE ABSTRACT
The electronic device determines an engagement score for each object based on the mapping of the gaze co-ordinates and renders the engagement score on a display device.

Translation: The device calculates a score for every item on screen to show how much attention it received from the viewer.

What this means for advertisers and content producers

For advertisers and broadcasters, this kind of data would answer a question that click-through rates and completion percentages cannot: did anyone actually look at the thing we paid to place on screen? A brand spending money on a product placement in a streaming series, or on an in-video overlay ad, currently has very little proof that viewers' eyes ever went there. An engagement score per object changes that calculus entirely.

The practical path to a shipping product requires hardware (audience-facing cameras in a controlled setting like a focus-group room, a smart TV, or a cinema) plus the consent and privacy infrastructure to collect gaze data legally, so this is not something that appears in a firmware update next quarter. Still, the underlying computer-vision pieces are mature, and Sony operates across televisions, cameras, and entertainment, which puts multiple parts of the required stack already inside one company. Readers tracking new Big Tech patents in ad tech and audience measurement will recognize this as part of a broader push to make attention, not just playback, the currency of video analytics.

Source: US 2026/0237091 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Sony patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 5 sheets

5 drawing sheets from US 2026/0237091 A1 · click any drawing to enlarge

Overview of the viewer tracking system, drawing sheet 1 from US 2026/0237091 A1
Sheet 1 Overview of the viewer tracking system
Internal components of the tracking device, drawing sheet 2 from US 2026/0237091 A1
Sheet 2 Internal components of the tracking device
Data flow of the tracking process, drawing sheet 3 from US 2026/0237091 A1
Sheet 3 Data flow of the tracking process
Character identification and engagement ranking, drawing sheet 4 from US 2026/0237091 A1
Sheet 4 Character identification and engagement ranking
Step-by-step tracking method flowchart, drawing sheet 5 from US 2026/0237091 A1
Sheet 5 Step-by-step tracking method flowchart
Patent filing page