Get the newsletter
Google · Software · Filed Dec 2, 2025 · USPTO published Aug 20, 2026 · Aug 20 release

Google Patents a Way to Pull Health Data Out of a Photo of Your Screen

Google has filed a patent for a system that can look at a photo of a device's screen and extract the health data being displayed on it, no manual entry required.

Smartphone capturing a photo of a smartwatch display to extract health metrics. Drawing from patent filing US 2026/0245723 A1.
Smartphone capturing a photo of a smartwatch display to extract health metrics.All 9 drawings ↓
Publication number
US 2026/0245723 A1(US20260245723A1)
Applicant
Google LLC
Filed · Published
Dec 2, 2025 · Aug 20, 2026
Inventors
Anupam J. Pathak, Dongeek Shin
Status when we published
Waiting for an examiner
Document
22 claims
US classification
382/128
Parent application
National Stage Entry of PCT/US2023/024221 (filed Jun 2, 2023)(PCTUS2023024221)

How Google reads your health stats from a screen photo

Health monitors and medical displays already show biometric readings on screen. The problem is that getting those readings into a second device, say, a phone or a cloud service, usually means typing the numbers in by hand or relying on a direct connection between the two gadgets.

Google's patent describes a different approach: take a photo of the screen showing the health data, and let software figure out what the numbers mean. The system uses what Google calls a "digital display function," which is essentially a decoder that already knows how that particular screen lays out its information. Because it knows the screen's format, it can pull out the actual biometric reading from the image rather than just seeing a picture of digits.

The result is that a second device, like a phone pointed at a glucose monitor or a heart-rate display, could automatically log your health readings without any manual transcription.

From the filing · CLAIM 1
… obtain an image including the display screen displaying biometric information associated with a user of the biometric sensing computing device …

Translation: It takes a picture of a screen that is showing health measurements.

How the digital display function decodes biometric data

The patent describes a two-device setup. One device, called the biometric sensing computing device, is something like a health monitor or medical display that shows biometric readings on its screen. A second computing device, which could be a phone or a tablet, takes a photo that includes that screen.

The key step is what Google calls the digital display function. Before the image is even captured, the second device obtains display screen information about the first device's screen (think: the screen's layout, pixel structure, how it renders numbers, and how its display panel encodes color and brightness). That metadata acts as a decoding key.

When the image arrives, the system runs the digital display function against it. This lets the software separate the actual biometric content, a blood-oxygen percentage, a heart rate, a glucose reading, from the visual noise of the photo itself (glare, angle, ambient light). The output is biometric content information: the underlying health data in a form the device can store and use, not just a picture of numbers.

The claim is deliberately broad. It covers any computing device doing this extraction, any kind of display screen, and any biometric information shown on that screen, which means the approach could apply across a wide range of health-monitoring scenarios.

From the filing · THE ABSTRACT
… execute a digital display function based on the display screen information to determine biometric content information from the image corresponding to the biometric information …

Translation: It processes the photo to extract the exact health numbers displayed on the screen.

What this means for remote health monitoring

For anyone who has ever squinted at a medical device and typed its readings into a phone app by hand, the appeal here is obvious. A system like this could make data transfer between health gadgets automatic, especially in cases where two devices have no shared wireless protocol or proprietary connection.

The broader significance is that Google is patenting a method that treats the screen itself as a data channel, not just a display. Health data from third-party devices that Google has no hardware relationship with could, in theory, flow into Google's ecosystem by camera alone. This area of biometric capture through optical means is one of the more active corners of interesting tech patents right now, as companies search for ways to absorb health data from the fragmented landscape of consumer and clinical monitors.

Google files its eighth application we've tracked in body-reading wearables since May, adding to earlier work like the heart-rhythm AI and the artery-pressure finger cuff.

Source: US 2026/0245723 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Google patent news breaks.

There are more where this came from

We read the new patents from Big Tech, carmakers and more and send you the ones worth knowing. Plain English, free, every week.

The drawings · 9 sheets

9 drawing sheets from US 2026/0245723 A1 · click any drawing to enlarge

Network system architecture diagram, drawing sheet 1 from US 2026/0245723 A1
Sheet 1 Network system architecture diagram
Smartphone photographing smartwatch screen, drawing sheet 2 from US 2026/0245723 A1
Sheet 2 Smartphone photographing smartwatch screen
Data processing flow diagram, drawing sheet 3 from US 2026/0245723 A1
Sheet 3 Data processing flow diagram
Heart rate monitor display screen, drawing sheet 4 from US 2026/0245723 A1
Sheet 4 Heart rate monitor display screen
Blood pressure and ECG screen, drawing sheet 5 from US 2026/0245723 A1
Sheet 5 Blood pressure and ECG screen
Extracted electrocardiogram waveform curves, drawing sheet 6 from US 2026/0245723 A1
Sheet 6 Extracted electrocardiogram waveform curves
Display screen configuration confirmation prompt, drawing sheet 7 from US 2026/0245723 A1
Sheet 7 Display screen configuration confirmation prompt
Screen layout adjustment interface, drawing sheet 8 from US 2026/0245723 A1
Sheet 8 Screen layout adjustment interface
Show sheet 9
Google Patents a Way to Pull Health Data Out of a Photo of Your Screen patent drawing, sheet 9
Sheet 9
Patent filing page

Watchlists this filing belongs to

All watchlists →