Samsung Patents Phone Camera Tech That Turns Hand Gestures Into Smart Glasses Controls

By Patentlyze Team · Updated Jun 12, 2026

Samsung's latest patent describes smart glasses that don't need their own gesture-tracking cameras — they borrow the one already in your phone to read your hand movements instead.

How Samsung's glasses would borrow your phone's camera

Imagine wearing a pair of Samsung smart glasses that show you a 3D display — but instead of having expensive cameras built into the frames to track your hands, the glasses quietly outsource that job to the phone already in your pocket.

Here's how it would work for you: your glasses beam a copy of what they're displaying to your phone. Your phone's camera watches your hands and sends images back to the glasses. The glasses figure out what gesture you made — a point, a swipe, a tap in mid-air — and respond accordingly, all without you ever touching a screen.

The payoff is practical: fewer sensors crammed into the glasses frame means lighter hardware, longer battery life, and potentially a lower price. Your phone does the heavy lifting it was already built to do.

How the mirroring-and-camera feedback loop works

The patent describes a two-device pipeline that turns an existing smartphone camera into the input sensor for a wearable display (think AR or XR glasses).

Here's the data flow step by step:

• Screen mirroring outbound: The glasses continuously send mirroring data — a representation of whatever 3D scene is shown on the display — to the paired phone over a wireless link.
• Camera frames inbound: The phone's camera captures images of the user's hands (or another external object) and packages them into a message sent back to the glasses.
• Gesture recognition on-glasses: The glasses processor analyzes movement across those incoming camera frames to identify the user's intent — a gesture, a hand position, or object motion.
• Visual response: The identified input triggers a visual object on the glasses display, confirming the interaction the way a cursor click would on a laptop screen.

The claim specifically mentions that the mirrored screen represents at least a portion of a three-dimensional space, which anchors this to XR (extended reality) use cases rather than a flat 2D screen share. The phone never needs a dedicated app for gesture tracking — the glasses initiate the whole loop.

What this means for affordable XR glasses design

Building gesture-tracking cameras directly into glasses frames is one of the harder engineering problems in XR hardware — it adds weight, cost, power draw, and thermal load to a device people have to wear on their face all day. Samsung's approach offloads that sensing task to the phone you already carry, which has a much larger battery and camera system than any glasses frame realistically can.

For you as a consumer, this could mean lighter, cheaper glasses that still support natural hand-gesture control — no wrist band, no handheld controller required. It also means Samsung could iterate on gesture accuracy by pushing software updates to the phone rather than redesigning the glasses hardware. Whether this ends up in a Galaxy Ring companion experience, the rumored Galaxy Glasses, or something else entirely, it's a clear signal that Samsung is thinking seriously about how its device ecosystem works together.

Editorial commentary on a publicly published patent application. Not legal advice.