Sony Patent Aims Remote Cameras at Whatever Direction Your Gaze Falls
Sony has filed a patent for a system that lets you control a remote camera just by turning your head, then shows what that camera sees on a screen wider than your normal field of view.
What Sony's gaze-driven remote viewing system actually does
Today, when someone monitors a remote location from afar, they usually click buttons or use a joystick to pan a camera around. Sony wants to remove that step entirely by watching where your head is pointing and using that information to guide things at the far end.
Here's how it plays out for you: you stand or sit in front of a large display showing a live wide-angle feed from, say, a construction site or a factory floor. As you turn your head toward the left side of the screen, the system registers that shift and sends a signal to a device at the site, pointing it in that same direction. No clicking, no joystick, no delay from figuring out which button does what.
The display itself is wider than what a person can naturally see at once, so you get more context than a regular monitor would give you. The direction indicator at the remote site, controlled by your gaze, could guide a robot, highlight a spot for a colleague, or steer additional cameras.
a display device that displays an image at a wider angle than a visual field range of a person; a head position/direction detection device that detects a position and a direction of a head of a viewer of the display device …
Translation: The system uses a wide screen and tracks where your head is pointing.
How head tracking translates into on-site direction signals
The patent describes two linked systems: a remote visual recognition system on the viewer's end, and a site imaging system at the location being observed.
On the viewer's side:
- A display wider than normal human vision (roughly beyond your natural ~200-degree visual field) shows a live image from the remote site.
- A head position and direction detection device continuously tracks where the viewer's head is pointing, not just where their eyes go, but the full orientation of their head in space.
- A control unit converts that head-orientation data into gaze direction information and transmits it to the remote site in real time.
At the remote site:
- A wide-angle camera captures footage that is sent back to the viewer's display.
- A direction indication device receives the gaze data and physically orients itself to match where the viewer is looking.
- That indicator could point a spotlight, a laser pointer, a secondary camera, or an actuator at whatever part of the scene the viewer is focused on.
The core technical insight is that head orientation (position plus angle in 3D space) can be mapped to a corresponding direction at the remote site, letting the viewer's natural looking behavior substitute for manual controls.
… controlling an indication direction by the direction indication device on the basis of received gaze direction information.
Translation: It moves the remote camera to match where you are looking.
What this could mean for remote inspections and monitoring
For anyone doing remote inspection work, whether that's checking a construction site, supervising a hospital ward, or overseeing a hazardous environment, the friction of manually steering a camera adds up fast. A system that simply watches where you look and redirects resources accordingly could make remote oversight feel much closer to being physically present.
Sony's run of remote-presence and imaging filings suggests this sits inside a broader push toward professional remote monitoring tools. The practical payoff for users is reduced cognitive load: instead of splitting attention between the scene on screen and the controls in your hand, you just look at what interests you and the system follows.
This is the 18th Sony filing we've tracked since July in the AR glasses race, building on sunglasses projecting floating images and keeping holograms sharp at any depth.
For someone doing a remote inspection, constantly operating a camera while trying to absorb what you are seeing means you will miss things. This system removes that step by moving the camera to match where you turn your head.
The oversized screen is what makes that work. If the display only showed a normal-sized view, there would be nothing useful to turn toward. The wide screen gives you edges worth looking at, so your natural head movements become actual commands.
The real question is whether the system can tell the difference between an intentional look and a casual glance. Head position and eye direction are not the same thing, and a system that treats every small tilt as a command will frustrate people quickly. That threshold is the whole ballgame, and it is not addressed here.
Get our take in your Top Stories
Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Sony patent news breaks.
There are more where this came from
We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.
The drawings
28 drawing sheets from US 2026/0261646 A1 · click any drawing to enlarge
Show the other 20 sheets
Want this weekly breakdown for a company we don't cover? Patentlyze Pro →
Be the first to weigh in