Get the newsletter
Apple · Software · Filed Mar 30, 2026 · USPTO published Nov 19, 2026 · This week's release

Apple Files Patent for Letting You Choose Which Service Identifies What Your Camera Sees

When your iPhone tells you what's in a photo, you rarely get to choose who does the telling. A new Apple patent application puts a button for that choice right on the screen.

A phone camera identifies a restaurant in real time and offers buttons to switch between different search providers for details. Drawing from patent filing US 2026/0367781 A1.
A phone camera identifies a restaurant in real time and offers buttons to switch between different search providers for details.All 26 drawings ↓
Publication number
US 2026/0367781 A1(US20260367781A1)
Applicant
Apple Inc.
Filed · Published
Mar 30, 2026 · Nov 19, 2026
Inventors
Adrian ZUMBRUNNEN, Johnnie B. MANZARI
Status when we published
Waiting for an examiner
Document
24 claims
US classification
715/764
Parent application
Claims priority from a provisional application 63806572 (filed May 15, 2025)

What Apple's visual lookup screen would show you

Every time you point your phone at something and ask it to tell you more, some service does the figuring-out behind the scenes, and you usually have no say in which one. Apple's filing puts that choice on the screen.

When you tap something in a photo or camera view, the phone opens a panel showing information about the lookup being run, plus a button for changing the service that does it. You can ask a question about the item, run a search, or pick an action, and swiping across the panel replaces placeholder boxes with the results.

The filing also covers a nudge for first-time use. The phone prompts you to use a gesture to mark the part of the picture you care about. If you do nothing for a set stretch of time, it highlights the things it spotted on its own, so you aren't left staring at a blank image.

From the filing · CLAIM 1
detecting, via the one or more input devices, an input requesting additional information associated with a feature of interest within respective visual content …

Translation: The system notices when you ask to learn more about something your camera sees.

How the screen hands your photo to a provider

The filing describes a visual analysis user interface (a panel that opens when you ask for more about something in a photo, screenshot or live camera view). The panel shows information about the lookup being run and, at the same time, a button for changing which service provider does the work. Every independent claim rests on that pairing.

Dependent claims add pieces to the panel:

  • A question box that gets answers about the item from the currently chosen provider.
  • A search button that pulls up results.
  • Action buttons that can hand the item to different apps.
  • A provider list that changes with the type of item, including a recommended pick.

Results can wait behind placeholder boxes until you swipe across the panel. If your past habits suggest you'd want a lookup, it can start automatically. If you switch providers after seeing results, the phone reruns the lookup with the new one. In a camera view, detected items can animate out of the shutter button, which still takes a photo when tapped.

Before any of that, the filing describes a prompt asking you to use a gesture to mark the part of the image you care about. If you do nothing for a set time, the phone highlights items it spotted itself.

Why a swappable lookup service matters on iPhone

For you, the payoff is control over a feature that usually makes that choice for you. When you point your phone at something and ask what it is, you could see which service is answering and switch to another if the first answer disappoints you, without leaving the screen. The provider list can even change with the type of item the phone detects, so different items could get different recommended services.

For Apple, the design keeps the screen simple while leaving room for several services behind it. The filing's own stated goals are fewer taps, less clutter over the picture you're analyzing, and less battery drain from lookups you didn't mean to run.

That makes this Apple's 727th filing we've tracked in our Apple coverage since May, adding to work like the search bar that runs tasks and widgets on a car screen.

Source: US 2026/0367781 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Apple patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 26 sheets

26 drawing sheets from US 2026/0367781 A1 · click any drawing to enlarge

Hardware parts and software built into a smartphone, drawing sheet 1 from US 2026/0367781 A1
Sheet 1 Hardware parts and software built into a smartphone
How the phone organizes touch events for apps, drawing sheet 2 from US 2026/0367781 A1
Sheet 2 How the phone organizes touch events for apps
External controls and sensors on a touch phone, drawing sheet 3 from US 2026/0367781 A1
Sheet 3 External controls and sensors on a touch phone
Internal parts of a computer running applications, drawing sheet 4 from US 2026/0367781 A1
Sheet 4 Internal parts of a computer running applications
Basic steps for sharing data between programs, drawing sheet 5 from US 2026/0367781 A1
Sheet 5 Basic steps for sharing data between programs
Software layers that let an app request tasks, drawing sheet 6 from US 2026/0367781 A1
Sheet 6 Software layers that let an app request tasks
Exchanging requests and answers between software tools, drawing sheet 7 from US 2026/0367781 A1
Sheet 7 Exchanging requests and answers between software tools
A smartphone home screen showing app icons, drawing sheet 8 from US 2026/0367781 A1
Sheet 8 A smartphone home screen showing app icons
Show the other 18 sheets
Moving fingers on a touchpad to control a separate screen, drawing sheet 9 from US 2026/0367781 A1
Sheet 9 Moving fingers on a touchpad to control a separate screen
Outer case and screen of a smartwatch, drawing sheet 10 from US 2026/0367781 A1
Sheet 10 Outer case and screen of a smartwatch
Hardware parts that run the wearable watch, drawing sheet 11 from US 2026/0367781 A1
Sheet 11 Hardware parts that run the wearable watch
Camera viewfinder showing search and question buttons, drawing sheet 12 from US 2026/0367781 A1
Sheet 12 Camera viewfinder showing search and question buttons
Pointing the camera at a storefront down the street, drawing sheet 13 from US 2026/0367781 A1
Sheet 13 Pointing the camera at a storefront down the street
A detected business badge popping out above the shutter button, drawing sheet 14 from US 2026/0367781 A1
Sheet 14 A detected business badge popping out above the shutter button
Circling a building on the screen to look it up, drawing sheet 15 from US 2026/0367781 A1
Sheet 15 Circling a building on the screen to look it up
Search results comparing details from different providers, drawing sheet 16 from US 2026/0367781 A1
Sheet 16 Search results comparing details from different providers
Circling an item on your screen to start a search, drawing sheet 17 from US 2026/0367781 A1
Sheet 17 Circling an item on your screen to start a search
Choosing which app or search engine analyzes your selection, drawing sheet 18 from US 2026/0367781 A1
Sheet 18 Choosing which app or search engine analyzes your selection
Getting identification details and care tips from a chosen app, drawing sheet 19 from US 2026/0367781 A1
Sheet 19 Getting identification details and care tips from a chosen app
Chatting with an AI about an object you circled, drawing sheet 20 from US 2026/0367781 A1
Sheet 20 Chatting with an AI about an object you circled
Switching tools to create reminders from detected objects, drawing sheet 21 from US 2026/0367781 A1
Sheet 21 Switching tools to create reminders from detected objects
Adding recognized ingredients directly into grocery lists or recipes, drawing sheet 22 from US 2026/0367781 A1
Sheet 22 Adding recognized ingredients directly into grocery lists or recipes
Picking a different AI assistant to answer visual questions, drawing sheet 23 from US 2026/0367781 A1
Sheet 23 Picking a different AI assistant to answer visual questions
Sending recognized items straight to a contact by voice, drawing sheet 24 from US 2026/0367781 A1
Sheet 24 Sending recognized items straight to a contact by voice
Prompting you to circle an object if you hesitate, drawing sheet 25 from US 2026/0367781 A1
Sheet 25 Prompting you to circle an object if you hesitate
Switching which service analyzes what the camera sees, drawing sheet 26 from US 2026/0367781 A1
Sheet 26 Switching which service analyzes what the camera sees
Patent filing page

Reader comments

No comments yet

Start the discussion

Real name or a handle, either is fine. Comments are read by a person before they appear, so allow a little time. Keep it about the filing.