Get the newsletter
Apple · Software · Filed Feb 3, 2026 · USPTO published Aug 13, 2026 · Aug 13 release

Apple Patents a Visual Search That Hides Buttons When There's Nothing to Find

Apple's new patent tackles a quiet frustration with visual search: tapping a highlight on a photo only to get a dead end. The fix is to only show the button if there's actually something behind it.

A smartphone camera view displaying a visual search indicator overlaid on a detected flower in a garden scene. Drawing from patent filing US 2026/0237205 A1.
A smartphone camera view displaying a visual search indicator overlaid on a detected flower in a garden scene.All 10 drawings ↓
Publication number
US 2026/0237205 A1(US20260237205A1)
Applicant
Apple Inc.
Filed · Published
Feb 3, 2026 · Aug 13, 2026
Inventors
Lukas A. BOSSARD, Matthias DANTONE, Pulah J. SHAH, Wentao WU, Yang ZHAO
Status when we published
Waiting for an examiner
Document
20 claims
US classification
348/222.1
Parent application
Continuation of 18/618,931 (filed Mar 27, 2024)(18618931)

What Apple's selective visual search actually does

Ever pointed your phone camera at something and wondered what it is, only to tap a button and get nothing useful back? That gap between "something is here" and "here's what it is" is exactly what this Apple patent is trying to close.

The idea is that when you're looking at a photo, your phone scans everything in the frame and checks whether real, usable information exists for each object. If it finds data, it shows you a small tap indicator on that object. If it finds nothing, the indicator stays hidden. You never see a dead-end button because the phone already knows it has nothing to offer you.

This is a refinement of how features like Visual Look Up already work on iPhones. Instead of highlighting objects and hoping the lookup works, the system front-loads the "do I have an answer" check so that every button you see is a button worth pressing.

From the filing · CLAIM 1
… displaying a visual indicator for at least one element determined to have obtainable information; and foregoing display of a visual indicator for at least one other element determined not to have obtainable information.

Translation: The system shows search buttons only for items it recognizes and hides them for everything else.

How the system decides which objects get a tap indicator

The patent describes a visual search system that processes an image displayed to a user and identifies all the distinct objects, or "elements," within it.

For each element, the system runs a check: is information about this thing actually retrievable? This is the key departure from a simpler approach where you highlight everything and let the lookup fail at tap-time. Here, the eligibility check happens before any indicator is shown.

  • Image analysis: The device scans the image and catalogs multiple elements, for example a plant, a pair of shoes, a restaurant sign.
  • Information availability check: For each element, the system queries whether associated data (product details, species names, location info) can actually be returned.
  • Selective display: Visual indicators appear only on elements with confirmed, retrievable information. Elements without it get no indicator at all.

The patent doesn't specify the underlying lookup mechanism in detail, leaving room for the system to work with product databases, web indexes, or on-device models. The core claim is the conditional display logic itself: show the affordance only when there's a payoff.

From the filing · THE ABSTRACT
The subject technology provides visual search systems and methods for selectively presenting visual indicators associated with elements in digital content. An image provided for display to a user may be analyzed to identify a plurality of elements.

Translation: This technology scans photos to find specific objects and decides which ones are worth highlighting for the user.

What this means for iPhone camera search features

For everyday iPhone users, this would mean a cleaner, less frustrating visual search experience. Right now, if your camera highlights an object and you tap it, a failed lookup feels like a broken feature. Hiding the indicator when there's nothing to show turns an error state into a non-event, which makes the feature feel more reliable even if the underlying database hasn't changed.

From an engineering standpoint, this is a purely software-level change to how results are surfaced, meaning it doesn't require new camera hardware or a dedicated chip. The shortest route to shipping it runs through an iOS update to Visual Look Up. Apple has been steadily expanding that feature since iOS 15, and this patent fits neatly into that trajectory. For ongoing coverage of Apple's visual-AI and search filings alongside the rest of the industry, Big Tech patent news tracks how these incremental software bets stack up across companies.

Source: US 2026/0237205 A1 at the USPTO (PDF). Full patent text and figures are in the official publication.

Get our take in your Top Stories

Liked this breakdown? Add Patentlyze as a preferred source on Google, and our plain-English take shows up more often in your Top Stories the next time Apple patent news breaks.

There are more where this came from

We read every patent application Big Tech publishes and send you the ones worth knowing. Plain English, free, every week.

The drawings · 10 sheets

10 drawing sheets from US 2026/0237205 A1 · click any drawing to enlarge

Smartphone connected to a remote server, drawing sheet 1 from US 2026/0237205 A1
Sheet 1 Smartphone connected to a remote server
Internal components of a computer system, drawing sheet 2 from US 2026/0237205 A1
Sheet 2 Internal components of a computer system
Visual search system architecture, drawing sheet 3 from US 2026/0237205 A1
Sheet 3 Visual search system architecture
Image region and domain prediction pipeline, drawing sheet 4 from US 2026/0237205 A1
Sheet 4 Image region and domain prediction pipeline
Landscape image with multiple search indicators, drawing sheet 5 from US 2026/0237205 A1
Sheet 5 Landscape image with multiple search indicators
Visual search results for a painting, drawing sheet 6 from US 2026/0237205 A1
Sheet 6 Visual search results for a painting
Visual search results identifying a dog breed, drawing sheet 7 from US 2026/0237205 A1
Sheet 7 Visual search results identifying a dog breed
Smartphone camera identifying a flower in real time, drawing sheet 8 from US 2026/0237205 A1
Sheet 8 Smartphone camera identifying a flower in real time
Show the other 2 sheets
Apple Patents a Visual Search That Hides Buttons When There’s Nothing to Find patent drawing, sheet 9
Sheet 9
Apple Patents a Visual Search That Hides Buttons When There’s Nothing to Find patent drawing, sheet 10
Sheet 10
Patent filing page