The Lens app on mobile devices already allows image search, but you will need an extra step of saving a photo or screenshot before you can perform an on-screen search. Google is updating the Lens in the coming months, so it could add a new ability of on-screen image search with the help of Google Assistant.

How on-screen image search is done via Assistant

As shown by Google in its clip, a user can search for an image or video being displayed on the screen by summoning Assistant and tapping ‘Search screen’ from the pop-up menu. While the demo was in the Messages app, Google says that the on-screen image search will be supported on other apps and web pages.

For most non-Pixel Android phones and on Apple’s iPhones, activating Assistant requires pressing the home button. Alternatively, you can trigger Assistant by opening the Google keyboard and tapping the microphone icon. In addition, you will need to install both Lens and Assistant to use the upcoming image search feature.

Google Lens on-screen image search via Assistant
Enable on-screen image search in apps and pages via Assistant / © Google; Edit by NextPit Image source: Google; Edit by NextPit

Since Google is still rolling out the search via Assistant, users can opt to capture a photo or screenshot and go through Lens or Google Photos to do an image search. But on desktops, Chrome already has an image search function where you can directly right-click through a photo to choose Search image with Google.

Google releases out multi-search for Lens and Search

At the same time, Google announced that multi-search on Lens and Search is now available globally. Similar to an image search action, you can refine the result by adding variations such as color to a car or nearby places where to buy the item searched.

Do you use Lens or image search in your device too? Which new features are you looking forward to trying out?

We mark partner links with this symbol. If you click on one of these links or buttons–or make a purchase through them–we may receive a small commission from the retailer. This doesn’t affect the price you pay, but it helps us keep nextpit free for everyone. Thanks for your support! Prices are based on the date of publication of this article and may be subject to change.