
Summary: Google has rolled out multimodal capabilities to the AI Mode with Lens visual search. This feature now enables you to capture or upload an image, ask questions about it, and receive detailed, context-rich answers, along with useful links for further exploration. Also, the AI Mode is now available to millions of free Google Labs users in the US.
Last month, Google released an experimental AI Mode feature for Google One AI Premium subscribers. Now, the search titan has released the feature to “millions more Labs users in the US.” Furthermore, Google is adding multimodal capabilities to the AI Mode with Lens visual search. The upgrade enables you to capture or upload an image and ask questions to receive detailed, context-rich answers in Google Search.
Google Lens powers the new multimodal search functionalities in Google’s AI Mode
According to the company, Google Lens and a custom version of Gemini power the multimodal search functionalities in Google’s AI Mode. It can now understand the entire scene in a photo, including the context of how things relate to one another and their unique materials, colors, shapes, and arrangements. Furthermore, Lens precisely identifies every object in the image, thanks to Google’s deep visual search expertise.
The new functionalities go beyond basic visual search. The AI Mode now not only analyzes an image but also the overall context. It essentially covers understanding the relationship between objects, textures, colors, shapes, and layout. Using Google Lens, the AI Mode feature identifies specific items in the photo, and with a technique known as “query fan-out,” it conducts multiple searches to gather deeper insights.
Google’s AI Mode can accurately recognize objects in photos
In an example shared by Google, the AI Mode interpreted the details within a photo, accurately recognizing all the books on a shelf. It then generated relevant queries to gather details about the titles of these books, apart from finding similar, high-rated suggestions.
The feature’s response included a list of recommended books, and even links to buy them along with additional details. Furthermore, the functionality allows you to ask follow-up queries to narrow down your search, like “I’m looking for a quick read. Which one of these recommendations is the shortest?”
Google’s AI Mode for Search is an answer to Perplexity and ChatGPT Search. These offer a chatbot-like experience that responds to questions with AI-generated summaries pulled from Google’s search index. Google has plans to continue to refine the search experience and expand features of the AI Mode in the coming months.
📰 Crime Today News is proudly sponsored by DRYFRUIT & CO – A Brand by eFabby Global LLC
Design & Developed by Yes Mom Hosting