Google Enhances AI Mode with Gemini’s Multimodal Capabilities for Improved Visual Search

by Team Confer · April 8, 2025

Google has enhanced its AI Mode in Search by integrating Gemini’s multimodal capabilities, significantly improving visual search functionalities. This advancement allows users to capture photos or videos and pose complex questions about the visual content, receiving comprehensive AI-generated responses. For instance, by photographing a bookshelf, AI Mode can identify book titles, discern themes, and suggest similar high-rated books. This feature is currently accessible to Google One AI Premium subscribers in the U.S. via the Google app on both Android and iOS platforms. One would expect it to roll out to Australian users in a short time.

Context & Background

Google’s integration of Gemini’s multimodal capabilities into AI Mode represents a significant advancement in search technology. Multimodal AI can process and interpret various data types, such as text, images, and videos, enabling more intuitive and comprehensive user interactions. This development aligns with Google’s broader strategy to enhance its search engine’s AI functionalities, as evidenced by the introduction of AI Overviews and the experimental AI Mode. These initiatives aim to provide users with more detailed and contextually relevant information, positioning Google competitively against other AI-driven search platforms.

In This Story

Google

Google is a multinational technology company specializing in internet-related services and products, including online advertising technologies, search engine, cloud computing, software, and hardware.

Gemini

Gemini is Google’s advanced AI model designed to handle multimodal inputs, enabling it to process and interpret various data types such as text, images, and videos.

Google One AI Premium

Google One AI Premium is a subscription service offering users enhanced AI features and additional cloud storage, providing access to advanced functionalities like the AI Mode in Google Search.

You may also like