AI PM Ready
Back to the Digest

Gemini API Adds Tool Retrieval to Enhance Agent Capabilities

Google AI BlogAI & Agentic AI3 min readImportantOriginal source ↗

The Gemini API now offers Tool Retrieval in preview, allowing agents to access hundreds of tools while using fewer tokens. This feature significantly enhances agent capabilities by providing efficient access to external functionalities, which can streamline complex workflows and reduce operational costs associated with token usage. PMs building agentic AI products should explore integrating this feature to improve agent efficiency and expand their actionable repertoires. This week, evaluate your agent's current toolset and identify potential integrations that Tool Retrieval could optimize.

What happened

Google's Gemini API is introducing "Tool Retrieval" in preview, enabling AI agents to access a wide array of tools more efficiently by using fewer tokens. This enhancement aims to boost the capabilities of AI agents and optimize their operational costs.

A scenario you might face

You are the PM for an AI-powered customer support chatbot that needs to access various tools like a CRM lookup, a knowledge base search, and a ticketing system. Currently, each tool interaction consumes a significant number of tokens. With the new Gemini API Tool Retrieval, you can potentially make these interactions much more efficient. How do you prioritize which tools to integrate first, and how do you measure the success of this feature beyond just token savings (e.g., faster response times, higher resolution rates)?

What changes in your practice

During your next roadmap planning session, explicitly consider how Gemini's Tool Retrieval could enhance your agent's functionality, prioritizing its integration for a high-impact workflow. Before your next feature kickoff for an agent-based product, ensure the PRD includes a section on tool integration strategy and cost-efficiency.

Questions for your team

  1. 01What are the criteria for selecting which tools are most suitable for inclusion in a tool retrieval system?
  2. 02How can we effectively measure and communicate the cost savings and performance improvements gained from Tool Retrieval?
  3. 03What are the security implications of allowing agents to dynamically retrieve and use a large number of tools?
  4. 04How does Tool Retrieval impact the agent's ability to chain complex actions or discover new tool combinations?

Practise this

Interviewers ask about stories like this one. Rehearse your answer in a timed mock interview.

Start a mock interview →
All stories
Was this page useful?