Google launches Gemini Decisions API for fast multimodal choices
The new API allows developers to get scores and probabilities for multiple questions in a single pass, significantly reducing latency and costs.
The short version
- The API provides results in 150-250ms end-to-end latency for multimodal inputs.
- Users are billed $0.10 per 1M input tokens with zero costs for output tokens.
- It supports up to 1,000 independent questions per request against a single multimodal input.
- The model handles text, images, audio, video, and PDFs in a single forward pass.
Why it matters
This tool allows developers to build faster, more reliable AI systems that need to make specific choices rather than just generating long-form text. By providing confidence scores, it helps systems automatically route ambiguous cases to humans or fallback processes.
A new tool for bounded choices
Google has released the Gemini Decisions API, a specialized endpoint designed for making fast, closed-set decisions. Unlike standard generative models that create text word by word, this API is built for specific tasks like choosing a tool, checking a policy, or routing a request to a different model. It uses a new model called gemini-decision-1 to provide these results efficiently.
The API is designed to handle multimodal inputs, which means it can process different types of data simultaneously. A single request can include text, images, audio, video, or PDFs up to 256K tokens in size. This allows developers to combine different types of information, such as pairing a scanned PDF claim with photos of damage, to reach a conclusion.
One of the primary goals of this release is to provide purpose-built primitives for bounded choices. These are situations where the AI must pick from a set of pre-defined options rather than creating an open-ended response. By focusing on these specific types of queries, the system achieves much higher speed and better calibration than general-purpose models.
How the scoring system works
The Gemini Decisions API operates by scoring candidate options in a single forward pass. This means the model looks at the input and all questions at once to provide probabilities and confidence scores. Because it does not use token-by-token decoding, the median model compute time is kept between 50-100 ms, resulting in a total end-to-end latency of 150-250 ms.
Developers can ask up to 1,000 independent questions in a single request. The API supports three specific types of evaluations to handle different needs. These include 'noul' for yes/no questions, 'choice' for multiple-choice selections between 2 and 255 options, and 'score' for grading inputs against an ordered rubric.
Every answer provided by the model includes a confidence score ranging from 0 to 1. This allows developers to build systems that know when they are unsure. If a confidence score is too low, the code can automatically route that specific case to a human reviewer or a different fallback process to ensure accuracy.
Cost and performance benefits
The pricing structure for the Gemini Decisions API is designed to be highly economical for high-volume tasks. It costs $0.10 per 1M input tokens, and notably, there are zero costs for output tokens. This makes it nearly 5x cheaper than using the Gemini 3.5 Flash-Lite model with the Interactions API for the same benchmark suite.
The API also simplifies billing for complex multimodal requests. The shared input is billed only once per request, regardless of how many questions are being evaluated. Each question only adds the cost of its own instructions and criteria tokens. This structure removes extra costs for things like audio transcription or OCR, which are often separate charges in other systems.
In terms of performance, Gemini Decision 1 leads across several benchmarks including agent routing and reasoning. It maintains a nearly flat latency even when the number of questions per request increases from 1 to 100. This consistency makes it a reliable choice for applications that require rapid, high-frequency decision-making without unpredictable spikes in processing time.
Real-world applications at Google
Several teams within Google are already using the Decisions API as a low-latency control plane. For example, Gemini Notebook uses it as a real-time router to direct queries to the best model tier. This helps serve everyday queries with up to 40% lower latency while saving complex reasoning models for more difficult tasks.
Other internal projects demonstrate the API's versatility in design and safety. The Stitch project uses it to generate playable wireframes of product flows in seconds and to apply voice or tap edits almost instantly. Meanwhile, Google Search uses the API to detect adversarial behavior and content against specific evaluations within a very tight latency window.
Smaller interactions also benefit from this speed. A project called CC from Google Labs uses the API to pick the correct emoji reaction from a palette of over 200 options. Because the API returns the winner and normalized probabilities in a fraction of a second, the reactions appear instantly to the user without adding any noticeable delay to the interface.
Availability and integration
The Gemini Decisions API is now available through the Gemini API in Google AI Studio. Developers can start prototyping immediately using a no-cost tier. Google has provided several demo apps, including Doorstep Parcels, Speed Sketch, and Find the Zoo Keeper, to help users see the model in action.
The company is also rolling out ecosystem integrations to make the tool accessible to a wide range of developers. Support is being added to popular frameworks like LangChain, Vercel, LiteLLM, and Pydantic AI. These integrations allow teams to plug the Decisions API into their existing workflows more easily than building from scratch.
For those ready to build, Google provides documentation and guides for Python, JavaScript, and REST. The API also supports the same Content block format as the Interactions API, making it easier for teams to transition existing multimodal projects. Support for Gemini in Google Cloud is also expected to arrive soon for enterprise users.
What to watch
- How the 40% latency reduction in Gemini Notebook impacts user experience for complex queries.
- The rollout of the API to Google Cloud for enterprise-scale deployments.
Try it
Check out the Doorstep Parcels, Speed Sketch, or Find the Zoo Keeper demo apps in Google AI Studio to see the API in action.
Sources and links
- Officialdocs.litellm.ai/docs/providers/gemini docs.litellm.ai
- OfficialPydantic AI pydantic.dev
- Officialdocs.langchain.com/oss/python/integrations/providers/google docs.langchain.com
- Reportingblog.google: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by blog.google · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
