Google expands Gemini to perform tasks like booking appointments and shopping
Google is rolling out a new model that allows Gemini to interact with apps, make purchases, and handle real-world logistics like scheduling car service.
The short version
- Gemini can now make phone calls to book appointments and handle hold music automatically.
- New Agent Payments Protocol (AP2) allows Gemini to make purchases with digital tokens and spending caps.
- The update includes a new hardware-isolated virtual machine to keep user data secure during tasks.
- Users can now forward emails to a dedicated Gemini address to automatically sync dates to their calendars.
Why it matters
This shifts AI from a tool you talk to into an agent that acts on your behalf. It allows users to automate repetitive logistics like scheduling and bill analysis without manual data entry.
From chat to active tasks
Google is expanding the capabilities of Gemini to move beyond simple conversation and into active task execution. The company is rolling out these updates for hundreds of millions of people across the U.S., Japan, Korea, Canada, Australia, and India. The goal is to help users manage daily responsibilities like school drop-offs and meetings by saving time and money.
The update introduces the Gemini 4 Hydrogen model, which powers these new features. Users can now hand off specific tasks to the AI, which then works in the background to complete them. This transition is designed to help people who have tasks piling up throughout their busy days.
To access these features, users can flip a toggle on their home screen from Chat to Task. This change allows the AI to interact with the Google ecosystem, including emails, calendars, photos, and payment cards. Because this data already lives in Google's secure environment, the company argues it is a more secure choice for personal assistance.
Handling logistics and bills
One of the primary ways Gemini handles tasks is by making phone calls to businesses. For example, the AI can call dealerships to find service appointments, sit through hold music, and book a time that fits a user's calendar. When calling, Gemini identifies itself as an AI and will not share private account information unless the user gives explicit permission.
The assistant can also perform deep analysis on personal finances and utilities. By accessing a utility portal through Google Password Manager, Gemini can analyze past billing statements to identify high costs. In one instance, the AI identified that a heat pump was running during peak pricing hours, a detail that might be missed by a human looking at PDFs.
For shopping, Gemini uses the Google Shopping Graph to compare products and ask follow-up questions about specific needs like wattage or color. It can even find discount codes and complete the checkout process. The system is designed to stay within a hard spending cap that the user sets upfront to ensure the AI does not overspend.
Payments and app integrations
To facilitate commerce, Google is using the Agent Payments Protocol (AP2). This allows Gemini to make purchases using digital tokens for supported cards from Visa, Mastercard, and American Express. Even when the AI handles the transaction, users still earn their usual card perks, such as cashback or airline miles.
The update also includes a new RCS integration, allowing users to text Gemini directly to add items to grocery orders. For example, a user can snap a photo of an empty food box and text it to the AI, which then adds the item to an Instacart order. The AI then hands the user off to the app to complete the final purchase.
Gemini now connects with more than 60 popular apps. Developers can also apply to join the Connected Apps Platform to expand these capabilities. Additionally, users can forward school emails to a specific address to have the AI automatically extract dates and invite family members to calendar events.
Security and sandboxing
Because Gemini is performing actions on behalf of users, Google is using a hardware-isolated virtual machine called Agent Compute Engine. Each task runs in a dedicated sandbox that is never shared with other users. This environment is regularly tested by security red teams to ensure that the AI remains isolated from other data.
The system includes multiple layers of defense, such as prompt-injection filters that scan webpages and search results. It also uses Google Safe Browsing to limit the types of links the AI can open. These measures are designed to protect the sensitive information the AI accesses while performing tasks.
Users maintain control over the AI's autonomy through various settings. Gemini is designed to pause and ask for confirmation before performing critical steps, such as clicking a 'Buy' button. However, for routine tasks that a user trusts, they can set an 'Always allow' preference to prevent the AI from asking for permission every time.
The path toward UCP
Google is currently working with major websites and security providers to help the web adapt to personal assistants. While many bots are blocked by default, the company believes that open, verifiable standards will help assistants navigate sites more reliably. They are partnering with site owners to ensure that these interactions are seamless for both the user and the business.
Looking ahead, Google plans to integrate the Universal Commerce Protocol (UCP) into Gemini. This is intended to create a faster and more reliable shopping experience that spans from the initial discovery of a product to the final checkout. This protocol aims to standardize how AI agents interact with online stores.
While the system is still evolving, Google is asking for user feedback to improve the experience. Users can provide a 'thumbs down' on responses that miss the mark or fail to complete a task. This feedback helps the team refine how the assistant navigates the web and handles complex instructions.
What to watch
- The upcoming launch of American Express support for Agent Payments Protocol.
- How many websites will successfully adopt the Universal Commerce Protocol.
- The expansion of Google Wallet to iOS for receipt tracking.
Try it
Open the Gemini app, flip the toggle to 'Task,' and ask it to find a time for a specific appointment and add it to your calendar.
Sources and links
- Reportingblog.google: the article we sourced
First reported by blog.google. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.