Gemini expands hands-free phone control and lock-screen access

Expanding device assistance

Google is making it easier for users to interact with their phones without manually navigating through menus or typing on a keyboard. The assistant now features a Device Assistance mode, which was previously known as Utilities, to handle everyday phone tasks. This allows for a more seamless experience when users are busy with other activities like driving or doing chores.

By enabling this feature in the settings, users can give voice commands to manage various parts of their mobile device. Examples of these actions include turning on the flashlight, adjusting the screen brightness, or changing the volume levels. It can also handle specific hardware requests like activating Bluetooth before connecting earbuds.

As androidpolice.com reported, these updates are designed to reduce the need for manual input during quick interactions. Users can also use voice commands to open specific apps or navigate to certain settings menus. This shift toward voice-first interaction aims to make the phone more accessible during multi-tasking scenarios.

Lock-screen functionality

A significant update allows Gemini to perform several tasks while the phone remains locked. This means users do not have to physically unlock their devices to ask general questions or manage basic timers. It provides a way to interact with the phone's core features while maintaining a level of security.

Specific actions available from the lock screen include setting or canceling alarms, pausing music, and controlling smart home devices. Users can also request directions through Google Maps without needing to enter a passcode first. These features are intended for quick, low-stakes tasks that do not require deep access to the phone's data.

To protect sensitive information, the assistant will still prompt the user to unlock the device for personal requests. For example, if a user asks for details from their calendar, the phone will require authentication. This ensures that someone else cannot use voice commands to access private information if the phone is sitting idle.

Voice-driven communication

Gemini is also taking over more of the heavy lifting for communication tasks like calling and messaging. Users can now dictate text messages and place phone calls using only their voice. This is particularly useful for people who want to stay connected without stopping what they are currently doing.

The assistant can place calls to specific contacts, businesses, or even dial specific phone numbers. For messaging, users can request the assistant to send a text to a contact and dictate the content in a single request. The assistant then uses the phone's default messaging app to complete the action.

On Android devices, the assistant also supports WhatsApp for sending messages. To make this work, users must ensure that the Phone and Messages apps are connected within the assistant's settings. This integration allows for a consistent experience across different communication platforms.

Customization and setup

To get the most out of these hands-free features, users need to toggle specific permissions in the Gemini app. This includes enabling Device Assistance under the Personal Intelligence section. Users may also need to grant the Google app permission to access their contacts and phone data for the assistant to function correctly.

Beyond functionality, Google offers ways to make the interaction feel more natural for the user. There are several different voice options available for Gemini, allowing people to choose a tone they prefer. Users can preview these voices in the settings menu before confirming their selection.

The goal of these updates is to provide a faster way to handle everyday tasks. While users may still need to type for complex instructions, the assistant is now better equipped for quick commands. This makes the device more responsive to the user's immediate needs without requiring constant manual input.

Impact on user workflow

The primary benefit of these updates is the ability to complete tasks without interrupting a current workflow. By moving from a typing-based interface to a voice-based one, users can maintain their focus on their environment. This is especially helpful for accessibility and for those who are physically unable to hold a phone for long periods.

For the average user, this means less time spent looking at a screen to perform simple actions like setting a timer or turning on a light. It streamlines the way people interact with their technology by prioritizing natural language. The assistant acts as a bridge between the user's intent and the phone's complex menu systems.

As these features become more integrated, the distinction between a chatbot and a system controller becomes thinner. Users can expect a more proactive experience where the phone responds to verbal cues more accurately. This evolution focuses on making the smartphone a more hands-free companion in daily life.

Next steps for users

Users who want to try these features should start by checking their current assistant settings. They can navigate to the Gemini app and look for the Personal Intelligence and Device controls sections. From there, they can toggle on the various permissions required for hands-free and lock-screen access.

It is also worth checking which apps are currently connected to the assistant. Ensuring that the Phone and Messages apps are linked is a necessary step for those who want to use voice-dictated texting. Users can also take a moment to listen to the different voice previews to find the one that sounds best to them.

As Google continues to update these features, users should keep an eye on what new system commands might be added. The current focus is on basic phone management, but the integration with smart home devices suggests a broader scope for future updates. For now, the focus remains on making the phone easier to use without typing a single word.

How to get started

To enable Device Assistance, open the Gemini app and go to Settings > Personal Intelligence > Connected Apps. Find the Device Assistance toggle and turn it on to begin using voice commands for system tasks.

To use Gemini on your lock screen, go to Settings > Device controls > Gemini on lock screen. Turn on the 'Use Gemini without unlocking' option to access basic features while the phone is locked.

To customize the assistant's voice, go to Settings > Voice > Gemini's voice. You can tap the different names to preview them and select your preferred option.