Apple expands Siri AI to perform actions across third-party apps
The iOS 27.3 update allows Siri to use personal context and on-screen awareness to complete tasks in external apps.
The short version
- Siri AI can now use personal context and on-screen awareness to complete requests in third-party apps.
- Developers can create 'app skills' to bundle multiple tasks into a single voice command.
- Users no longer need to specify an app's name if the app is currently in the foreground or a Live Activity.
- The update also brings expanded Siri AI capabilities to native Apple apps, including Mail and Photos.
Why it matters
This shift moves Siri from a simple voice command tool to a more proactive assistant that understands your current activity. It reduces the friction of navigating menus by letting the AI handle multi-step processes across different software.
Expanding Siri's reach
Apple is introducing a significant update to its voice assistant with the release of iOS 27.3. This update allows Siri AI to perform actions across a much broader range of third-party applications than it could previously. The goal is to make the assistant more capable of handling complex, multi-step requests for users.
As reported by The Verge, the company is providing developers with the tools to integrate these new features into all apps. This means that Siri AI will be able to draw on a user's personal context to complete tasks. It will also process natural language prompts more effectively to understand what a user actually wants to achieve.
The update is currently rolling out as part of a Developer Preview. This phase allows developers to begin building for the new system before it reaches the general public. By opening up these capabilities, Apple is aiming to make Siri a more central hub for mobile interactions.
How app skills work
A core part of this update is the introduction of 'app skills.' These are new features that third-party developers can create to combine several different tasks into one single action. Instead of a user having to give three separate commands, they can trigger a sequence of events with one request.
Apple's documentation explains that users will not have to mention a specific app's name if that app is already in the foreground. This applies to situations where a user is actively looking at an app or viewing a Live Activity. Siri AI will use on-screen awareness to understand what the user is looking at and what they want to do next.
For example, a user might be using a ride-share app and see a Live Activity showing their ride's status. They could then say, 'Hey Siri, change my ride pickup to a new address.' Siri AI would understand the context of the current app and perform the specific action without the user needing to say 'in the ride-share app.'
Impact on native apps
While the focus is on third-party integration, Apple is also expanding Siri AI's capabilities within its own ecosystem. The update brings these new features to a wide variety of native applications. This includes common tools like Calendar, Mail, Maps, Messages, and Photos.
Users will be able to perform more sophisticated queries within these apps using natural language. For instance, a person might ask Siri AI to find a coffee shop they visited last week. The assistant will use the app's data and the user's personal context to surface that specific information quickly.
The update also covers utility apps like Files, Finder, and Reminders. Users might be able to perform organizational tasks, such as archiving files that have not been opened in over a year. Apple notes that users can simply ask Siri AI what it is capable of doing within each specific app to see the full range of options.
Technical capabilities
The underlying technology relies on Siri AI's ability to process natural language prompts more deeply. Rather than just looking for keywords, the system tries to understand the intent behind a user's speech. This allows for a more fluid conversation where the assistant can maintain context over multiple turns.
On-screen awareness is another key technical component of this update. This allows the assistant to 'see' what is happening on the display in real-time. By combining what it sees with what the user says, Siri AI can bridge the gap between a voice command and a specific button or menu item in a third-party app.
This integration is designed to reduce the number of steps a user has to take to complete a goal. By allowing the AI to handle the navigation and the execution of the task, the experience becomes more seamless. It moves the assistant from being a tool you call to a partner that understands your current workflow.
What to expect next
Because this is currently in the Developer Preview stage, the full scope of third-party integrations will grow over time. Developers will need to build and optimize their own 'app skills' to take advantage of the new iOS 27.3 features. This means the most useful integrations will likely appear in the most popular service categories first.
As more developers adopt these tools, the way users interact with their phones will likely shift toward more conversational commands. Instead of tapping through multiple screens to change a setting or book a service, users will increasingly rely on Siri AI to perform those actions in the background. This represents a move toward a more automated mobile experience.
Apple is positioning these updates as a way to make the assistant more useful in daily life. By allowing Siri AI to interact with both native and third-party apps, the company is creating a more unified experience. Users can expect to see a wider variety of 'skills' appearing as the software matures beyond the preview phase.
What to watch
- Which third-party apps will be the first to release 'app skills'?
- How will Apple balance user privacy with Siri AI's need for on-screen awareness?
Try it
Check your iPhone's software version to see if you have access to the iOS 27.3 Developer Preview.
Sources and links
- Officialannounced developers developer.apple.com
- OfficialApple’s developer documentation developer.apple.com
- ReportingThe Verge: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by The Verge · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
