Apple Watch begins beta testing for AI conversation rewinds and recaps

New audio intelligence features

Apple is currently rolling out a suite of AI-powered tools known as Audio Intelligence for its Apple Watch. These features are beginning with a developer beta in the iOS 27.3 update for the Apple Watch Series 12 and Ultra 4 models. The goal is to help users interact with the sounds and conversations around them more effectively.

The update introduces four distinct opt-in features designed for different use cases. Two of these are utility-focused, such as identifying important sounds like sirens or doorbells for the deaf and hard-of-hearing. Another feature integrates with the Shazam app to identify songs playing in the background.

The most notable additions involve processing human speech. These features aim to provide a way to catch up on missed information or summarize long discussions. Apple is positioning these tools as a way to mimic a user's ability to take notes while keeping their hands free.

Live Rewind and Siri Recaps

Live Rewind is designed for moments when a user misses a specific detail, such as a waiter listing specials or someone giving directions. By double-pressing the digital crown, the watch displays a text snippet of what was said in the last 15 seconds. This snippet appears on the watch face and can be viewed immediately or saved to a standalone Siri app.

If a user chooses to view the snippet without saving it, the text disappears permanently after 30 seconds. If they do save it, they can also use an 'Ask Siri' option to get more information about specific terms mentioned in the speech. To alert others, the watch plays an audible chime and shows an animation when the crown is pressed.

Siri Recaps takes this further by providing high-level summaries of entire conversations. Instead of a word-for-word transcript, it generates a short sentence and bullet points highlighting key facts like deadlines, pricing, or dates. This is intended for scenarios like work meetings or parent-teacher conferences where the user needs to remember specific tasks.

Privacy and data handling

Apple has implemented several layers of privacy to address concerns regarding AI recording devices. The system is designed to omit sensitive information, including financial data, government identifiers, and language promoting self-harm. It also avoids recording when the user is listening to music through headphones or using noise cancellation.

The technology relies on a secure enclave, which is a hardware-protected memory space that the rest of the operating system cannot access. A dedicated audio buffer processes the raw audio within this space, ensuring it is not accessible to anyone, including Apple. The audio is only shared with the paired iPhone through a secure pairing mechanism.

On the iPhone, lightweight models turn the audio into condensed text by removing filler words. This condensed text is then sent to Apple’s Private Cloud Compute to create the final recap. The recap and any summaries used to create it are deleted from the cloud immediately after they are sent back to the user's device.

User control and availability

Users have significant control over how these features behave on a daily basis. For Siri Recaps, owners can manually enable the feature or set a specific schedule. For example, a user could set the watch to only recap conversations during work hours and remain off at night.

The system provides regular prompts to review saved recaps, which appear when the user first unlocks their watch in the morning. If a user does not review or save a recap, it will automatically delete itself within seven days. Users can also quickly toggle the recapping feature off at any time using the Control Center.

The features are expected to have no impact on the battery life of the watch or the paired iPhone. Following the current developer beta, the tools will move to a public beta for broader testing before a full release. This rollout allows Apple to refine the AI models and user experience before the general public can access them.