Apple Opens Audio Intelligence Beta for Apple Watch Conversation Tools
Apple has started developer beta testing of Audio Intelligence for Apple Watch Series 12 through iOS 27.3. First announced at Apple’s September Surprise and Shine hardware event, the opt-in feature set combines sound recognition, song identification, Live Rewind and Siri Recaps. Apple says the capabilities will later reach a public beta before wider availability.
The release brings Apple’s most sensitive Watch-based AI functions into hands-on testing. Live Rewind lets a wearer double-press the Digital Crown to view a text snippet of what was said in the preceding 15 seconds. The snippet can be allowed to disappear or saved to the standalone Siri app introduced with iOS 27.
Apple says the interaction includes an audible chime and an on-screen animation, intended to make the action apparent to people nearby. If not saved, Live Rewind snippets are automatically deleted after 30 seconds. An Ask Siri control beneath the displayed text can be used for follow-up questions about a term or detail that was mentioned.
Conversation summaries without raw-audio storage
Siri Recaps is designed to produce a short sentence and bullet points from conversations, highlighting items such as dates, deadlines, pricing or payment-plan information. Apple says it does not identify speakers, retain raw audio or create word-for-word transcripts. It positions the tool for situations including meetings, parent-teacher conferences and personal training sessions.
The product direction builds on Apple Watch AI conversation recap features while the beta provides more detail on retention controls and processing. Recaps are not made when a user is listening to music through headphones or using noise cancellation. When the feature is enabled, the Watch prompts the user to review saved recaps at the end of the day and again when the Watch is first unlocked in the morning.
Users can save selected notes to Notes or export more personal items to Journal. Recaps that are left untouched are deleted within seven days. The feature can be enabled manually, scheduled for contexts such as work, excluded at night, or switched off at any time through Control Center.
Hardware, iPhone processing and Private Cloud Compute
Audio Intelligence on Apple Watch Series 12 and Apple Watch Ultra 4 uses the S11 chip, the built-in microphone, Apple Intelligence models running on the paired iPhone and Apple’s Private Cloud Compute. Apple says the Watch’s always-on processor contains a secure enclave with a dedicated audio buffer, isolating raw-audio processing from the rest of the operating system.
Lightweight models on the S11 detect whether the wearer is participating in a conversation. Audio is transferred through secure pairing to the iPhone, where on-device processing creates condensed text with filler words removed. That text is encrypted before being sent to Private Cloud Compute to generate the recap; Apple says the recap and the summarizations used to create it are deleted from the service immediately afterward.
Apple says accessible recaps are available only to the user and are encrypted when synchronised across Apple devices. It also says Live Rewind audio is transferred to the iPhone for processing, and that the features should not affect Watch or iPhone battery life. For businesses, the beta is a practical point to assess whether review schedules, retention settings and user-controlled saving match their policies before conversation summaries are enabled in work settings.