Osegi
Mobile·2 min read

Apple Watch Audio Intelligence Enters Beta With Live Rewind

Apple is opening Audio Intelligence for Apple Watch to developers in beta, adding sound recognition, Live Rewind and Siri Recaps to the Series 12 and Ultra 4.

Apple Watch on a wrist displaying a live text transcript of a conversation on its screen.
Image: Webrazzi

Apple has started a beta of Audio Intelligence, a set of AI-powered features for Apple Watch. The tools first reach developers through the iOS 27.3 update and add four capabilities to the Apple Watch Series 12 and Apple Watch Ultra 4: detecting important sounds, recognizing songs, reviewing missed speech and generating notes from conversations.

What the features do

Sound recognition is aimed at users who are deaf or hard of hearing. The watch can alert the wearer to sirens, alarms and doorbells. Song recognition uses Shazam to identify the title and artist of music playing nearby.

Live Rewind lets users catch up on something they missed in a conversation. Double-pressing the Digital Crown turns the last 15 seconds of speech into text on the watch screen. Users can save that text to the Siri app for later; unsaved text is deleted after 30 seconds. They can also ask Siri about topics they did not understand.

Siri Recaps summarizes conversations such as work meetings, parent-teacher talks or personal training sessions. Instead of a word-for-word transcript, it produces a short summary and key points, which can include dates, deadlines, prices and payment plans. Notes can be exported to Apple's Notes or Journal apps.

Privacy approach

Following recent debate over AI wearables recording surrounding conversations, Apple stresses privacy. The company says Siri Recaps does not identify speakers, keep raw audio or produce verbatim transcripts.

Audio is handled by the S11 chip and secure memory on the watch, then passed to the paired iPhone, where it is converted to text. The text is encrypted and sent to Apple's Private Cloud Compute, and the data used is deleted from the cloud right after the summary is created. Apple says only the user can access the summaries and that data is encrypted when synced between devices.

Users can turn Siri Recaps on manually or schedule it for certain hours, and switch it off at any time from Control Center. Summaries not saved by the user are deleted automatically after seven days.

Apple says it aims to keep the features from affecting battery life on the Apple Watch or iPhone. After the developer beta, the company plans a public beta, followed by a release to all users once testing is complete.

Apps worth a look

SUMO: the number puzzle

Tap the right tiles, add them up, hit the target. Easy to learn, hard to master. Free, for all ages.

Tags:appleapple watchaudio intelligencesiriwatchosprivacy

More from this day

See all →

More in: Mobile

See all →