Apple Watch Series 12 and Ultra 4 Add Health Sensing and Audio Intelligence

Originally published at: Apple Watch Series 12 and Ultra 4 Add Health Sensing and Audio Intelligence - TidBITS

Apple has introduced the Apple Watch Series 12 and Apple Watch Ultra 4, focusing on the new Health Sensing System and Audio Intelligence, both powered by the new S11 chip.

Health Sensing System

To improve the Apple Watch’s ability to track heart rate and heart rate variability, Apple redesigned its optical and electrical heart sensors, with larger, more power-efficient green LEDs in the optical sensor. Combined with the S11 chip, the new Health Sensing System measures heart rate every 5 seconds—60 times more frequently than before—and heart rate variability up to every 5 minutes, or 24 times more frequently. The more frequent sampling should produce smoother, more representative data by reducing the influence of outlying individual readings. A new heart rate complication displays your heart rate at a glance throughout the day.

Apple is also using the increased sampling rate to power a new Readiness feature that combines recent activity, training load, sleep score, and vitals into a 0–10 score accompanied by a recommendation such as Recover, Pace Yourself, Ready, or Go For It. Other health trackers from Garmin, Whoop, Oura, and others have offered similar features, but I’ve never seen much utility in them. Speaking as a certified running coach, I think it’s important for people to listen to their bodies when training seriously, and some metrics can be useful for athletes. However, most people don’t have the flexibility to change their behavior much based on a readiness score, and they aren’t stressing their bodies enough to bother anyway. What are you going to do, call in sick to work or pass on grocery shopping because you got a 3 on your readiness score?

Apple says it also rebuilt the pedometer model to provide more accurate distance measurements during indoor walk or run workouts, and the S11 chip allows more accurate step counts throughout the day. More accuracy is always welcome, but remember that the 10,000-steps goal originated with a 1960s Japanese marketing campaign, rather than scientific research. I can’t see a more accurate step count making a difference to most people’s health.

Audio Intelligence

More interesting is the new Audio Intelligence feature, which uses the microphones in the Series 12 and Ultra 4 to listen to ambient sound and provide four features, two familiar and two new ones that require additional unpacking:

  • Sound Recognition: This long-standing feature of the iPhone, iPad, and Vision Pro listens for and reports on ambient sounds like doorbells, crying babies, and sirens. It’s important for those who are deaf or hard of hearing, and having it on an Apple Watch, even when the iPhone isn’t present, could provide a welcome awareness of nearby events.
  • Music recognition: The music recognition feature Shazam isn’t new to Apple Watch, but the Series 12 and Ultra 4 can now automatically recognize nearby music and display the result in the Music Recognition widget in the Smart Stack.
  • Live Rewind: If you have trouble hearing or remembering what was just said in a conversation, you can double-press the Digital Crown to show the previous 15 seconds of conversation as a text snippet. You can also ask Siri about the snippet or save it to the Siri app for later reference.
  • Siri Recap: Live Rewind works only on the last 15 seconds, but Siri Recap creates high-level summaries of conversations that you can review later. When it’s turned on, Apple Intelligence automatically generates a title and key points in the Siri app.

You’re probably thinking, “Wait, so if you enable these features, your Series 12 or Ultra 4 Apple Watch can be listening to everything around it all the time?” You would be excused for feeling that’s a bit creepy, but Apple took pains to emphasize the privacy features surrounding Audio Intelligence, including:

  • No recordings: These features don’t create or store audio recordings, and the raw audio data is inaccessible to watchOS, apps, the user, and Apple. A new Secure Exclave compartment on the S11 chip processes that raw audio in isolation from the rest of the system, then immediately deletes it.
  • User control: Apple says that users must enable each Audio Intelligence feature, decide when and where Siri Recap takes notes, and toggle it on and off from Control Center. But really, will most people who want to use it ever turn it off?
  • No speaker identification: Audio Intelligence doesn’t identify speakers or attribute speech to different people—Apple says that’s to protect privacy, but I suspect it’s also a technological limitation.
  • Curated summaries: Siri Recap produces only a brief, high-level summary of conversations, not a full transcript, and Apple says it will try to exclude sensitive information like financial information and government-assigned identifiers.
  • Activation alerts: Much like the recording light on Meta’s AI “perv” glasses, Live Rewind attempts to make it clear that it has been activated with an audible chime, plus a full-display animation and microphone indicator. I very much doubt most people will understand what these alerts mean.
  • End-to-end encryption: Live Rewind text snippets that you save and Siri Recap summaries are end-to-end encrypted when synced between your devices through iCloud. Because Apple doesn’t hold the encryption keys, it can’t read the synced data.
  • Auto-deletion: If you take no action, Live Rewind snippets disappear about 30 seconds after the Apple Watch display dims, and Siri Recaps auto-delete after 7 days if you don’t explicitly save or export them.

Sound Recognition and automatic Shazam recognition will be available immediately with the Series 12 and Ultra 4. Live Rewind and Siri Recap will arrive in beta in late 2026, initially in English, and won’t be available in the EU at first. They also require Siri AI and an iPhone 16 or later, excluding the iPhone 16e, and Apple says daily usage limits will apply because they rely in part on server-side models.

Apple seems to have said nothing about how Audio Intelligence interacts with laws governing the interception or electronic overhearing of conversations. The lack of a saved audio recording isn’t necessarily a Get Out of Jail Free card: some federal and state laws regulate acquiring the contents of a conversation electronically, and consent requirements vary by state. We’ll see if Live Rewind and Siri Recap attract legal scrutiny in areas with stricter consent laws.

Other Details

Beyond the Health Sensing System and Audio Intelligence features that come with the improved heart rate sensors and S11 chip, the Ultra 4 remains largely unchanged. The main improvement comes in battery life, with the Ultra 4 offering up to 50 hours of everyday use. The new Extended Workout mode delivers up to 25 hours of battery life with full GPS and heart rate readings; the Max Extended Workout mode can track outdoor runs, walks, and hikes for up to 45 hours while still taking GPS readings every second.

Grid of Apple Watch features: 50hrs battery life, improved calorie estimates, Health Age -3.9 years, live heart rate 62 BPM, Audio Intelligence, HRV in vitals, most accurate heart rate sensing, Readiness score, extended workout, steps complication, Siri Recap, faster charging, S11 chip, Live Rewind, Siri AI, and Health Sensing System, shown with a titanium Apple Watch Ultra displaying the watch face

Everyday battery life for the Series 12 is unchanged at up to 24 hours, but it will now offer up to 10 hours of battery life during an outdoor workout—25% more than the Series 11. Both the Ultra 4 and Series 12 charge faster than ever, with just 15 minutes of charging adding 18 hours of battery life to the Ultra 4 and 12 hours to the Series 12.

The Series 12 brings back ceramic cases alongside the usual aluminum and titanium—ceramic last appeared with the Series 5. Aluminum models replace Ion-X front glass with Ceramic Shield 2, which Apple says is 60% tougher than the Series 11’s Ion-X glass, while titanium and ceramic models use sapphire front crystals. The Ultra 4 case continues to rely on 3D-printed recycled titanium and is essentially unchanged.

Grid of Apple Watch feature tiles: Readiness, Live Rewind, S11 chip, 24hrs battery life, Audio Intelligence, Ceramic Shield 2, Steps complication, Health Age, ceramic back sensor, live heart rate, most accurate heart rate sensing, Health Sensing System diagram, faster charging, Siri Recap, Siri AI, HRV in vitals with overnight and daytime readings

The Series 12 aluminum models come in black, space gray, light gold, and a new dark bronze finish. The titanium models come in natural titanium and radiant gold, and the ceramic cases are available in pearl white and night blue. The Ultra 4 still comes in natural titanium and black, just like the Ultra 3. Apple also updated band colors and patterns, most of which are quite muted. The metal Milanese Loop now comes in radiant gold and dark bronze to match those case finishes. The Ultra 4’s silicone Ocean Band now comes in translucent black, translucent kelp, and translucent gray.

Starting prices for the aluminum and titanium Series 12 and the Ultra 4 remain unchanged from the previous generation: $399 for aluminum Series 12 models, $699 for titanium, and $799 for the Ultra 4. The new ceramic Series 12 starts at $899. For budget-conscious buyers, the Apple Watch SE 3 remains available starting at $249.

Apple is accepting pre-orders now, with availability starting on 18 September 2026.

1 Like

Has anyone had their Ultra series watch battery replaced or do you just get a new watch?
Next, I read this announcement highlight, thanks Adam, and compared models. I’ve the Ultra 2 pre-Apple vs Masimo Blood O2 changes. Apparently in April, ITC formally said that it will not review any further petitions from Masimo. So I would think Apple now has a revamped SpO2 sensor but it footnotes (4) in its product that Blood Oxygen is shown on the iPhone App. Where with my Pre-ruling Ultra 2 watch, I can view on the watch, as can others in other countries.

My question is, has since the ITC ruling, do with think the Ultra 4 or even later Ultra 5 will allow on watch of O2 reading, sans iphone? And what of blood sugar monitoring, has that been achieved without port (on arm) or needle-device?
Growing up watching Star Trek, to have something on our wrist to inform us of air quality, body conditions and reporting is just a necessity. We are getting there but I hope, sooner than later.

Again, I asked originally about the battery as the newer Ultra has a 84hr low power mode. I get about 3 days on my Ultra 2 but notice if I don’t put in lp mode, I’m lucky to have a day. And I mostly use it for health monitoring (temp, O2, HR…). I wonder with the new Ultra 4 and the Live HR, how that affects battery life. And the legal issues with the watch listening…perfect timing with the LG news from Gamers Nexus and how your LG is listening and scanning for devices…something to be concerned on. Interesting to see that now Apple (see Microsoft-Xbox limiting cloud use in gaming) is also limiting data use. Which appears more about cost than data.

Regarding listening, I wear noise cancelling earbuds or headphones (Sony brand or ISOTunes). And I am listening to music while working around the yard. My watch will alert me to loud noise, but I know this, aka why I am wearing noise protection or cancelling earbuds (ISOtunes) and control the music/level from my Ultra 2. Why can’t the watch know this? Or why can’t I turn off this feature temporarily and easily while working, and not have the data logged? I know I can turn if off, or put in Water Lock mode, but I want the option of say, Off for an hour, Off till end of day, or Off.
I also do wood working, as well as outdoors work, and leave the watch on. Tell ya, when you sweat and using a pole digging tool or breaker bar, that watch is noticeable. And then with a chainsaw or lawn implement, the watch warns you of the noise (yes, I know hence earbuds) and after so many alerts over time, I just start to ignore. Which can be a problem if that next alert was a reminder.

I have not after almost ten years of owning an Apple Watch, but Apple never replaces a battery - they give you a “like-new” (e.g, new or refurbished) model that matches the one that you own.

There is no way to know if Apple will ever get an agreement with Masimo on this, but the patent(s) which prevent the watch from showing a blood oxygen reading expire in August 2028. My guess would be that watchOS 29 that September would restore the ability to show results.

As it is, it’s not a terrible burden now on my Ultra 3. I take the reading, it tells me to check my iPhone, and shortly I get a notification on the phone of my results.

It is my understanding that the improved battery life of the Ultra 4 includes the new feature to monitor heart rate every 5 seconds. Most likely Apple managed this due to the new S12 processor, upgraded from the S10 (they skipped S11) in the Series 10, Series 11, Ultra 2, Ultra 3, and (I think) SE 3 models. I know that the S10 was a 4 nanometer process chip, and I believe that the S12 is 3 nanometer, but also includes other improvements over previous models. The S10 itself was essentially the same as the S9, meaning that it’s been three years since Apple has improved the processor in the Apple Watch.

I’ve noticed this as well, and it’s a really good question for people wearing AirPods Pro models in noise-canceling mode. The watch (or the paired iPhone) knows that it is in noise canceling mode (and the APP recent models even have noise protection in Transparency mode these days). That said, I ignore these warning when I know I’ve been using power equipment with hearing protection on. That said, I almost always see them after the incident.

I have turned off those warnings many years ago.

I routinely plug my iPod Touch into my car’s line-in port via an analog audio cable from the headphone jack. I find that I get the best audio quality by setting the iPod’s volume to maximum, controlling the volume entirely via the car’s controls.

But there’s no way to tell the iPod that I’m not running the maximum-volume audio directly into my ears via earbuds of headphones, so it (and therefore my phone) would give me all kinds of dire warnings about permanent hearing damage. After a few weeks of all those notifications and alerts, I disabled the feature altogether.

anyone else find siri recap exceptionally creepy? it’s not apparent that you can completely disable siri on your watch. but even if you can, you have no control over what is happening on other people’s watches.

suggest that this is yet another blow to the already dubious proposition that apple cares about your privacy. i certainly won’t buy a device that has this feature enabled on it.

Well, it hasn’t shipped yet, so conclusions are a bit hasty. However, as it doesn’t record, so the feature doesn’t concern me, at least so far as it has been described.

Yep! I can’t imagine how they think this is going to get around two-party consent laws in a wide range of states.

It has to record if it’s giving you 15 second transcripts of the most recent conversation and summarizing longer conversations. It may delete that recording after processing it, but it’s still a recording. Apple is trying to make a distinction between recordings and “raw audio” but that seems like handwaving to me. It is (if temporarily) storing audio recordings on the watch.

We can get pedantic about “recording,” but I wouldn’t consider a streaming speech to text translation as falling in that category, just as dictation from the keyboard doesn’t either.

1 Like

We can, but (at least) California’s all-party consent law says…

A person who, intentionally and without the consent of all parties to a confidential communication, uses an electronic amplifying or recording device to eavesdrop upon or record the confidential communication…

California Penal Code § 632

There doesn’t seem to be an exception for “but I’m going to erase it right after I transcribe it.” And the “amplifying or recording” bit seems to indicate that the intent was to cover electronic monitoring even if no electronic record is kept. I researched this many years ago, and I vaguely recall that there is even case law concerning a case where a conversation was “amplified” or “recorded” just so that a stenographer could transcribe it in near real-time, and the statute was held to apply. Similarly, listening to a conversation on an extension or a speakerphone, unless all parties have consented, is a violation.

I am nearly certain that if I tried to argue that I wasn’t amplifying or recording when using the Apple Watch feature, I would lose even with all the legal talent reasonably available to me. Apple, on the other hand, might be able to prevail particularly in today’s power-to-the-oligarchy judicial climate.

There are also pending (I think) cases – Otter.AI Privacy Litigation, N.D. Cal., No. 5:25-cv-06911 and Ambriz v. Google – that hold that using AI to transcribe constitutes recording under §632 if the AI has the capability to use the intercepted conversation for its own uses (which sounds like anthropomorphizing to me).

(I’m not a lawyer and not even lawyer adjacent. I even believe that the law should be consistent and make sense, so there’s very little chance I could ever even survive law school. But it is difficult for me to see a way that the Apple Watch transcription feature could fail to fall afoul of these statutes and rulings.)

This article seems to cover the topic fairly well:

1 Like

It’s important not to conflate the two distinct features. There’s the “summarize a conversation” feature, and the “see the last 15 seconds” feature.

I don’t see how the latter is any different than dictation or live captioning, which have been features for years.

As to the former, Apple has already said that activating the summary feature will audibly notify that it has started.

Oh, I’m not a lawyer either. But I’m certain that Apple has plenty of them on staff and that this has been greatly discussed in those circles.

This is great news! It seems to apply to every person at Starbucks with their phone on Speaker. I can’t wait to inform them that it’s against the law. :)

An admirable application of the rule of law!

To be pedantic, Live Rewind (the last 15 second feature) is the one that Apple says will show a large microphone icon and an audible tone, even if the watch is silent. They don’t say that about Siri Recap.

Siri Recap produces a brief, high-level summary of conversations — not a transcript — and is designed to exclude sensitive information like financial information or government-assigned identifiers. Live Rewind plays an audible chime when it is being used, even if Apple Watch is on silent, and shows a full-display animation and microphone indicator so people nearby can hear and see that the feature has been activated.

I don’t have an Ultra 4 or Series 12, so this won’t affect me as a user of the feature. And I’m not a lawyer so I can’t intelligently comment on the legality. But I really think that at least Siri Recap sounds potentially as creepy as people wearing Meta glasses with cameras with no way to know if they are capturing anything. That said, it does sound like an intriguing feature for me as a user. I suppose the good news is that the feature only works when the watch is being worn. Whatever the user can hear, the watch can hear, but you can’t place it far away to eavesdrop, as you potentially could with an iPhone with voice recorder activated.

How many billions does Apple owe in legal settlements at the moment?