Can Apple Home’s AI camera features outsmart Amazon’s and Google’s? I put them to the test

All About Technology by The Verge by 18 min read 29x views
Can Apple Home’s AI camera features outsmart Amazon’s and Google’s? I put them to the test

Share Post

A few years back, I was at a beachside Easter egg hunt, observing my kids dash through dirt dunes searching for saccharine treats. My phone buzzed in my pocket; I ignored it. A instant later, it buzzed again. I pulled it out, glanced down, and saw a “motion detected” notification from my safety camera. “Just my dog in the yard,” I thought, dismissing it.

As the colorful eggs piled up in the baskets, my phone kept buzzing. Reluctantly, I pulled it out again and saw multiple additional “motion detected” alerts. I tried to burden a video clip, but it fair buffered endlessly.

AI-powered content descriptions coat the entire environment in a sentence.

When I returned home, I established my four pet chickens dead, killed by my small border terrier. Looking rear complete the camera footage, I saw that they had pushed open their coop door, which I, in a hurry to get to the Easter festivities, hadn’t correctly secured.

If alternatively of “motion detected,” that archetypal notification had peruse “small dog chasing a chicken,” I would have raced rear residence and perchance saved them.

Today, that category of notification is possible. With AI-generated content descriptions, a abbreviated communication describing what the camera saw can attain nearly instantly, fine before a video nourish loads, artwork the entire environment in a sentence.

Most important safety camera companies now recommendation content descriptions, which merge traditional motion triggers alongside Vision Language Models, including Ring, Google Nest, Blink, Wyze, and Arlo. This month, alongside iOS 27, Apple eventually brought the capability to its HomeKit Secure Video service alongside the initiate of Apple Intelligence for Home.

The astonishment is that Apple is charging up to three times as much as its competition for the feature. Is it value it? And are safety cameras getting improved at telling us concerning what really matters?

You’d think no one can get former my entrance without me knowing concerning it.

You’d think no one can get former my entrance without me knowing concerning it.

I’ve been evaluation Apple Intelligence for Home since it launched in beta this summer, alongside Amazon Ring’s and Google Nest’s AI camera features introduced final year. I installed multiple cameras for each, but for this piece, I focused chiefly on video doorbells — which I set up whenever iOS 27 officially arrived on September 14th. I tested a Ring Wired Doorbell Pro ($249.99), Google Nest Doorbell 2K ($199.99), and for Apple, the HomeKit Secure Video-compatible Aqara Doorbell Camera G400 ($99).

I focused on how quickly all assistance sent the AI-powered notifications, how exact and helpful the descriptions were at telling me what happened, and how reliably it captured and notified me concerning activity. I additionally tested another AI-powered features all phase offers, including Apple’s capability to hunt and stitch together action throughout multiple cameras, Ring’s Unusual Event that distinguished normal action from out-of-the-ordinary events, and Google’s capability to trigger automations according to what a camera sees.

The AI features on all three platforms are a important betterment complete their essential astute alerts. It’s now easier to comprehend what’s happening at a glance and decide whether to react, and safety cameras awareness additional helpful and small annoying overall.

Ultimately, the genuine value of AI in cameras isn’t in describing what they see, but in using that cognition to fig out what you really need to know, and eventually what your residence should do concerning it.

What Apple Intelligence provides, at what price

How to use Apple Intelligence for Home

  • 2TB plan: $9.99 a duration (or Apple One / $39.95 a month) for one camera
  • 6TB plan: $29.99 a duration for two cameras
  • 12TB plan: $59.99 a duration for up to five cameras
  • No tier supports additional than five cameras.

Note: standard HomeKit Secure Video record additionally requires an iCloud Plus plan, starting at $0.99 for one camera (50GB plan), $2.99 for five (200GB), and $9.99 for unlimited (2TB). All tiers that contain Apple Intelligence assistance essential HKSV features on unlimited cameras.

Apple Intelligence is on by default for Reduce Notifications and off by default for Summarize Videos. To adjust, go to Settings in the Home app, scroll downward to Apple Intelligence, toggle on Summarize Video, and choose participating cameras.

With Apple Intelligence, a compatible camera connected to Apple’s HomeKit Secure Video service can dispatch you content descriptions through the Apple Home app: “A dog sat on the floor,” “a cat played in the room,” “someone delivered a package.”

It additionally enables natural-language video search, surfaces “noteworthy” events, stitches applicable clips together, and adds a decrease notifications characteristic that combines connected events into a sole vigilant that updates. This is in supplement to the existing astute alerts, facial recognition, and 10 days of video retention available alongside HomeKit Secure Video.

Pricing is anywhere it gets tricky. Apple Intelligence for Home is bundled into iCloud Plus: $10 a duration covers one camera, $30 covers two, and $60 up to five (see sidebar). No tier supports additional than five cameras.

By comparison, Google Home’s Nest cameras recommendation Gemini-powered content descriptions, video search, facial recognition, and a regular Home Brief digest — which summarizes the day’s action in a abbreviated paragraph (sometimes alongside a fictional slant) — for $20 a month, covering unlimited cameras and 24/7 record on wired models.

Amazon’s Ring additionally charges $20 a duration for its AI content descriptions, video search, facial recognition, different events alerts, and clip record on unlimited cameras, alongside 24/7 costing an additional $3 per camera on wired models. Ring has its own reduced notification option that rolls akin events from the identical camera into one notification, specified as “Brian is mowing the lawn.”

Text descriptions are a equivalent changer for safety cameras. For me, getting an vigilant that says “A FedEx shipment individual is strolling on the lawn” fairly than “person detected at forefront door” is the difference between getting up and going downstairs or carrying on working. But norm and accuracy change wildly, equal inside a sole provider.

Sometimes I get helpful details, another times a few words that inform me nearly nothing. Then there were the times whenever the descriptions were detailed, but laughably wrong: “A tennis assist simulator is rolling on the walkway,” “A gray hoverboard is driving on the pathway” — the two misidentifications of a robot grassland mower.

1/3

I donned a Ghostface disguise to see how the assorted AIs would react. Nest sent the most helpful alert.

In my testing, content alerts from Google and Ring provided the most environment and specificity, and Apple frequently didn’t try, saying “someone” fairly than providing any detail. For example, it would say “someone is strolling in the yard,” whereas Ring and Google provided additional context: a shipment individual is strolling in the yard, a individual in uniform, person carrying a bag, and so on.

Apple was additionally the briefest. For example, whenever my cat was on the forefront porch, Apple said, “A cat sat on the porch.” Ring went alongside “A cat is position on the pathway exterior the porch.” Google Home told me which cat: “A dreary and pale cat walks throughout the porch.”

All three identified shipment trucks, correctly flagging UPS and FedEx vehicles driving past, as fine as shipment group approaching the door. Apple was the lone one to ID the USPS van pulling up to my mailbox, although not consistently.

Google was the most descriptive alongside vehicles — “a light-colored car drives by on the street” or “a pale van,” “a dark-colored SUV” — Apple and Ring mostly stated “a conveyance drove by,” sometimes alongside a category (van, car, truck).

Apple’s decrease notifications characteristic combines multiple alerts into one.

These were difficult to peruse and not terribly useful.

Apple’s descriptions were the hardest to digest at a glance, particularly the blended ones through decrease notifications. For example, “Someone seen. Someone carried a box” is clunky. Ring and Google merge the events additional fluidly into “a individual carried a box up the driveway.”

In fairness, Apple Intelligence in Home lone officially launched this month, so I anticipate this to improve, but as things stand, Ring’s and Google’s are additional helpful and disbursal less.

Finicky facial acknowledgment and alerts

For a bell camera, the genuine advantage of AI descriptions is knowing who’s there correct away. All three recommendation facial acknowledgment alongside the capability to place a UPS controller or similar.

Ring was the most consistently accurate, identifying me all period I approached the door. Apple hedged its bets, sometimes identifying me, sometimes saying “Someone who may be Jennifer Pattison Tuohy,” and another times fair “Someone.” Google got it correct concerning fractional the time; the another fractional it idea I was my daughter’s finest mate (a alter from the UPS controller it pegged me as for most of final year).

Apple fair wasn’t certain concerning me.

Ring was the most accurate; Google was mostly accurate.

Text descriptions are additional helpful if they display up, and quickly. But on the bell camera I was testing, Apple’s frequently didn’t. Apple Home reliably alerted me whenever person pressed the doorbell, and it recorded all event, but notifications concerning another motion events were inconsistent.

A possible matter current is that, dissimilar its competition, Apple doesn’t authority the entire experience. HomeKit Secure Video lone plant alongside third-party hardware — there are no Apple cameras yet. I was using the G400, Aqara’s latest wired bell camera.

When I archetypal set it up, alerts arrived in Apple Home alongside no issues, but at several item they stopped, and no amount of troubleshooting brought them back. However, alerts kept coming through in the Aqara app. I additionally motionless got bell circle alerts in the Home app, and notifications from another Aqara cameras continued to work.

The Google Nest bell captured everything and was consistently archetypal to notify me of an event. Ring was additionally accelerated and mostly reliable; its notifications showed up fair following Google’s, although I’d occasionally get “This video is unavailable” whenever trying to perform rear footage.

Reliability is Apple’s biggest fix, affirmative several innovation

The fine news is that record in HomeKit Secure Video has improved considerably alongside iOS 27. Apple stated it entirely rearchitected the system, which addresses a long-standing issue alongside missing clips.

I’ve noticed that cameras burden faster, are additional stable, and no longer young female recordings. An Eve outdoor camera that was nearly continually offline has been stable since the upgrade, and the Aqara Camera Hub G5 outdoor camera and G350 indoor camera have additionally been solid. The G400 bell camera has been the lone issue child, alongside missing notifications, but it records consistently.

All the another HomeKit cameras I tested reliably sent alerts; lone the Aqara bell camera had the issue, but equal whenever I didn’t get alerts, I could use video hunt to discover events.

Typing “When did the USPS truck come” in the Apple Home app pulled up all case the Aqara bell spotted the communication delivery. In comparison, during the Nest Cam didn’t acknowledge the USPS truck as often, its video hunt results contained additional specifics, including an event anywhere the communication individual dropped off an Amazon package.

Of the three, Google’s video hunt was the most useful, followed by Ring’s, afterward Apple’s, which immediately correlates alongside the amount of item all provides in the content descriptions.

Apple has two features Ring and Google don’t offer. The archetypal is clip stitching, anywhere Apple Intelligence identifies person or item on one camera, recognizes it again on another, understands these are related, and plays the sequence as a sole video in the Home app. I haven’t established a genuine use for this so far, but it’s been fun for tracking my dog about the home whenever I’m out.

The second characteristic is bringing events that Apple judges crucial to the top of the hunt box. In the final two weeks, it’s lone highlighted the trash pickup ━ I conjecture my existence fair isn’t that noteworthy.

One of the biggest problems alongside safety cameras is filtering out the crucial info from the sheer quantity of everything they see. Even alongside AI notifications turned on, I motionless get a stream of alerts from Apple Home and Google Home. Some are additional helpful than they used to be, but overload is motionless an issue.

These are the lone alerts Ring sent from the bell camera complete an complete weekend whenever I had Unusual Event enabled.

Apple’s noteworthy events is a akin concept, but it doesn’t dispatch a particular vigilant alternatively fair surfacing the clip to the top of your hunt page.

While Apple’s noteworthy events characteristic shows promise, Ring’s Unusual Event characteristic is the finest resolution I’ve seen. It learns what normal traffic looks akin for all camera, afterward notifies you only whenever item isn’t normal. This summer, I cut my Ring notifications downward from about 40 a day to fair two or three.

Instead of getting an vigilant all period my cat is on my porch, I lone get one whenever a raccoon or possum walks by. It doesn’t dispatch alerts whenever my son comes residence from school, but it does whenever he comes residence at 2AM. The camera by my poultry coop no longer sends a sequence of notifications whenever person is feeding them or collecting eggs — but it does vigilant me whenever I am out there at midnight alongside a flashlight to wrestle a snake.

What’s next: cameras that can act

The cats were a big fan of Google Home’s inability to inform them apart, as it meant additional kibble. (This is not Smokey).

The cats were a big fan of Google Home’s inability to inform them apart, as it meant additional kibble. (This is not Smokey).

The natural progression current is automations triggered by the camera understanding what it sees. Turn on the sprinklers if there’s a raccoon in the backyard, but not if it’s fair my dog. A cat at the rear entrance broadcasts an vigilant through my astute speakers so person can let them in. The trash truck rolling former without stopping sends an urgent notification to put the bins out before it comes rear the another way.

This is anywhere cameras move beyond being merely safety devices to rotate into intelligent smart-home sensors that can comprehend what’s happening and possibly act on it.

Google Home lately added the capability to trigger automations from camera alerts, although in my first testing, it’s not dependable enough.

I tried it with my three cats and a pet feeder using Google’s new Pet Memory feature. But alternatively of lone dispensing food for one particular cat as I asked, it triggered all period it saw a cat. At smallest the cats were happy.

The issue is accuracy. When AI can’t reliably acknowledge the subject, the automations can’t react reliably. So, my before example of Apple accurately recognizing the USPS van fractional the period would average any automation I set up to vigilant me the communication is current would lone activity fractional the time.

Today, Apple doesn’t have this capability, but if the gossip that the business is evolving its own video doorbell and security camera are true, I would anticipate to see a characteristic akin this arrive to Apple Home.

The smarter cameras become, the additional they need to cognize concerning your home. For a scheme to comprehend what’s normal, it needs to study who lives there, whenever they arrive and go, which pets are around, and which vehicles belong. This raises extremely genuine concerns about privacy and surveillance.

Ring has faced particular scrutiny complete its cloud-based architecture and partnerships alongside law enforcement. Where Google and Apple can commencement alongside local processing, Ring processes all footage in the haze by default.

There’s genuine advantage in a scheme knowing everything concerning my residence — I’d fair favor to be the lone one who knows it.

Last month, Ring announced an overhaul to that model, introducing a new default encryption scheme called TAKE. This rotates encryption keys for cloud-stored video and deletes Ring’s copy following 24 hours. Among another privacy protections, including no admin access, Ring says this method it can no longer hand complete decrypted footage to the police. However, it can motionless be compelled to provision encrypted files.

With Apple’s norm HomeKit Secure Video, your residence hub processes footage locally and encrypts it end-to-end before sending it to the haze for storage. But adding Apple Intelligence changes that: Video summaries are now processed in the haze using Apple’s Private Cloud Compute (PCC), anywhere they are unencrypted for processing.

According to Apple, PCC writes the captions, sends them back, and afterward “permanently deletes the data from PCC.” Apple assistance docs additionally state that there is no admin access, and nothing identifies who the footage belongs to.

Google takes a akin method to Apple, but without end-to-end encryption; footage is encrypted in transit and at rest. Gemini for Home-enabled Nest cameras can use several on-device processing, but the dense activity is done in the Gemini cloud, in row alongside Google Home’s privacy practices.

A big inquiry for me is whether all this intellect has to live on person else’s computers. There’s genuine advantage in a scheme knowing everything concerning my residence — I’d fair favor to be the lone one who knows it. For privacy, security, and possibly speed, local AI handling and retention feels akin the correct answer. Manufacturers including Anker Eufy, Reolink, Ubiquiti UniFi, and UGreen already have or have announced products that do this.

With a new Apple TV, HomePod, and a imaginable astute display all rumored to be imminent, Apple’s next generation of hardware power change additional handling back into the house — which could average paying small all duration for the privilege.

When Ghostface is at my door, I desire Apple Home to inform me.

When Ghostface is at my door, I desire Apple Home to inform me.

Is Apple Intelligence value it?

Based on my evaluation of the beta and the first complete release, Apple Intelligence in Home has brought significant improvements, eventually putting HomeKit Secure Video in disagreement alongside Ring and Google.

Whether it’s value the cost depends on how many cameras you own. If you have one — say, a video bell — Apple Intelligence is a sensible agreement at $10 a duration if you additionally need 2TB of iCloud storage. You get capable descriptions, improved video search, and Apple’s privacy position. Even alongside multiple cameras, you can get several advantage by enabling it on fair one.

Next let’s create them improved at telling us what really matters.

However, if you desire AI capabilities throughout your home, including clip stitching, the math gets bad fast. At five cameras, you’re paying $60 a duration for Apple to inform you “a cat sat on the porch” or “a conveyance drove by.” The competition gives you additional detailed descriptions on as many cameras as you own for $20 a month.

Today, you’re paying an Apple premium for less. But this is Apple’s archetypal move, and I anticipate it to improve. AI has unlocked genuine usefulness here, making safety cameras improved at telling us what’s happening; next, let’s create them improved at telling us what really matters.

A few years ago, a “motion detected” vigilant wasn’t adequate to inform me that my chickens were in trouble. Today, AI can inform me it’s a dog chasing a chicken. The next stage is for it to comprehend that this is item I need to cognize correct now and create certain I get that data quickly adequate to act. Eventually, an intelligent residence power really be capable to do item concerning it, too.

That’s the astute residence I want. But we’re not there yet.

Photos and screenshots by Jennifer Pattison Tuohy / The Verge

Follow topics and authors from this narrative to see additional akin this in your personalized homepage nourish and to obtain email updates.

Other Article All About Technology by The Verge
↑
Close Right Ads
Close Left Ads