Which A.I assistant is smarter than the others? One company found the answer

Loup Ventures tests smart speakers and digital assistants each year to get a sense of their practical uses and to see who gets the highest score. This year’s tests are complete and the results are in. Once again, Google Assistant had the highest score, followed by, in order from highest to lowest, Siri, Alexa, and Cortana.

The test consists of 800 questions in five categories: Local knowledge, commerce, navigation, information, and commands. Each smart speaker has two scores: The number of questions correctly understood and the number of correct responses. The table below summarizes this year’s test results for smart speakers.

Loup Ventures differentiates between testing digital assistants on smart speakers and on smartphones. Google Assistant on Android phones and Siri on iPhones might have different relative scores than the same assistants on smart speakers.

Smart Speaker,
Voice Assistant
Answered Correctly Understood the Question
Google Home,
Google Assistant
87.9% 100%
Apple HomePod,
74.6% 99.6%
Amazon Echo (2nd Gen),
72.5% 99%
Harman Kardon Invoke,
Microsoft Cortana
63.4% 99.4%

Even though Google Home understood all 800 questions in the test, the other smart speakers weren’t far behind. The HomePod only misunderstood three questions, and the Invoke and Echo misunderstood five and eight questions, respectively.

Loup Ventures noted that most of the very few misunderstood questions contained proper names, such as towns or restaurants. From the perspective of understanding questions, therefore, you can safely assume these smart speakers will understand pretty much everything you ask or say to them. The smart speakers’ scores on giving correct responses varied significantly.

One area that drew the testers’ particular interest was how well the smart speakers answered questions related to commerce. Loup Ventures noted that while “conventional wisdom suggests Alexa would dominate, Google Assistant correctly answers more questions about product information and where to buy certain items than Amazon’s Alexa, which tended to offer items to purchase. To make the point, the testers gave the following example from the test.

  • Question: “How much would a manicure cost?”
  • Alexa: “The top search result for manicure is Beurer Electric Manicure & Pedicure Kit.

    It’s £59 on Amazon.

    Want to buy it?

  • Google Assistant: “On average, a basic manicure will cost you about £20.

    However, special types of manicures like acrylic, gel, shellac, and no-chip range from about £20 to £50 in price, depending on the salon.”

Loup Ventures also noted that because Apple HomePod and Google Home each have proprietary map data, their performance on questions about local topics and navigation stood “head and shoulders above the others.”

Editors’ Recommendations

Laser TagEnjoy a game of Laser Tag in the comfort of your own home. This pair of mini combat laser tag pistols are great fun and will keep you busy for hours as you run, hide, aim and shoot at your opponent. Tag your targets and score points, you have 3 lives each and it the first contender to lose all their lives loses. When a gun registers a hit from the other pistol, this means you lose a life. Makes a great gift or an ideal game for a party. These Laser Tag guns can easily attach to your keychain meaning you can carry it whilst on the move. These guns require 3xAG13 batteries (included) in each to operate.     - More Info

Laser TagLaser Tag 2. All LEDs are scarlet red 3. All LEDs flash upon impact Requires 6 x AA batteries (Not included) - More Info

Pretty Petals Gift TagDesigned to accompany the Pretty Petals Mini Vase, this Pretty Petal Gift Tag can be attached with a colourful ribbon. - More Info

Our crew neck, short sleeved men's t shirts are 100% premium cotton in a soft pre-shrunk jersey knit. Our women's t shirts are lighter weight 150g tees made with deluxe 30's soft style yarns for a soft feel." alt="Tag T Shirt" title="Tag T Shirt" width="150" height="150">Hashtag, you’re it. Combining childhood games with technology. T Shirt design reads: < you're it >Our crew neck, short sleeved men's t shirts are 100% premium cotton in a soft pre-shrunk jersey knit. Our women's t shirts are lighter weight 150g tees made with deluxe 30's soft style yarns for a soft feel. - More Info

Engraved Pet TagSince 1992 it's been mandatory for any dog in a public place to wear a collar with the owner's details on it.You could settle for a plain, boring collar and hand write your details on it or you could show everyone who's really top dog with our engraved pet tag!On one side of the circular tag is a silver paw print design overlaid on a sleek, black glittery background. Flip the tag over and there's room for four lines of your details. Our expert engravers will ensure your personal info is clear, readable and resistant to all-weathers.Make your dog the envy of owners and dogs alike with our Engraved Pet Tag. Also suitable for feline friends!Dimensions: 35mm(L) x 25mm(W) x 1mm(D). - More Info

You may also like...

Apps & Games Clothing Electronics & Photo Large Appliances
Baby Womens Apparel Garden Lighting
Beauty Mens Apparel Outdoors Luggage
Books Girls Apparel Health & Personal Care Pet Supplies
Car Boys Apparel Home Shoes & Bags
Motorbike Computers & Accessories Kitchen Equipment Sports & Outdoors
Fashion DIY & Tools Jewellery Toys & Games