November 22, 2024
Google vs. Siri: A 1600 Question Comparison

Google vs. Siri: A 1600 Question Comparison

Posted June 29, 2012 at 2:51pm by iClarified
Piper Jaffray's Gene Munster asked an iPhone 1,600 questions, 800 on the busy streets of Minneapolis, 800 in a quiet room, in order to compare the performance of Google vs. Siri, reports FORTUNE.

Analyzing the results, Munster estimated that Siri is more than two years behind Google giving it a grade D compared to B+ for Google.

Notably, Siri uses Google to answer 60% of its queries. The rest of the answers are divided as follows: 20% of from Yelp, 14% from WolframAlpha, 4% from Yahoo and 2% from Wikipedia.


"Breaking down Siri's reliance further," Munster writes, "Google provides 100% of navigation results, 61% of information results, 48% of commerce results and 42% of local results. Among other result aggregators, Yelp provided the most local results (51%) and commerce results (51%), while WolframAlpha provided 34% of information results."

RESULTS:
● Google understands 100% of the questions (not surprisingly, since they are keyed in)
● Google replies accurately 86% of the time
● Siri comprehends 83% of queries in noisy conditions, 89% in a quiet room
● Siri answers accurately 62% of the time on the street and 68% in a quiet room.

COMMON SIRI MISTAKES:
What team does Peyton Manning play for? Responded with the answer to the previous query. This was the most common error.
Where is Elvis buried? Responded I can't answer that for you. It thought the persons name was Elvis Buried.
Where am I? Pin dropped in the wrong place.
When did the movie Cinderella come out? Responded with a movie theater search on Yelp.
How do I get from Boston to New York? Responded I can only give directions from your current location. I cant give you directions to a place you are not in.
What spices are in Lasagna? Responded with a Yelp search with lasagna on the menu.
When is the next Haley's comment? Responded "You have no meetings matching Haley's"
I want to go to Lake Superior? Responded with directions to the company Lake Superior X-Ray.

Read More



Google vs. Siri: A 1600 Question Comparison
Add Comment
Would you like to be notified when someone replies or adds a new comment?
Yes (All Threads)
Yes (This Thread Only)
No
iClarified Icon
Notifications
Would you like to be notified when we post a new Apple news article or tutorial?
Yes
No
Comments (10)
You must login or register to add a comment...
C.A.
C.A. - July 1, 2012 at 3:18am
Are they testing Siri on iOS 5.1.1 or 6.0 ? It's gotten better with the new iOS.
Tames
Tames - July 1, 2012 at 6:18pm
It's not out yet.
Tames
Tames - June 30, 2012 at 11:02am
Idk what I'm talking about
NoGoodNick
NoGoodNick - June 30, 2012 at 4:52am
Without seeing the kind of questions asked (not just the ones that Siri failed), it's impossible to evaluate this test. Siri's biggest problem, aside from having to transmit the questions to be translated before answering, is it's overreliance on commerial answers (see the "movie question").
Vin
Vin - June 30, 2012 at 2:19am
So this is comparing Siri to typing on google ? Apples and Oranges. Who cares. I'd expect google to win. Who wouldn't ?
Tames
Tames - June 30, 2012 at 1:10am
Siri was listed as Beta when it first came out. I don't know why anyone would or could judge its functionality yet.
kongkeahoun
kongkeahoun - June 29, 2012 at 9:57pm
Really Siri doesn't answer the true location.
James
James - June 29, 2012 at 9:23pm
When is the next Haley's comment? what is a Haley's comment? Even I don't understand that question. hahahaha fail.
Frank
Frank - June 29, 2012 at 2:59pm
Duh?
joyz
joyz - June 29, 2012 at 4:32pm
Ermm wasn't them 2years spent as BETA? And no doubt the test were conducted whilst in beta...
Recent. Read the latest Apple News.
RECENT
Tutorials. Help is here.
TUTORIALS
Where to Download macOS Sequoia
Where to Download macOS Ventura
AppleTV Firmware Download Locations
Where To Download iPad Firmware Files From
Where To Download iPhone Firmware Files From
Deals. Save on Apple devices and accessories.
DEALS