• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

3

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

3

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

Minneapolis street test: Google gets a B+, Apple’s Siri gets a D

By
Philip Elmer-DeWitt
Philip Elmer-DeWitt
Down Arrow Button Icon
By
Philip Elmer-DeWitt
Philip Elmer-DeWitt
Down Arrow Button Icon
June 29, 2012, 6:42 AM ET

FORTUNE — Pi


per Jaffray’s Gene Munster is nothing if not methodical. When customers queue up for a new Apple (AAPL) product, he’s the analyst who goes to the line and counts heads. When programmers gather at an Apple developers conference, he’ll stop three or four dozen to ask if they are writing apps for Mac, iPhone or Android devices.

So when he wanted to know how Siri stacked up against a Google (GOOG) search, he (or his staff) asked an iPhone 1,600 questions, 800 on the busy streets of Minneapolis, 800 in a quiet room.

Piper Jaffray published the results Thursday in a note to clients:

  • Google understands 100% of the questions (not surprisingly, since they are keyed in)
  • Google replies accurately 86% of the time
  • Siri comprehends 83% of queries in noisy conditions, 89% in a quiet room
  • Siri answers accurately 62% of the time on the street and 68% in a quiet room.

“In order to become a viable mobile search alternative,” Munster writes, “Siri must match or surpass Google’s accuracy of B+ and move from a grade D to a B or higher.”

He estimates that Siri is more than two years behind Google in its learning curve, but he’s optimistic: “With the iOS 6 release in the fall, we expect Siri to improve meaningfully while reducing its reliance on Google from 60% to 48%.”

Given the results, however, it’s not clear that reducing Siri’s reliance on Google is necessarily a good thing.

Currently Siri gets 60% of its answers from Google, 20% from Yelp, 14% from WolframAlpha, 4% from Yahoo and 2% from Wikipedia.

“Breaking down Siri’s reliance further,” Munster writes, “Google provides 100% of navigation results, 61% of information results, 48% of commerce results and 42% of local results. Among other result aggregators, Yelp provided the most local results (51%) and commerce results (51%), while WolframAlpha provided 34% of information results.”

Starting in the fall, Apple’s in-house maps will eliminate its reliance on Google for navigation and the integration of  Yahoo Sports, Open Table, Rotten Tomatoes and Fandango will provide answers for sports scores and statistics, restaurant reservations, movie show times and ticket purchases.

Breaking down the type of errors Siri makes, Munster provides some sample questions that demonstrate how far it has to go:

  • What team does Peyton Manning play for? Responded with the answer to the previous query. This was the most common error.
  • Where is Elvis buried? Responded I can’t answer that for you. It thought the persons name was Elvis Buried.
  • Where am I? Pin dropped in the wrong place.
  • When did the movie Cinderella come out? Responded with a movie theater search on Yelp.
  • How do I get from Boston to New York? Responded I can only give directions from your current location. I cant give you directions to a place you are not in.
  • What spices are in Lasagna? Responded with a Yelp search with lasagna on the menu.
  • When is the next Haley’s comment? Responded “You have no meetings matching Haley’s”
  • I want to go to Lake Superior? Responded with directions to the company Lake Superior X-Ray.

Those responses would make a terrific TV ad. For Google.

About the Author
By Philip Elmer-DeWitt
See full bioRight Arrow Button Icon

Latest in

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in

Xbox CEO Asha Sharma
SuccessCareers
Xbox’s CEO spent her early career taking out trash and selling coupon books—she says the secret to her rise was never obsessing over a dream career
By Preston ForeJune 10, 2026
2 hours ago
Boris Cherny, Head of Claude Code
SuccessHiring
The architect behind Claude Code reveals the three things Anthropic looks for in a good hire—and why people with low ego are a must
By Emma BurleighJune 10, 2026
2 hours ago
Meryl Streep says she was ‘ready to retire’ when the call for ‘Devil Wears Prada 2’ came—so she demanded they double her salary or nothing
SuccessThe Promotion Playbook
Meryl Streep says she was ‘ready to retire’ when the call for ‘Devil Wears Prada 2’ came—so she demanded they double her salary or nothing
By Orianna Rosa RoyleJune 10, 2026
3 hours ago
Trump sits at the Resolute Desk with his hands folded
AIImmigration
OpenAI and Nvidia CEOs didn’t flinch at Trump’s $100,000 H-1B visa fee, and now they’re paying up as their application numbers soar
By Jacqueline MunisJune 10, 2026
3 hours ago
knicks
SuccessNew York
‘Knicks in 6. 2026 NBA Finals’: Why did this New Yorker make a prophecy in his 2020 high school yearbook?
By Philip Marcelo and The Associated PressJune 10, 2026
3 hours ago
platner
PoliticsElections
Graham Platner easily prevails over attempts to derail progressive Senate candidacy in Maine
By Patrick Whittle, Kimberlee Kruesi and The Associated PressJune 10, 2026
3 hours ago

Most Popular

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
Asia
Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
By Kate O'Keeffe and BloombergJune 8, 2026
2 days ago
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
Economy
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
By Nick LichtenbergJune 9, 2026
1 day ago
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
Success
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
By Preston ForeJune 8, 2026
2 days ago
Current price of oil as of June 9, 2026
Personal Finance
Current price of oil as of June 9, 2026
By Joseph HostetlerJune 9, 2026
1 day ago
Current price of silver as of Tuesday, June 9, 2026
Personal Finance
Current price of silver as of Tuesday, June 9, 2026
By Joseph HostetlerJune 9, 2026
1 day ago
Wall Street dumped nearly $1 trillion in tech stocks by midday—then clawed it back and bought peanut butter and paint
Investing
Wall Street dumped nearly $1 trillion in tech stocks by midday—then clawed it back and bought peanut butter and paint
By Eva RoytburgJune 9, 2026
19 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.