• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Elon Musk on MacKenzie Scott giving away $26 billion of her fortune: 'Sadly,' it makes the world a worse place

2

MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year

3

Philanthropy leader at Warren Buffett and Bill Gates’ Giving Pledge says children of billionaires are pushing them to give their wealth away faster

1

Elon Musk on MacKenzie Scott giving away $26 billion of her fortune: 'Sadly,' it makes the world a worse place

2

MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year

3

Philanthropy leader at Warren Buffett and Bill Gates’ Giving Pledge says children of billionaires are pushing them to give their wealth away faster
TechPointCloud

Google Can Teach Your Robot to Recognize You (and Your Mood)

Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
December 2, 2015, 3:30 PM ET
Google
Add Fortune on Google for similar content.

Imagine a Roomba robot that not only recognizes you as you but can tell from the scowl on your face that now may not be the best time to vacuum around your feet.

That’s the scenario enabled by a new Google tool that will let developers train robots, toys, and appliances to know who you are and even figure out from your expression what mood you’re in—and react accordingly.

Google (GOOG) detailed the technology in a blog post on Wednesday. A test version of the Vision Application Programming Interface is now available to developers.

At its most basic, this API will let developers build software that can interact with Google cloud-based smarts in near-real-time. In theory, that Roomba-of-the-future may see you in the room, send your image to Google computers to get information about it. Or it could be trained over time by reviewing many images to know that you are you and that a smile means you’re in a good mood and that a grimace means trouble. It would also know that the big fur ball over there is a cat and not a fuzzy slipper.

With the API, developers can apply tons of machine learning smarts to home or work applications. Machine learning, once known as artificial intelligence, is when computers learn over time from data they view to recognize people, things, words—just about anything.

All of that grunt work is enabled by the massive compute power of Google or Microsoft (MSFT) or Amazon (AMZN) public clouds, which harness a huge number of shared computers around the world. With all that firepower, the data can be crunched, parsed and served up as needed. To tell your vacuum cleaner who you are and that you may be in a crappy mood, for example.

Last month Google released TensorFlow, an artificial intelligence engine that can process images and sounds so it can recognize them later. Days later, Microsoft talked up new Project Oxford computer vision capabilities that will let computers gauge a person’s emotional state—anger, contempt, fear, disgust, happiness, sadness, surprise —from her facial expressions. (An earlier iteration could estimate a person’s age from her image.)

googleapi2

This technology could also be used by parents or businesses to quickly flag objectionable or inappropriate images before kids see them or to identify corporate logos to better hone searches for shoppers.

The good news is this could mean a new generation of smarter, more capable products and services. The bad news is that some of us may be creeped out by all of that stuff.

For more on what the tech can do, check out the Google video below:

[youtube https://www.youtube.com/watch?v=eve8DkkVdhI&w=560&h=315]

And for more on machine learning/artificial intelligence, check out Fortune’s video

For more from Barb, follow her on Twitter at @gigabarb, read her coverage at fortune.com/barb-darrow or subscribe via this RSS feed.

And please subscribe to Data Sheet, Fortune’s daily newsletter on the business of technology.

About the Author
Barb Darrow
By Barb Darrow
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Brown University Professor Roberto Serrano, a man in a suit holding onto a gold trophy--the King Of Spain Economy Award"-- before Spain's King Felipe and a painted wall.
AIEducation
‘Humanity has chosen to become idiots’: This Brown professor switched to take-home exams after a mass shooting and discovered mass cheating
By Catherina GioinoJune 29, 2026
9 hours ago
bis
EconomyMarkets
The central bank of central banks just released its flagship annual report — and it sees a $1 trillion AI investment boom headed for a reckoning
By Nick LichtenbergJune 29, 2026
9 hours ago
paralegal
AIdisruption
The most reassuring argument about AI and jobs quietly explains why Gen Z can’t get one
By Nick LichtenbergJune 29, 2026
13 hours ago
This summer’s heat is a live stress test for data centers—here’s what it’s revealing in real time
AIData centers
This summer’s heat is a live stress test for data centers—here’s what it’s revealing in real time
By Tristan BoveJune 29, 2026
13 hours ago
Photo of Jim Farley
AIAutos
Ford on why it hired 350 ‘gray beard’ engineers: you need their mentorship for younger workers — and to drive huge AI productivity gains
By Sasha RogelbergJune 29, 2026
14 hours ago
‘Cop on your wrist’: Wearables offer tons of data, but people are still going to sleep to Netflix and TikTok
HealthBrainstorm Tech
‘Cop on your wrist’: Wearables offer tons of data, but people are still going to sleep to Netflix and TikTok
By Amanda GerutJune 29, 2026
14 hours ago

Most Popular

Elon Musk on MacKenzie Scott giving away $26 billion of her fortune: 'Sadly,' it makes the world a worse place
Success
Elon Musk on MacKenzie Scott giving away $26 billion of her fortune: 'Sadly,' it makes the world a worse place
By Sydney LakeJune 29, 2026
16 hours ago
MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year
Success
MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year
By Sydney LakeJune 25, 2026
5 days ago
Philanthropy leader at Warren Buffett and Bill Gates’ Giving Pledge says children of billionaires are pushing them to give their wealth away faster
Success
Philanthropy leader at Warren Buffett and Bill Gates’ Giving Pledge says children of billionaires are pushing them to give their wealth away faster
By Preston ForeJune 27, 2026
3 days ago
The retired college professor fighting a $313 trespassing ticket in Wisconsin thinks he's part of a national struggle
Environment
The retired college professor fighting a $313 trespassing ticket in Wisconsin thinks he's part of a national struggle
By Catherina GioinoJune 28, 2026
2 days ago
Cristiano Ronaldo is soccer's first-ever billionaire: He went from begging for burgers outside McDonald's to landing a $400 million contract
Success
Cristiano Ronaldo is soccer's first-ever billionaire: He went from begging for burgers outside McDonald's to landing a $400 million contract
By Preston ForeJune 28, 2026
2 days ago
Ex-Google engineer says Larry Page, Sergey Brin and Sundar Pichai share the same trait—it's the lesson he swears by as a $7.2 billion AI CEO
Success
Ex-Google engineer says Larry Page, Sergey Brin and Sundar Pichai share the same trait—it's the lesson he swears by as a $7.2 billion AI CEO
By Orianna Rosa RoyleJune 28, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.