• Home
  • News
  • Fortune 500
  • Tech
  • Finance
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechGoogle

Google Images Adds More Artificial Intelligence to Improve its Vision

By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
October 25, 2018, 9:00 AM ET

Google Images is getting a big upgrade that is based on artificial intelligence.

Google said Thursday that it started introducing a new feature for smartphone users that lets them search for specific objects within photos, like a flower bouquet in a wedding portrait. All users have to do is trace a finger around that bouquet to find similar looking bouquets that could be linked to outside sources like floral sites and interior design blogs.

It’s part of a broader initiative by Google to develop more ways for people to search for information beyond entering words and text into the company’s core search engine, explained Google Images engineering head Cathy Edwards.

The revamped Google Images is now powered by the company’s Lens technology that it unveiled in 2017 and embedded in products like its Google Photos mobile phone app that people use to store their digital photos. The Lens technology, derived from the company’s various deep learning projects that teach computers to recognize objects in photos, can tell people what breed of dog their beloved pooch may be by scanning their pet photos.

Now Google has added Lens technology to Google Images to make it easier for people to search for specific images, Edwards explained.

Users will now see a small lens-shaped icon below the photos they chose to access from Google Images. Pressing the lens icon triggers several smaller dots to appear over objects in the photo that the tech recognizes, and touching one of those overlaid dots will produce other similar photos of the objects from around the web.

People can also use their fingers to trace over areas within photos that contain objects they want the tech to recognize and scour the web for. If users search for Oscar dresses, for instance, they can use their fingers to circle an actress’ shoes, which should retrieve images of similar looking footwear.

The goal is to give Google Images users something else to do besides merely stare at the photos that happen to show up in a search query. It’s also a way to try to keep Google Images competitive amid the rise of social photo sites like Facebook’s Instagram and Pinterest, both of which created ways for people to do more things when perusing their services, like visiting retail sites that may sell sneakers shown in certain photos.

Some users consult Google Images for ideas about do-it-yourself home projects, while others want to see photos of car engines to help with their auto repairs, Edwards said.

“We have an enormous number of queries for people who want to fix their cars and they want to identify car parts,” she said.

Although the new feature should be able to identify basic objects in photos, over time it should be able to identify more advanced things like specific types of flowers and noteworthy landmarks, she said. The new feature, however, won’t work with controversial content like pornography, she explained.

Still, adding more features to Google Images opens the company up to potential problems with its AI technologies. In 2015, for instance, Google Photos was heavily criticized for labeling African-Americans as gorillas, underscoring problems with artificial intelligence understanding what’s in a photo and inadvertent bias in the data used to train the technology.

Get Data Sheet, Fortune’s technology newsletter.

Edwards said that the company has been testing the latest feature for bias, and is using artificial intelligence technology to potentially mitigate problems. The new product is rolling out first in the U.S. and later overseas to work out any potential hiccups.

About the Author
By Jonathan Vanian
LinkedIn iconTwitter icon

Jonathan Vanian is a former Fortune reporter. He covered business technology, cybersecurity, artificial intelligence, data privacy, and other topics.

See full bioRight Arrow Button Icon

Latest in Tech

Big TechSpotify
Spotify users lamented Wrapped in 2024. This year, the company brought back an old favorite and made it less about AI
By Dave Lozo and Morning BrewDecember 4, 2025
8 hours ago
InnovationVenture Capital
This Khosla Ventures–backed startup is using AI to personalize cancer care
By Allie GarfinkleDecember 4, 2025
12 hours ago
AIEye on AI
Companies are increasingly falling victim to AI impersonation scams. This startup just raised $28M to stop deepfakes in real time
By Sharon GoldmanDecember 4, 2025
13 hours ago
Jensen Huang
SuccessBillionaires
Nvidia CEO Jensen Huang admits he works 7 days a week, including holidays, in a constant ‘state of anxiety’ out of fear of going bankrupt
By Jessica CoacciDecember 4, 2025
13 hours ago
Ted Pick
BankingData centers
Morgan Stanley considers offloading some of its data-center exposure
By Esteban Duarte, Paula Seligson, Davide Scigliuzzo and BloombergDecember 4, 2025
13 hours ago
Zuckerberg
EnergyMeta
Meta’s Zuckerberg plans deep cuts for metaverse efforts
By Kurt Wagner and BloombergDecember 4, 2025
13 hours ago

Most Popular

placeholder alt text
Economy
Two months into the new fiscal year and the U.S. government is already spending more than $10 billion a week servicing national debt
By Eleanor PringleDecember 4, 2025
18 hours ago
placeholder alt text
Success
‘Godfather of AI’ says Bill Gates and Elon Musk are right about the future of work—but he predicts mass unemployment is on its way
By Preston ForeDecember 4, 2025
14 hours ago
placeholder alt text
North America
Jeff Bezos and Lauren Sánchez Bezos commit $102.5 million to organizations combating homelessness across the U.S.: ‘This is just the beginning’
By Sydney LakeDecember 2, 2025
3 days ago
placeholder alt text
Success
Nearly 4 million new manufacturing jobs are coming to America as boomers retire—but it's the one trade job Gen Z doesn't want
By Emma BurleighDecember 4, 2025
14 hours ago
placeholder alt text
Success
Nvidia CEO Jensen Huang admits he works 7 days a week, including holidays, in a constant 'state of anxiety' out of fear of going bankrupt
By Jessica CoacciDecember 4, 2025
13 hours ago
placeholder alt text
Health
Bill Gates decries ‘significant reversal in child deaths’ as nearly 5 million kids will die before they turn 5 this year
By Nick LichtenbergDecember 4, 2025
1 day ago
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.