• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock

2

‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion

3

OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation

1

Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock

2

‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion

3

OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
TechGoogle

Google’s new ‘multisearch’ tool lets online shoppers browse for hot new items by searching both images and text

By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
April 7, 2022, 9:00 AM ET
Add Fortune on Google for similar content.

Google believes that online shoppers are looking for more compelling ways to discover new items to stock their wardrobes, and so is trialing a beta version of an upgraded search function that lets consumers use both images and text to browse for chic new outfits and accessories.

The Alphabet-owned search giant debuted the new feature, called multisearch, on Thursday, making it available for English-language users in the U.S. Unlike Google search, which can handle only either written or visual search prompts, multisearch allows users to perform search queries using images and text at the same time.

The idea is that multisearch will help people more accurately search for items they may have trouble describing, like a version of a certain shoe style they like but in a different color from what they have. The search tool can be used to find items other than clothes, but seems particularly suited for fashion.

Beta users can access the feature using the Google Lens icon located on the far right of Google’s core search bar in the Google smartphone app, on both iPhones and Android devices. After the Lens icon is activated, people can snap a photo of their favorite jeans, for instance, and retrieve a list of similar-looking jeans on sale across various third-party websites. 

People can further refine their search queries by swiping up and clicking the field that says, “Add to your search.” There they can add text like the word “blue,” which will prompt Google to display a list of blue jeans that look similar to the original photo.

Google says the new feature works for screenshots as well, so if people screenshot a photo of an orange dress found on the web, they can then query the word “green” to find green variants of the dress, according to a blog post about the multisearch feature.

Currently the multisearch feature directs users to shopping results, which a Google spokesperson told Fortune is because the company has seen “high user interest” from online shoppers about using visual searches to find new items. 

Google competitors, like Meta’s Instagram and Pinterest, have recently debuted compelling features that help consumers buy goods they see in photos, too, underscoring how consumer tech companies try to cater to users who scour the internet like they are window-shopping.

Google touts that its new multisearch feature is powered by the company’s advanced artificial intelligence (A.I.) search algorithms. It is also researching how the company’s other A.I. technology, the Multitask Unified Model (MUM), can further improve multisearch.

MUM is an example of a type of A.I. software called multimodal A.I., which is rising in popularity with researchers. These multimodal A.I. systems are able to analyze and find patterns within datasets that contain both images and text. 

For instance, this week the A.I. company OpenAI debuted its DALL-E 2 software for researchers, which incorporates multimodal techniques to perform feats like automatically generating images based on text prompts. As my Fortune colleague Jeremy Kahn explained, “All a user has to do is type the command ‘a shiba inu wearing a beret and a black turtleneck,’ and DALL-E 2 spits out dozens of photorealistic variations on that theme.”

As researchers continue to make major advancements in A.I., expect tech companies like Google and OpenAI to incorporate them into products.

Never miss a story: Follow your favorite topics and authors to get a personalized email with the journalism that matters most to you.

About the Author
By Jonathan Vanian
LinkedIn iconTwitter icon

Jonathan Vanian is a former Fortune reporter. He covered business technology, cybersecurity, artificial intelligence, data privacy, and other topics.

See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

Latest in Tech

t
AIMarkets
Billionaire Mike Bloomberg warns Trump’s AI ownership plan would make ‘George Orwell blush’
By Eva RoytburgJuly 21, 2026
6 hours ago
U.N. reports Southeast Asia’s criminal networks are using tech to build a global illicit economy
AsiaTech
U.N. reports Southeast Asia’s criminal networks are using tech to build a global illicit economy
By The Associated PressJuly 21, 2026
6 hours ago
Anthropic to pay authors $1.5 billion over pirated books used to train Claude in first major AI copyright settlement
LawAnthropic
Anthropic to pay authors $1.5 billion over pirated books used to train Claude in first major AI copyright settlement
By The Associated PressJuly 21, 2026
6 hours ago
kid lying down on phone
PoliticsSocial Media
Lawmakers say they’re protecting kids—but their age checks are quietly building an ID requirement for the entire internet
By Catherina GioinoJuly 21, 2026
6 hours ago
holland
Arts & EntertainmentMovies
‘The audience is telling the industry something’: even IMAX is stunned by Christopher Nolan’s runaway ‘Odyssey’
By Tatiana SatauaJuly 21, 2026
8 hours ago
OpenAI CEO Sam Altman looking up.
CybersecurityOpenAI
OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
By Jeremy Kahn and Emily ForliniJuly 21, 2026
8 hours ago

Most Popular

Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock
Success
Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock
By Sasha RogelbergJuly 20, 2026
1 day ago
‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion
Success
‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion
By Sydney LakeJuly 20, 2026
2 days ago
OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
Cybersecurity
OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
By Jeremy Kahn and Emily ForliniJuly 21, 2026
8 hours ago
'Dr. Doom' Nouriel Roubini says we're headed for universal basic income or 'some form of socialism' as AI revolutionizes work—He calls that optimistic
AI
'Dr. Doom' Nouriel Roubini says we're headed for universal basic income or 'some form of socialism' as AI revolutionizes work—He calls that optimistic
By Jason MaJuly 18, 2026
3 days ago
Mathematicians grapple with a ‘very rapid and very unsettling change’ as AI cracks yet another century-old problem
AI
Mathematicians grapple with a ‘very rapid and very unsettling change’ as AI cracks yet another century-old problem
By Eva RoytburgJuly 21, 2026
11 hours ago
Despite a $156 million contract, Knicks star Jalen Brunson still calls his parents for financial advice any time he makes a big purchase
Success
Despite a $156 million contract, Knicks star Jalen Brunson still calls his parents for financial advice any time he makes a big purchase
By Emma BurleighJuly 21, 2026
12 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.