• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

New

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

Watch Fortune Daily, our new video show that brings you inside the Fortune newsroom and the boardroom

MPWAmazon

Amazon Reportedly Killed an AI Recruitment System Because It Couldn’t Stop the Tool from Discriminating Against Women

By
David Meyer
David Meyer
Down Arrow Button Icon
By
David Meyer
David Meyer
Down Arrow Button Icon
October 10, 2018, 6:00 AM ET
Add Fortune on Google for similar content.

Machine learning, one of the core techniques in the field of artificial intelligence, involves teaching automated systems to devise new ways of doing things, by feeding them reams of data about the subject at hand. One of the big fears here is that biases in that data will simply be reinforced in the AI systems—and Amazon seems to have just provided an excellent example of that phenomenon.

According to a new Reuters report, Amazon spent years working on a system for automating the recruitment process. The idea was for this AI-powered system to be able to look at a collection of resumes and name the top candidates. To achieve this, Amazon fed the system a decade’s worth of resumes from people applying for jobs at Amazon.

The tech industry is famously male-dominated and, accordingly, most of those resumes came from men. So, trained on that selection of information, the recruitment system began to favor men over women.

According to Reuters’ sources, Amazon’s system taught itself to downgrade resumes with the word “women’s” in them, and to assign lower scores to graduates of two women-only colleges. Meanwhile, it decided that words such as “executed” and “captured,” which are apparently deployed more often in the resumes of male engineers, suggested the candidate should be ranked more highly.

The team tried to stop the system from taking such factors into account, but ultimately decided that it was impossible to stop it from finding new ways to discriminate against female candidates. There were apparently also issues with the underlying data that led the system to spit out rather random recommendations.

And so, Amazon reportedly killed the project at the start of 2017.

“This was never used by Amazon recruiters to evaluate candidates,” Amazon said in a statement.

Amazon isn’t the only company to be alert to the problem of algorithmic bias. Earlier this year, Facebook said it was testing a tool called Fairness Flow, for spotting racial, gender or age biases in machine-learning algorithms. And what was the first target for Facebook’s tests of the new tool? Its algorithm for matching job-seekers with companies advertising positions.

This article was updated to include Amazon’s statement.

About the Author
By David Meyer
LinkedIn icon
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in MPW

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

Latest in MPW

Fidji Simo had to leave OpenAI. But she’s still building a business that could find cures to chronic diseases that affect women like her
NewslettersMPW Daily
Fidji Simo had to leave OpenAI. But she’s still building a business that could find cures to chronic diseases that affect women like her
By Emma HinchliffeAugust 4, 2026
6 hours ago
Most billionaires are stuck in ‘slow philanthropy.’ MacKenzie Scott gave away $26 billion and won’t stop until ‘the safe is empty’
SuccessMacKenzie Scott
Most billionaires are stuck in ‘slow philanthropy.’ MacKenzie Scott gave away $26 billion and won’t stop until ‘the safe is empty’
By Sydney LakeAugust 2, 2026
3 days ago
A person walks alone in a public plaza
North Americapublic policy
Bars, bowling alleys, and movie theaters cost too much to run and visit. Americans have run out of places to hang out and we’re paying with our health
By Catherina GioinoAugust 2, 2026
3 days ago
n
North AmericaTaxes
Gavin Newsom has been earning up to $2 million per year since 2022, records show
By Sophie Austin and The Associated PressAugust 1, 2026
3 days ago
israel
North AmericaIsrael
Most Jewish Americans under 45 get the ick from Israel, polling shows
By Giovanna Dell'Orto and The Associated PressJuly 31, 2026
4 days ago
Meet the jet-setting fashion editor who turned a New York manicure at 23 into Nails.Inc—Despite selling for $40 million, she still wakes at 5:45 a.m.
SuccessFortune The Good Life
Meet the jet-setting fashion editor who turned a New York manicure at 23 into Nails.Inc—Despite selling for $40 million, she still wakes at 5:45 a.m.
By Orianna Rosa RoyleJuly 31, 2026
5 days ago

Most Popular

How Zohran Mamdani's pied-à-terre tax exposed an epidemic of 'ghost cars' instead
Personal Finance
How Zohran Mamdani's pied-à-terre tax exposed an epidemic of 'ghost cars' instead
By Catherina GioinoAugust 4, 2026
16 hours ago
Bars, bowling alleys, and movie theaters cost too much to run and visit. Americans have run out of places to hang out and we're paying with our health
North America
Bars, bowling alleys, and movie theaters cost too much to run and visit. Americans have run out of places to hang out and we're paying with our health
By Catherina GioinoAugust 2, 2026
3 days ago
Ray Dalio on the AI bubble nearing 1929, 2000 levels and the lesson people always forget: 'Wealth is not the same as money'
Investing
Ray Dalio on the AI bubble nearing 1929, 2000 levels and the lesson people always forget: 'Wealth is not the same as money'
By Nick LichtenbergAugust 4, 2026
16 hours ago
Wall Street bulls are starting to admit the earnings bubble is real—and the 60/40 portfolio may be the first casualty
Investing
Wall Street bulls are starting to admit the earnings bubble is real—and the 60/40 portfolio may be the first casualty
By Nick LichtenbergAugust 3, 2026
1 day ago
Electric air taxis are finally ready for takeoff
Magazine
Electric air taxis are finally ready for takeoff
By Alexei OreskovicAugust 3, 2026
2 days ago
The Iran war already has a winner: The world’s largest shipbroker notching record earnings from the 'exceptional volatility' in the Strait of Hormuz
Energy
The Iran war already has a winner: The world’s largest shipbroker notching record earnings from the 'exceptional volatility' in the Strait of Hormuz
By Sasha RogelbergAugust 3, 2026
1 day ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.