• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'

3

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'

3

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
Commentary

A.I. Bias Isn’t the Problem. Our Society Is

By
Alex Salkever
Alex Salkever
and
Vivek Wadhwa
Vivek Wadhwa
Down Arrow Button Icon
By
Alex Salkever
Alex Salkever
and
Vivek Wadhwa
Vivek Wadhwa
Down Arrow Button Icon
April 14, 2019, 9:00 AM ET
People gather on April 16, 2018 to protest at a Starbucks in Philadelphia, where days earlier two black men were arrested.
Protesters gather on April 16, 2018 for ongoing protest at the Starbucks location in Center City Philadelphia, PA where days earlier two black men were arrested. Starbucks CEO Kevin Johnson apologized publicly after the arrest prompted controversy after video of the incident became viral. (Photo by Bastiaan Slabbers/NurPhoto via Getty Images)Bastiaan Slabbers—NurPhoto via Getty Images

On Wednesday, Sens. Ron Wyden and Cory Booker and Rep. Yvette Clarke introduced the Algorithmic Accountability Act, indicating policymakers’ increasing concern that artificial intelligence is magnifying human bias in tools such as facial recognition, self-driving cars, customer service, marketing, and content moderation.

While A.I. has incredible potential to improve our lives, the truth is that it is only capable of reflecting our societal problems right back at us. And because of that, we can’t trust it to make important decisions that are susceptible to human prejudice.

Even the most enlightened of humans have deep-seated biases. Difficult to identify, they are even harder to correct. Today’s A.I. learns by encoding patterns from the data that it feeds on. If you build an A.I. system designed to identify who is going to be a future convict, for example, the only data you can rely on is past data. Since the percentage of blacks in prison is higher and the percentage of whites in prison is lower than their respective shares of the U.S. population, a naive A.I. system will infer that a black person is more likely than a white person to commit a crime.

Such a system is unable to take into account all of the systemic biases that have ensured blacks’ relatively higher incarceration rates. And we currently don’t have data to train A.I. systems other than data that, though superficially objective, inherently expresses societal norms and biases.

Finding better data will be exceptionally hard. Even if we programmed an A.I. system to ignore race and use different measures when predicting future criminality, the results would likely come out the same. Consider the other attributes convicts might share: living in particular neighborhoods, coming from single-parent families, or not graduating from high school. All of these categories would essentially act as proxies for race, since machine learning cannot account for all their different interlinkages.

In this way, the current generation of artificial intelligence is smart like a savant, but has nothing close to the discriminating intelligence of a human.

A.I. shines in performing tasks that match patterns in order to obtain objective outcomes. Playing Go, driving a car on a street, and identifying a cancer lesion in a mammogram are excellent examples of narrow A.I. These systems can be incredibly helpful extensions of how humans work and are already surpassing us in discrete parts of jobs. A tumor is a tumor, regardless of whether it is in the body of an Asian or Caucasian. Able to base their judgements on objectively measurable data, these systems are readily correctible if and when interpretations of those data are subject to overhaul.

But, although an A.I. machine may best a human radiologist in spotting cancer, it will not, for many years to come, replicate the wisdom and perspective of the best human radiologists.

This is where A.I. presents its greatest risk: in softer tasks that may have objective outcomes but incorporate what we would normally call judgment. Some such tasks exercise much influence over people’s lives. Granting a mortgage, admitting a child to a university, awarding a felon parole, or deciding whether children should be separated from their birth parents due to suspicions of abuse fall into this category. Such judgments are highly susceptible to human biases—but they are biases that only humans themselves have the ability to detect.

Another failure of A.I. lies in its analysis and use of content. Services like YouTube have created algorithms to boost user engagement that identify the stickiest, most engaging content and promote it. Unfortunately, these algorithms were designed without a circuit breaker, and any human assessment of whether the toxic content promoted by these algorithms was good for society was a too-late afterthought.

Growing awareness of these risks, however, has not slowed the rapid weaving of algorithmic decision-making into the fabric of society. Today, the tech giants deploy A.I. to influence what we see, hear, buy—and even feel. The shift of the burden of discernment from people to machines is rapidly spreading into many other nooks—but under the guise of “optimization.”

It’s time to press pause. Perhaps in the future we can create systems that do an excellent job of utilizing data about our lives while excising bias. Until then, A.I. left unchecked is more of a risk than a benefit to society.

Alex Salkever is a consultant and technology executive researching the frontiers of technology. Vivek Wadhwa is a distinguished fellow at Carnegie Mellon University at Silicon Valley and Harvard Law School. Together, they authored The Driver in the Driverless Car: How Your Technology Choices Create the Future, which will be available in paperback in June 2019.

This article is commentary. For more opinion in Fortune, click here.

About the Authors
By Alex Salkever
See full bioRight Arrow Button Icon
By Vivek Wadhwa
See full bioRight Arrow Button Icon

Latest in Commentary

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Commentary

Elon Musk sits with his fists together, looking up.
Commentaryspace
SpaceX will be worth trillions, but the space station that made it possible is worth even more — if we don’t squander it
By Tejpaul BhatiaMay 20, 2026
9 hours ago
trader
CommentarySoftware
The 50-year-old law that governed every software company just broke. Here’s what replaces it
By Martin Casado and Abhishek NagarajMay 20, 2026
18 hours ago
FJ Campbell, MD, is chief medical officer at Ardent Health.
CommentaryHealth
A doctor shortage is coming. AI could be the only realistic fix
By FJ CampbellMay 20, 2026
20 hours ago
trump
CommentaryCongress
Milken-Harris Poll: 80% of Americans want AI workforce programs now — and Washington hasn’t delivered
By Karen Kornbluh and Libby RodneyMay 20, 2026
20 hours ago
‘Change the World’ idealism is dying in Silicon Valley. We’ll miss it when it’s gone
CommentarySilicon Valley
‘Change the World’ idealism is dying in Silicon Valley. We’ll miss it when it’s gone
By Jonathan WeberMay 19, 2026
2 days ago
reorgs
CommentaryRestructuring
We found the real reason 70% of transformations fail
By Julia Dhar, Kristy R. Ellmer and Philip JamesonMay 19, 2026
2 days ago

Most Popular

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
Workplace Culture
Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
By Preston ForeMay 19, 2026
1 day ago
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
Success
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
By Preston ForeMay 20, 2026
15 hours ago
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
Future of Work
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
By Mike Householder and The Associated PressMay 17, 2026
4 days ago
The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
Politics
The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
By Jake AngeloMay 12, 2026
8 days ago
Dr. Bernice King on why companies that walked back DEI were never truly committed: 'If you retreat that quick…that reveals who you really are'
Workplace Culture
Dr. Bernice King on why companies that walked back DEI were never truly committed: 'If you retreat that quick…that reveals who you really are'
By Preston ForeMay 19, 2026
1 day ago
Current price of oil as of May 20, 2026
Personal Finance
Current price of oil as of May 20, 2026
By Joseph HostetlerMay 20, 2026
17 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.