• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
NewslettersBrainstorm Health

A Major Healthcare A.I. Has a Serious Racial Bias: Brainstorm Health

By
Sy Mukherjee
Sy Mukherjee
Down Arrow Button Icon
By
Sy Mukherjee
Sy Mukherjee
Down Arrow Button Icon
October 24, 2019, 5:48 PM ET

Good afternoon, readers.

Algorithms can be racist—seriously. Biases are often built into programs which then carry out what their programmers (perhaps innocently and unwittingly) build into the code.

But that’s a major problem in an increasingly digital world, intentions aside. And it’s especially problematic in the healthcare arena.

Unfortunately, a new study published in the journal Science finds that an unnamed, but widely-used, A.I. algorithm meant to manage population health fell prey to these very problems. The program is meant to analyze health risks across wide populations, specifically for chronically ill patients who may require an extra level of care.

But the underlying metrics used to calculate these risks were questionable. And they had the broader effect of discriminating against people based on race, particularly black Americans.

“We show that a widely used algorithm, typical of this industry-wide approach and affecting millions of patients, exhibits significant racial bias: At a given risk score, Black patients are considerably sicker than White patients, as evidenced by signs of uncontrolled illnesses,” wrote the study authors. “Remedying this disparity would increase the percentage of Black patients receiving additional help from 17.7 to 46.5%.”

Read on for the day’s news.

Sy Mukherjee, @the_sy_guy, sayak.mukherjee@fortune.com

DIGITAL HEALTH

Viz.ai raises $50 million for A.I.-fueled stroke diagnostics. Digital health firm Viz.ai has raised $50 million from partners including GV, Kleiner Perkins, Threshold Ventures, and Greenoaks in order to build up its A.I.-fueled stroke detection platform. The company's tech is used to sniff out suspected cases of a certain kind of stroke by analyzing CT scans. (Reuters)

INDICATIONS

Vertex, British drug watchdog finally reach an agreement. The wins keep coming for Vertex Pharmaceuticals this week. First, the company won a major approval for its cystic fibrosis combo therapy Trikafta, which could potentially treat 90% of patients with the rare disorder. Now, the U.K.'s hard-nosed drug pricing/value watchdog has come to an agreement over three of Vertex's other cystic fibrosis drugs, making them available on the market. The agency had initially deemed the treatments to not be cost-effective. (PharmaTimes)

THE BIG PICTURE

CVS to pull certain J&J baby powder from the shelves. Pharmacy chains CVS and Rite Aid are yanking certain Johnson & Johnson baby powder products from their shelves following the drug giant's voluntary recall (related to asbestos concerns. "CVS Pharmacy is complying with Johnson & Johnson’s voluntary recall of Johnson’s Baby Powder 22 oz. and is removing this product from all stores and from CVS.com," CVS said in a statement. "We also initiated a ‘Do Not Sell’ register prompt in our stores to prevent the sale of this item during the product removal process." (CNBC)

REQUIRED READING

What's Next for Google After Claiming 'Quantum Supremacy'? by Robert Hackett

How Tesla Made More Profit from Less Revenue, by David Z. Morris

You Might Have to Pay for Gmail. You Always Did, by Aaron Pressman

Another Wrinkle Emerges in the WeWork Saga, by Erik Sherman

Find past coverage. Sign up for other Fortune newsletters.

About the Author
By Sy Mukherjee
See full bioRight Arrow Button Icon

Latest in Newsletters

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Newsletters

She learned accounting before she was a teenager. Now she’s bringing Wall Street to the blockchain
NewslettersMPW Daily
She learned accounting before she was a teenager. Now she’s bringing Wall Street to the blockchain
By Sheryl EstradaApril 17, 2026
14 hours ago
Meet the crypto guru to the Fortune 500
NewslettersCFO Daily
Meet the crypto guru to the Fortune 500
By Sheryl EstradaApril 17, 2026
16 hours ago
The startup Blackstone just backed to turn any exec’s data question into instant answers
NewslettersTerm Sheet
The startup Blackstone just backed to turn any exec’s data question into instant answers
By Allie GarfinkleApril 17, 2026
20 hours ago
The first wave of bank earnings shows why ‘resilience’ is Wall Street’s favorite word
NewslettersCEO Daily
The first wave of bank earnings shows why ‘resilience’ is Wall Street’s favorite word
By Diane BradyApril 17, 2026
20 hours ago
Netflix cofounder and chairman Reed Hastings on July 10, 2025 in Sun Valley, Idaho. (Photo: Kevin Dietsch/Getty Images)
NewslettersFortune Tech
End of an era: Reed Hastings steps down from Netflix
By Andrew NuscaApril 17, 2026
20 hours ago
An AI protest
NewslettersEye on AI
Anti-AI sentiment is on the rise—and it’s starting to turn violent
By Beatrice NolanApril 16, 2026
1 day ago

Most Popular

Pope Leo warned the world is in ‘big trouble’ if Elon Musk becomes the first trillionaire
Success
Pope Leo warned the world is in ‘big trouble’ if Elon Musk becomes the first trillionaire
By Preston ForeApril 17, 2026
19 hours ago
A world going broke: IMF says America's $39 trillion national debt is actually a global problem—and AI may be the only rescue
Economy
A world going broke: IMF says America's $39 trillion national debt is actually a global problem—and AI may be the only rescue
By Nick LichtenbergApril 16, 2026
1 day ago
Jeff Bezos pledged $10 billion for climate change. With the 2030 clock ticking, his wife, Lauren Sánchez Bezos, is leading the charge to spend it
Environment
Jeff Bezos pledged $10 billion for climate change. With the 2030 clock ticking, his wife, Lauren Sánchez Bezos, is leading the charge to spend it
By Sydney LakeApril 15, 2026
3 days ago
Germany already told its workers to ditch four-day weeks and work-life balance. Now the government wants to cut their pay for calling in sick, too
Success
Germany already told its workers to ditch four-day weeks and work-life balance. Now the government wants to cut their pay for calling in sick, too
By Orianna Rosa RoyleApril 16, 2026
2 days ago
Iran has reopened the Strait of Hormuz—but experts say it now holds a card that works ‘almost like a nuclear deterrent’
Energy
Iran has reopened the Strait of Hormuz—but experts say it now holds a card that works ‘almost like a nuclear deterrent’
By Eva RoytburgApril 17, 2026
12 hours ago
MacKenzie Scott is bypassing the Ivy League and rewriting the $79 billion higher ed playbook by giving to HBCUs and community colleges
Politics
MacKenzie Scott is bypassing the Ivy League and rewriting the $79 billion higher ed playbook by giving to HBCUs and community colleges
By Sydney LakeApril 16, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.