• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
NewslettersBrainstorm Health

A Major Healthcare A.I. Has a Serious Racial Bias: Brainstorm Health

By
Sy Mukherjee
Sy Mukherjee
Down Arrow Button Icon
By
Sy Mukherjee
Sy Mukherjee
Down Arrow Button Icon
October 24, 2019, 5:48 PM ET

Good afternoon, readers.

Algorithms can be racist—seriously. Biases are often built into programs which then carry out what their programmers (perhaps innocently and unwittingly) build into the code.

But that’s a major problem in an increasingly digital world, intentions aside. And it’s especially problematic in the healthcare arena.

Unfortunately, a new study published in the journal Science finds that an unnamed, but widely-used, A.I. algorithm meant to manage population health fell prey to these very problems. The program is meant to analyze health risks across wide populations, specifically for chronically ill patients who may require an extra level of care.

But the underlying metrics used to calculate these risks were questionable. And they had the broader effect of discriminating against people based on race, particularly black Americans.

“We show that a widely used algorithm, typical of this industry-wide approach and affecting millions of patients, exhibits significant racial bias: At a given risk score, Black patients are considerably sicker than White patients, as evidenced by signs of uncontrolled illnesses,” wrote the study authors. “Remedying this disparity would increase the percentage of Black patients receiving additional help from 17.7 to 46.5%.”

Read on for the day’s news.

Sy Mukherjee, @the_sy_guy, sayak.mukherjee@fortune.com

DIGITAL HEALTH

Viz.ai raises $50 million for A.I.-fueled stroke diagnostics. Digital health firm Viz.ai has raised $50 million from partners including GV, Kleiner Perkins, Threshold Ventures, and Greenoaks in order to build up its A.I.-fueled stroke detection platform. The company's tech is used to sniff out suspected cases of a certain kind of stroke by analyzing CT scans. (Reuters)

INDICATIONS

Vertex, British drug watchdog finally reach an agreement. The wins keep coming for Vertex Pharmaceuticals this week. First, the company won a major approval for its cystic fibrosis combo therapy Trikafta, which could potentially treat 90% of patients with the rare disorder. Now, the U.K.'s hard-nosed drug pricing/value watchdog has come to an agreement over three of Vertex's other cystic fibrosis drugs, making them available on the market. The agency had initially deemed the treatments to not be cost-effective. (PharmaTimes)

THE BIG PICTURE

CVS to pull certain J&J baby powder from the shelves. Pharmacy chains CVS and Rite Aid are yanking certain Johnson & Johnson baby powder products from their shelves following the drug giant's voluntary recall (related to asbestos concerns. "CVS Pharmacy is complying with Johnson & Johnson’s voluntary recall of Johnson’s Baby Powder 22 oz. and is removing this product from all stores and from CVS.com," CVS said in a statement. "We also initiated a ‘Do Not Sell’ register prompt in our stores to prevent the sale of this item during the product removal process." (CNBC)

REQUIRED READING

What's Next for Google After Claiming 'Quantum Supremacy'?by Robert Hackett

How Tesla Made More Profit from Less Revenue, by David Z. Morris

You Might Have to Pay for Gmail. You Always Did, by Aaron Pressman

Another Wrinkle Emerges in the WeWork Saga, by Erik Sherman

Find past coverage. Sign up for other Fortune newsletters.

About the Author
By Sy Mukherjee
See full bioRight Arrow Button Icon

Latest in Newsletters

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

Latest in Newsletters

NewslettersMPW Daily
Why retailers seeking billion-dollar growth are betting on women
By Emma HinchliffeDecember 15, 2025
9 hours ago
A woman sits with a suitcase and a work file on a windowsill.
NewslettersFortune CHRO
Unlimited vacation policies can work—it just depends on where employees are based
By Kristin StollerDecember 15, 2025
14 hours ago
NewslettersFortune Crypto
Crypto wallets, long a painful experience, now feel a lot more like Venmo
By Jeff John RobertsDecember 15, 2025
15 hours ago
Businesswoman discussing AI business efficiency to her colleagues in a meeting room.
NewslettersCFO Daily
Earnings calls citing ‘AI’ surge in 2025 as ‘uncertainty’ mentions fade
By Sheryl EstradaDecember 15, 2025
15 hours ago
NewslettersTerm Sheet
This Thrive-backed startup says it aspires to be the “Amazon of homes”
By Allie GarfinkleDecember 15, 2025
16 hours ago
President Donald Trump displays a signed executive order in the Oval Office of the White House on December 11, 2025 in Washington, DC.
NewslettersCEO Daily
CEOs usually favor less regulation. But not all are happy with Trump’s executive order to block state AI laws
By Diane BradyDecember 15, 2025
16 hours ago

Most Popular

placeholder alt text
Success
'I had to take 60 meetings': Jeff Bezos says 'the hardest thing I've ever done' was raising the first million dollars of seed capital for Amazon
By Dave SmithDecember 15, 2025
10 hours ago
placeholder alt text
Success
Meetings are not work, says Southwest Airlines CEO—and he’s taking action, by blocking his calendar every afternoon from Wednesday to Friday 
By Preston ForeDecember 15, 2025
12 hours ago
placeholder alt text
Success
Sorry, six-figure earners: Elon Musk says that money will 'disappear' in the future as AI makes work (and salaries) irrelevant
By Orianna Rosa RoyleDecember 15, 2025
14 hours ago
placeholder alt text
AI
Deloitte's CTO on a stunning AI transformation stat: Companies are spending 93% on tech and only 7% on people
By Nick LichtenbergDecember 15, 2025
17 hours ago
placeholder alt text
Uncategorized
Transforming customer support through intelligent AI operations
By Lauren ChomiukNovember 26, 2025
19 days ago
placeholder alt text
North America
Ford writes down $19.5 billion as it pivots electric Lighting line of vehicles
By Sasha RogelbergDecember 15, 2025
6 hours ago

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.