• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

The pig in the python: Baby Boomers are strangling the economy they built by refusing to move or retire

2

Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year

3

The U.S. campaigned to host the World Cup. Now soccer fans will trade their countries' train system for the U.S.'s 'D' rated infrastructure

1

The pig in the python: Baby Boomers are strangling the economy they built by refusing to move or retire

2

Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year

3

The U.S. campaigned to host the World Cup. Now soccer fans will trade their countries' train system for the U.S.'s 'D' rated infrastructure
ConferencesBrainstorm Design
Asia

Data activist Renée Cummings says there’s an important question to ask when making responsible AI: ‘Where did this data come from?’

By
Jay Ganglani
Jay Ganglani
Down Arrow Button Icon
By
Jay Ganglani
Jay Ganglani
Down Arrow Button Icon
December 6, 2024, 3:32 AM ET
Renée Cummings, Assistant Professor of the Practice in Data Science, University of Virginia, speaks at Fortune Brainstorm Design on Dec. 5, 2024.
Renée Cummings, Assistant Professor of the Practice in Data Science, University of Virginia, speaks at Fortune Brainstorm Design on Dec. 5, 2024.Lucas Schifres for Fortune

One of AI’s thorniest issues is ensuring the new technology doesn’t end up reflecting all the same biases of its human creators have. Generative AI, trained on massive amounts of data, is compounding the problem, rather than mitigating it, as models deliver answers that align with pervasive prejudices about different races and genders.

Recommended Video

Data activist Renée Cummings, at Fortune’s Brainstorm Design event in Macau on Thursday, argued that the core of the issue is data. “We know that AI is a revolutionary technology, we know that AI is a radical technology, but we have to understand that there is no AI without data,” she said. 

Cummings, a professor of practice in data science at the University of Virginia, examines ethical risks in artificial intelligence and studies how to build a responsible and sustainable AI that can benefit everyone in society, regardless of background. 

For example, a recent United Nations study recently pointed to predictive policing as an example of how racial biases are reproduced through technology. This practice involves making judgments regarding who will commit future crimes and where these incidents may take place. The study warns that predictive policing could further add to problems regarding over-policing communities based on race and ethnicity. 

“We know that data creates very unique challenges when it comes to bias, when it comes to discrimination, when it comes to systemic challenges,” Cummings said. 

“It’s so important when we’re designing to ask ourselves, where did this data come from?” she asked. “Sometimes we’re using data that is being duplicated in very weird ways. Data that’s actually missing critical pieces of the stories that need to be told.”

That means AI designers need to have a heightened sense of “ethical vigilance,” she explained. “We have a responsibility to ensure that we bring a framework to…audit the ways in which we are building models, the ways in which we are building algorithms,” she said. 

AI also brings its share of environmental concerns. The metals used in AI hardware, for instance, can lead to both pollution and soil erosion. “We speak about building a sustainable and resilient future using this technology, but we’ve got to think about the ways in which the environment is also being impacted.”

Due diligence can help AI designers work around these issues. They could design new models while ensuring that concepts such as equity, access, and fairness are respected, yet also in a manner that doesn’t undermine the accuracy, or the validity of data, she said

“How involved are communities in the process? It’s very critical the ways in which we engage communities to design, because we’re realizing that many of our data sets…are creating very critical risks,” she explained. 

AI does have the potential to do “extraordinary things,” Cummings noted. AI tools have led to increased efficiency, reduced costs, and greater convenience. But that only heightens the need to make sure the new technology works in a responsible way.

If AI designers don’t take data equity into account, then “what we are going to create are systems that not only undermine our own progress, but systems that could create situations that undermine the ways in which we move into the future together,” she warned. 

The Fortune 500 Innovation Forum will convene Fortune 500 executives, U.S. policy officials, top founders, and thought leaders to help define what’s next for the American economy, Nov. 16-17 in Detroit. Apply here.
About the Author
By Jay Ganglani
See full bioRight Arrow Button Icon

Latest from our Conferences

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest from our Conferences

A photo taken during the Maroon Bells bicycle ride during Fortune Brainstorm Tech 2019 in Aspen, Colorado. (Photo: Fortune)
InnovationBrainstorm Tech
Fortune Brainstorm Tech 2026 will be brilliant
By Andrew NuscaMay 22, 2026
3 days ago
Clinical Psychologist Daniel Wendler
ConferencesWorkplace Innovation Summit
A ‘proudly autistic’ workplace expert says putting neurodivergent employees in a typical office is like dropping a polar bear in Austin, Texas
By Tristan BoveMay 20, 2026
5 days ago
lucas
ConferencesWorkplace Innovation Summit
Trump’s EEOC chair is suing The New York Times because ‘we should bring it on behalf of white workers too’
By Nick LichtenbergMay 20, 2026
5 days ago
Fortune Workplace Innovation Summit logo
ConferencesWorkplace Innovation Summit
Fortune Workplace Innovation Summit 2026 livestream
By Fortune EditorsMay 19, 2026
7 days ago
burke
ConferencesAthletic Gear
The CEO of Trek Bicycle reads 52 books a year, hates smartphones, and thinks Milton Friedman was wrong
By Nick LichtenbergMay 6, 2026
19 days ago
mark
ConferencesHospitality
Hyatt’s CEO has built a ‘family’ culture for 20 years. Now he’s leaning on it
By Nick LichtenbergApril 30, 2026
25 days ago

Most Popular

The pig in the python: Baby Boomers are strangling the economy they built by refusing to move or retire
Economy
The pig in the python: Baby Boomers are strangling the economy they built by refusing to move or retire
By Nick LichtenbergMay 25, 2026
14 hours ago
Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year
Success
Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year
By Preston ForeMay 21, 2026
4 days ago
The U.S. campaigned to host the World Cup. Now soccer fans will trade their countries' train system for the U.S.'s 'D' rated infrastructure
Travel & Leisure
The U.S. campaigned to host the World Cup. Now soccer fans will trade their countries' train system for the U.S.'s 'D' rated infrastructure
By Catherina GioinoMay 25, 2026
11 hours ago
Uber CEO says rideshare 'freed up' his son from having to get a driver’s license—and he's one of many Gen Zers who aren’t willing to drive
Lifestyle
Uber CEO says rideshare 'freed up' his son from having to get a driver’s license—and he's one of many Gen Zers who aren’t willing to drive
By Sasha RogelbergMay 24, 2026
1 day ago
Elon Musk's best friend could make more than $100 billion from SpaceX's IPO. His firm is also owed billions by SpaceX
Investing
Elon Musk's best friend could make more than $100 billion from SpaceX's IPO. His firm is also owed billions by SpaceX
By Eva RoytburgMay 25, 2026
10 hours ago
This 39-year-old quit his lineman job during the pandemic and built a $50 million company in his backyard
Success
This 39-year-old quit his lineman job during the pandemic and built a $50 million company in his backyard
By Nick LichtenbergMay 23, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.