• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'

3

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'

3

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
TechAI

When Artificial Intelligence Knows Too Much (or Too Little) About You

Michal Lev-Ram
By
Michal Lev-Ram
Michal Lev-Ram
Special Correspondent
Down Arrow Button Icon
Michal Lev-Ram
By
Michal Lev-Ram
Michal Lev-Ram
Special Correspondent
Down Arrow Button Icon
May 1, 2019, 6:15 PM ET

“Know thyself.”

Those were the words of advice offered up by philosopher, historian, and best-selling author Yuval Noah Harari during an on-stage conversation at Stanford University last week. The prolific writer (and agitator) has long been a critic of artificial intelligence applications that track, aggregate, and learn from our every move, gleaning insights about us that we are sometimes oblivious to ourselves.

“Get to know yourself better,” Harari said again in more modern English, “because now, you’ve got competition.”

Stanford’s Human-Centered AI Institute, which aims to develop technologies to benefit humanity, co-sponsored the event. The conversation also featured computer science professor Fei-Fei Li, a pioneer in AI research and co-director of the multidisciplinary institute. Both speakers focused on what the future holds for AI, and how it can be utilized to “support rather than subvert” human interests. Not surprisingly, Harari and Li did not always see eye to eye on the best path forward or on the scope and severity of the harm AI can unleash.

One of Li’s suggestions, for examples, was to develop AI systems that can explain their processes and decisions. But Harari argued that these technologies have become too complex to be explainable, and that this level of complexity can undermine our autonomy and authority.

While the conversation was mostly fruitful and productive, there were a few friendly jabs.

“I’m very envious of philosophers, because they can propose questions and crises, but they don’t have to answer them,” said Li. (Even Harari chuckled at that one.)

Perhaps, Harari’s laughter came from knowing that he was about to offer some solutions, though even his very simplest takeaway—“know thyself”—is easier said than done. The challenge of knowing ourselves better than AI systems can is best illustrated with an anecdote shared by the philosopher himself. Harari told the audience that he didn’t realize he was gay until he was 21 years old. “I’m with myself 24 hours a day,” he said, yet an AI system could have concluded his sexual identity faster than he could.

“What does it mean to live in a world where you can learn something so important about yourself from an algorithm?” he asked the audience. “And what if that algorithm doesn’t share [this information] with you but with others—advertisers or an authoritarian regime?”

The risks of AI knowing too much about us are real and are starting to be addressed—both by outside critics like Harari and increasingly, by engineers, educators, and other insiders like Li. But what about the risks of the flip side, when AI systems know too little about us, or about entire demographics?

Also last week, I attended Women Transforming Technology, an event that took place at the Palo Alto campus of technology company VMware. There, Joy Buolamwini, a researcher at the Massachusetts Institute of Technology’s Media Lab, discussed problems of bias in AI applications. Much of Buolamwini’s work has centered on the inability of facial recognition systems to accurately identify the faces of women and, to a much greater extent, people of color. As you can probably guess, these systems tend to have the hardest time recognizing the faces of women of color.

“These are the under-sampled majority of the world—women and people of color,” Buolamwini told her audience.

The bias in many facial recognition applications starts with the data sets used to train these AI systems. According to Buolamwini, the vast majority of the pictures fed into these self-learning systems are of subjects who are male and white. The benchmarks used to assess accuracy on these systems, therefore, are also optimized for male, white faces. This has vast and potentially dangerous implications: Just imagine a self-driving vehicle that doesn’t detect someone with dark skin as accurately as it can “see” someone with light skin.

It is these types of risks that led Buolamwini to start the Algorithmic Justice League, an organization aimed at highlighting and alleviating bias from AI systems. The “collective,” as the M.I.T. researcher calls it, brings together coders, activists, regulators, and others to work together to raise awareness on these important technological and societal issues.

Buolamwini’s work has likely led to improvements. During her talk she pointed to recent increases in the accuracy of detecting non-white and non-male subjects by facial recognition from IBM, Facebook and other companies. But here’s the rub: While Buolamwini is clearly pushing for more improvements in these systems, she is also very worried about the applications of facial recognition technologies that do know enough about all people.

“You can have accurate facial recognition and put it on some drones, but it might not be the world you want to live in,” Buolamwini told me during a sit-down interview after her talk.

Buolamwini gave another example: If a system is biased and it’s being deployed for law enforcement purposes, you can’t justify using that system. Now, let’s say you’ve fixed that bias. Then, the question becomes, in Buolamwini’s words, “Do we want to live in a mass surveillance state?”

That is one question I’m pretty sure that Buolamwini, Harari, and Li would answer the same way: No.

About the Author
Michal Lev-Ram
By Michal Lev-RamSpecial Correspondent
Twitter icon

Michal Lev-Ram is a special correspondent covering the technology and entertainment sectors for Fortune, writing analysis and longform reporting.

See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Anu Madgavkar, a partner at the McKinsey Global Institute
AIWorkplace Innovation Summit
McKinsey partner says up to 50% of work hours could be transformed within the next 5 years
By Emma BurleighMay 21, 2026
15 minutes ago
allbirds
AILayoffs
Allbirds’ 600% stock surge says a lot about how ‘AI washing’ became the new ‘greenwashing’
By Suvrat Dhanorkar and The ConversationMay 21, 2026
3 hours ago
musk
InvestingIPOs
‘We do not want humans to have the same fate as dinosaurs’: SpaceX IPO reads like Hollywood fantasy version of the future
By Bernard Condon and The Associated PressMay 21, 2026
3 hours ago
murdoch
Big TechMedia
James Murdoch vows ‘ambitious journalism and agenda-setting conversations’ as he takes over New York, Vox brands
By Jocelyn Noveck and The Associated PressMay 21, 2026
4 hours ago
Traders work after a Federal Open Market Committee (FOMC) meeting on the floor of the New York Stock Exchange (NYSE) in New York, US, on Wednesday, March 18, 2026.
InvestingMarkets
Wall Street thinks there’s a chance the S&P 500 could push 20% higher by 2027
By Eleanor PringleMay 21, 2026
5 hours ago
Elon Musk sits with his fists together, looking up.
NewslettersTerm Sheet
SpaceX’s IPO filing is full of surprises
By Allie GarfinkleMay 21, 2026
5 hours ago

Most Popular

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
Workplace Culture
Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
By Preston ForeMay 19, 2026
2 days ago
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
Success
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
By Preston ForeMay 20, 2026
1 day ago
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
Future of Work
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
By Mike Householder and The Associated PressMay 17, 2026
4 days ago
Dr. Bernice King on why companies that walked back DEI were never truly committed: 'If you retreat that quick…that reveals who you really are'
Workplace Culture
Dr. Bernice King on why companies that walked back DEI were never truly committed: 'If you retreat that quick…that reveals who you really are'
By Preston ForeMay 19, 2026
2 days ago
Pay transparency is exposing a bigger problem: Most companies can't explain why they pay what they pay
Workplace Culture
Pay transparency is exposing a bigger problem: Most companies can't explain why they pay what they pay
By Sydney LakeMay 20, 2026
20 hours ago
Current price of oil as of May 20, 2026
Personal Finance
Current price of oil as of May 20, 2026
By Joseph HostetlerMay 20, 2026
1 day ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.