• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

3

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

3

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
TechModerators

Why Thousands of Human Moderators Won’t Fix Toxic Content on Social Media

Michal Lev-Ram
By
Michal Lev-Ram
Michal Lev-Ram
Special Correspondent
Down Arrow Button Icon
Michal Lev-Ram
By
Michal Lev-Ram
Michal Lev-Ram
Special Correspondent
Down Arrow Button Icon
March 22, 2018, 7:30 AM ET
Human moderators in Silicon Valley
Human moderators in Silicon ValleyPorpeller—Getty Images

Do you have a college degree, analytical skills, and an eye for questionable content? If so, you might have what it takes to become a “News Feed integrity data specialist” for the largest social network in the world: Facebook.

The fancy job title is industry-speak for workers who sift through and flag articles, ­videos, and other posts that could be in violation of the company’s code of conduct—a professional role that’s in growing demand. Indeed, in response to concerns over a proliferation of fake news, abuse, and Russian-backed political ads, the social media giant has already put 10,000 people to work on beefing up its safety and security (7,500 of them are so-called human moderators), and says it will grow that number to 20,000 by the end of 2018. Alphabet’s YouTube division, which has also faced criticism for allowing violent and offensive content to thrive on its platform, is ramping up its humanoid workforce too, with plans to hire more than 10,000 people this year. And Twitter, under increasing pressure over the spread of bot-controlled accounts and other “bad actors” on its app, has announced it will use moderators in an effort to become a “safer” place for real users, though it won’t disclose how many people it has hired or plans to hire.

“We have invested significant resources in both human content monitoring and machine learning to fight abuse on Twitter,” a company spokeswoman told Fortune in an email.

The efforts to bring in actual people are necessary at the moment, because, researchers say, algorithms still have a hard time telling the difference between a clip of someone eating a chicken sandwich and a video of someone performing inappropriate acts on one. (A real example, unfortunately.)

But humans may not be a sustainable solution. The 10,000 additional moderators and other workers Facebook says it hopes to deploy to combat abuse on its platform is a pricey supplement to its existing 25,105 total employees, even if some of those new hires are contractors. Adding this many people hardly fits into tech company business models. (And yes, these days Facebook has even bigger problems with its business model: See Cambridge Analytica.) What’s more, the sheer amount of content on these platforms makes it nearly impossible for even thousands of new employees to make a significant dent in any cleanup efforts.

But there is a technological alternative, and it’s already happening. Even as YouTube’s CEO, Susan Wojcicki, announced the expansion of her company’s fleet of human moderators last December, she also pointed out the A.I. on the job. “Since we started using machine learning to flag violent and extremist content in June [2017], the technology has reviewed and flagged content that would have taken 180,000 people working 40 hours a week to assess,” Wojcicki wrote in a company blog post late last year. Artificial intelligence is not only faster than people, it is also immune from emotional wear and tear. In mid-March, Wojcicki made another announcement: YouTube had started limiting the amount of time its content moderators can sift through videos to four hours per day, in order to protect their mental health. The move, while necessary, makes it even more unlikely that employees will be able to significantly clean up content on sites like YouTube.

If history is any indication, the efficiency of technological tools will likely prevail over the more nuanced abilities of humans. In the early days of search engines, for example, companies like Yahoo relied on human curation, employing thousands to neatly categorize and organize the fast-growing content on the web. But before long, Google-built algorithms were shown to be vastly superior, and the rest is history. (Though to be sure, there were other reasons that Yahoo didn’t last as a search engine.)

Just because Facebook is hiring thousands, and CEO Mark Zuckerberg has said he is “dead serious” about ridding his platform of problems like Russian meddling in our elections, that doesn’t mean he sees an army of human moderators as a workable—or long-term—solution. More likely, he and the rest of the industry see humans as a temporary patch, not to mention a public relations move, intended to placate those who are skeptical of fighting bad technology with even more technology.

Cynical? Maybe, but consider this: The world’s largest social network has 2.13 billion monthly active users. Even with 20,000 safety and security specialists, that’s still just about one person per every 100,000 accounts plus all of the videos and messages published by those registered users, whether real or bot.

That means that if there’s any hope for solving the massive spread of misinformation, hate speech, and violent content (to name just a few offenders) readily available on all of these popular platforms, it won’t be throngs of poor souls struggling through hours of gratuitous posts. Rather it will be a few people working alongside technology that has yet to be developed. Let’s hope it gets there soon.

 

About the Author
Michal Lev-Ram
By Michal Lev-RamSpecial Correspondent
Twitter icon

Michal Lev-Ram is a special correspondent covering the technology and entertainment sectors for Fortune, writing analysis and longform reporting.

See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Bridgit Mendler speaks on stage at Fortune Brainstorm Tech 2026 in Aspen, Colorado.
Startups & VentureBrainstorm Tech
The space economy’s next frontier is in ground infrastructure, Northwood Space CEO says
By Sebastian HerreraJune 10, 2026
56 minutes ago
Digital sovereignty isn’t the same thing as digital isolation. Asia’s governments should be careful
Commentarydata sovereignty
Digital sovereignty isn’t the same thing as digital isolation. Asia’s governments should be careful
By Leonard LimJune 10, 2026
5 hours ago
Microsoft co-founder Bill Gates (C) arrives for a closed-door interview with the House Oversight Committee on Capitol Hill in Washington, DC, on June 10, 2026.
LawBill Gates
Gates testifies on Epstein: previous Fortune investigation reveals payments to his ex-girlfriend, $1M Microsoft deal
By Eva Roytburg, Joey Cappelletti, Hannah Schoenbaum and The Associated PressJune 10, 2026
6 hours ago
How the World Cup is a high-stakes stage for Big Tech’s AI push
NewslettersCIO Intelligence
How the World Cup is a high-stakes stage for Big Tech’s AI push
By John KellJune 10, 2026
7 hours ago
Anthropic accused of ‘secret sabotage’ as Claude Fable 5 silently limits capabilities for AI researchers and developers
AIAnthropic
Anthropic accused of ‘secret sabotage’ as Claude Fable 5 silently limits capabilities for AI researchers and developers
By Sharon GoldmanJune 10, 2026
9 hours ago
A 5-week course and a guaranteed job: Meta commits $115 million to solve the skilled-trades shortage stalling its AI build-out
Future of WorkMeta
A 5-week course and a guaranteed job: Meta commits $115 million to solve the skilled-trades shortage stalling its AI build-out
By Jacqueline MunisJune 10, 2026
9 hours ago

Most Popular

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
Asia
Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
By Kate O'Keeffe and BloombergJune 8, 2026
2 days ago
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
Success
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
By Preston ForeJune 8, 2026
2 days ago
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
Economy
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
By Nick LichtenbergJune 9, 2026
1 day ago
Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer
Energy
Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer
By Sasha RogelbergJune 10, 2026
8 hours ago
Wall Street dumped nearly $1 trillion in tech stocks by midday—then clawed it back and bought peanut butter and paint
Investing
Wall Street dumped nearly $1 trillion in tech stocks by midday—then clawed it back and bought peanut butter and paint
By Eva RoytburgJune 9, 2026
1 day ago
Current price of oil as of June 9, 2026
Personal Finance
Current price of oil as of June 9, 2026
By Joseph HostetlerJune 9, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.