• Home
  • News
  • Fortune 500
  • Tech
  • Finance
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
Tech

‘This Is an Arms Race.’ Why Facebook Isn’t Winning Its War on Harmful Content—Yet

By
Danielle Abril
Danielle Abril
Down Arrow Button Icon
By
Danielle Abril
Danielle Abril
Down Arrow Button Icon
April 11, 2019, 6:49 PM ET

Facebook says its latest updates to News Feed, Messenger, and Instagram will help it battle misinformation and harmful content. While the new features incrementally turn the dial, don’t expect them to end fake news entirely.

Facebook detailed its new rollouts at a press briefing on Wednesday at its Menlo Park headquarters. To combat bad actors and fake news, the social network is introducing several new measures. It’s starting by limiting the reach of groups that repeatedly spread misinformation. With a new measurement called the “Click-Gap,” Facebook says it’s also getting better at identifying click-bait. And the social network is expanding the amount of content that will be fact-checked by the Associated Press. In addition, Messenger users will be able to get a verified badge, helping to combat impersonation, and Instagram posts deemed inappropriate will become harder to find.

These measures are meant to clean up the darker corners of Facebook’s social media empire. In recent years, the company has been heavily scrutinized for how it managed misinformation and harmful content. For example, it hosted live streams of the New Zealand mass shooting in March. It has helped the spread of misinformation and hate speech that encouraged people to kill Muslims, creating chaos in Sri Lanka in March 2018. And it exposed user information to political firm Cambridge Analytica, which used the data to influence the 2016 presidential election.

While Facebook’s latest efforts aim to prevent future incidents like these, the company admits it still faces numerous challenges in fighting the spread fake news.

“We’re up against adversaries,” Guy Rosen, Facebook’s vice president of integrity. “This is an arms race.”

But a few things handicap Facebook in its efforts to improve the integrity of its network.

First, the company takes a hands-off approach when it comes to removing misinformation. Facebook wants to provide users a place to openly express themselves and share information, regardless of its merit, and it’s relatively picky about what it considers harmful and worth removal.

Posts that don’t follow its community standards—like threats of physical harm, hate speech, violence, and sexual activity—are removed. Beyond that, it will take down posts that provide misinformation about elections or increase the risk of eminent violence in specific regions of the world.

But the company doesn’t remove information from Facebook just because it’s false, says Tessa Lyons, head of news feed integrity. As a result, posts containing scientifically debunked anti-vaccination claims remain on the platform—though their reach is diminished, reports WIRED.

To proactively identify potentially harmful posts in the massive amounts of content posted on Facebook every day, the company uses artificial intelligence. But, Facebook’s A.I. can be tricked—another handicap in its arms race.

When harmful content is published, A.I. quickly identifies and removes copies—often before anyone has seen it. But if the content is slightly modified, it sometimes can go undetected by the system. That was the case with the New Zealand shooting, as 300,000 videos of the 1.5 million published were not blocked from being posted.

This shortfall is why Facebook also relies heavily on help from content reviewers, human contract workers who physically review problematic posts. Vendors like Cognizant, Telus International, and Accenture provide a workforce of 15,000 content moderators to Facebook in 20 locations around the world.

But another handicap for Facebook is just how overwhelming this content can be. Given the A.I. detection’s shortcomings, contractors are sometimes left to review the same slightly modified graphic content over and over again, decreasing the ground they can cover and exposing them to possible traumatic effects.

Wednesday’s Facebook briefing showed that though it is is attempting to shore up the integrity of its network, it still has many more battles to win before it can come close to declaring a victory against misinformation.

About the Author
By Danielle Abril
See full bioRight Arrow Button Icon

Latest in Tech

AIOpenAI
Sam Altman declares ‘Code Red’ as Google’s Gemini surges—three years after ChatGPT caused Google CEO Sundar Pichai to do the same
By Sharon GoldmanDecember 2, 2025
19 minutes ago
Google CEO Sundar Pichai
SuccessCareers
As AI wipes jobs, Google CEO Sundar Pichai says it’s up to everyday people to adapt accordingly: ‘We will have to work through societal disruption’
By Emma BurleighDecember 2, 2025
1 hour ago
Photo of Candace Owens
LawLaw
Inside the economics of Candace Owens’ media empire and the Macron lawsuit threatening to unravel it
By Lily Mae LazarusDecember 2, 2025
2 hours ago
Amar Subramanya
AIApple
Meet Amar Subramanya, the 46-year-old Google and Microsoft veteran who will now steer Apple’s supremely important AI strategy
By Dave SmithDecember 2, 2025
2 hours ago
Elizabeth Kelly
CommentaryNon-Profit
At Anthropic, we believe that AI can increase nonprofit capacity. And we’ve worked with over 100 organizations so far on getting it right
By Elizabeth KellyDecember 2, 2025
3 hours ago
Espinoza
AIColleges and Universities
After mass AI college-cheating freakout, many admissions offices are using it to screen student applications
By Jocelyn Gecker and The Associated PressDecember 2, 2025
3 hours ago

Most Popular

placeholder alt text
Economy
Ford workers told their CEO 'none of the young people want to work here.' So Jim Farley took a page out of the founder's playbook
By Sasha RogelbergNovember 28, 2025
4 days ago
placeholder alt text
Success
Warren Buffett used to give his family $10,000 each at Christmas—but when he saw how fast they were spending it, he started buying them shares instead
By Eleanor PringleDecember 2, 2025
6 hours ago
placeholder alt text
Success
Forget the four-day workweek, Elon Musk predicts you won't have to work at all in ‘less than 20 years'
By Jessica CoacciDecember 1, 2025
24 hours ago
placeholder alt text
Innovation
Google CEO Sundar Pichai says we’re just a decade away from a new normal of extraterrestrial data centers
By Sasha RogelbergDecember 1, 2025
23 hours ago
placeholder alt text
Personal Finance
Current price of gold as of December 1, 2025
By Danny BakstDecember 1, 2025
1 day ago
placeholder alt text
Big Tech
Elon Musk, fresh off securing a $1 trillion pay package, says philanthropy is 'very hard'
By Sydney LakeDecember 1, 2025
1 day ago
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.