• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
Tech

Twitter Is Now Trying to Detect and Curb Abuse in Real Time

By
Mathew Ingram
Mathew Ingram
Down Arrow Button Icon
By
Mathew Ingram
Mathew Ingram
Down Arrow Button Icon
March 1, 2017, 8:59 AM ET
Twitter's IPO Filing Implies $12.8 Billion Value Amid Growth
Photograph by Bloomberg — Getty Images

For years, Twitter has been criticized for focusing more on freedom of speech and anonymity than on curbing abuse and harassment of its users. Recently, however, the company has been trying to show that it’s listening to those complaints, and on Wednesday it rolled out new features designed to help curb such attacks.

The most far-reaching step, and probably also the most difficult, is to identify abusive behavior before users report it and take action immediately reduce its visibility.

Twitter has gradually improved how it handles abuse and harassment, by removing hurdles to reporting it and speeding up its response time (although some users argue the process is still too difficult). But now, the company says it hopes to identify abuse while it is actually occurring, instead of waiting until a user flags it.

According to a blog post by Ed Ho, Twitter’s VP of engineering, if the service’s algorithm detects abuse, it will take one of a number of steps to reduce the potential reach and harm of those tweets, including limiting the harasser’s account for a set time period.

Get Data Sheet, Fortune’s technology newsletter.

This includes limiting the reach of a user’s tweets so that only people who already follow them can see their posts. This appears to be the “time out” feature that a number of users reported seeing recently after they posted certain tweets considered by the company to be in violation of its rules. They received a message saying their account would be restricted for up to 12 hours, and that it would then return to normal.

A source with knowledge of Twitter’s plans said that future steps could include requiring an account that has been flagged as abusive by the algorithm to provide a verified phone number or email address before the restriction is lifted.

Twitter time out

The Twitter blog post notes that the service “supports the freedom to share any viewpoint,” but that the company will take action if an account holder violates the rules. The difficult part for Twitter will be determining—using only an algorithm—what is a joke, or a sarcastic remark between friends, or some other innocuous statement, and what is actual harassment or abuse.

“We aim to only act on accounts when we’re confident, based on our algorithms, that their behavior is abusive,” says Ho. “Since these tools are new we will sometimes make mistakes, but know that we are actively working to improve and iterate on them everyday.”

A number of the users whose accounts were limited after this feature was being tested complained that their free-speech rights were being restricted for no reason, just because they used a specific word. One tweet said a user had been “put on the naughty step” by a “digital daddy.”

In the past, Twitter has trumpeted its status as the “free-speech wing of the free-speech party,” the service responsible for helping topple dictators in Egypt and Libya. Cracking down on abuse inevitably means deciding what kind of speech is tolerated and what isn’t, something Facebook has also run into difficulty with.

In addition to the curbs that use technology, Twitter said that it is adding more fine-grained filtering options for notifications, so that users can control what they see and from whom. For example, users will be able to filter out tweets from accounts that have no profile picture, and those that have unverified email addresses or phone numbers.

Twitter also said it is enhancing the “mute” function that it introduced in November that allows users to block tweets based on specific keywords or phrases. Now, users will be able to set limits for how long they want such blocks to be in effect.

The company added that it will try to be more “open and transparent” about the process it uses to handle abuse reports and other safety problems. It is an apparent response to complaints that users seldom knew whether anyone got their reports of harassment, and were never informed about what action had been taken.

Ho added that Twitter is trying to learn quickly from its mistakes as well, like the recent case in which the company announced a change to how it notifies users about when they have been added to a list (a collection of accounts that are followed by a specific user). It said that users would no longer be notified, but after a torrent of negative feedback, that feature was rolled back within a matter of hours.

About the Author
By Mathew Ingram
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Apple CEO Tim Cook in Washington, D.C. on December 10, 2025. (Tom Williams/CQ-Roll Call/Getty Images)
NewslettersFortune Tech
Tim Cook’s advice for Apple’s next CEO
By Andrew NuscaMay 1, 2026
12 minutes ago
Newly appointed Apple CEO John Ternus (left) with outgoing CEO Tim Cook in Cupertino, Calif. (Photo courtesy Apple)
PoliticsMarkets
Apple’s new CEO said he will continue the company’s tradition of secrecy—and Wall Street loved it
By Jim EdwardsMay 1, 2026
51 minutes ago
Hitting the ‘GenAI wall’: Where generative AI stops working, and what it means for your talent strategy
AILeadership
Hitting the ‘GenAI wall’: Where generative AI stops working, and what it means for your talent strategy
By François Candelon and Iavor BojinovMay 1, 2026
1 hour ago
Evan Spiegel wears a black t-shirt and speaks into a microphone while on stage.
AITech
Snap CEO praises AI for writing two-thirds of the company’s code but warns fellow tech executives underestimate ‘societal pushback’ to the tech
By Sasha RogelbergMay 1, 2026
2 hours ago
Meta wants to spend more even after it lost $80 billion on the Metaverse and over 20 million users
Big TechMeta
Meta wants to spend more even after it lost $80 billion on the Metaverse and over 20 million users
By Marco Quiroz-GutierrezMay 1, 2026
3 hours ago
Tim Cook reveals the advice he gave Apple’s next CEO: The most important decision he’ll make is ‘where he spends his time’
Big TechApple
Tim Cook reveals the advice he gave Apple’s next CEO: The most important decision he’ll make is ‘where he spends his time’
By Alexei OreskovicApril 30, 2026
10 hours ago

Most Popular

Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
Success
Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
By Preston ForeApril 27, 2026
4 days ago
China dominates the world's lithium supply. The U.S. just found 328 years' worth in its own backyard
North America
China dominates the world's lithium supply. The U.S. just found 328 years' worth in its own backyard
By Jake AngeloApril 30, 2026
17 hours ago
Accenture's Julie Sweet blew up 50 years of company history. She says the hardest part is still ahead
Conferences
Accenture's Julie Sweet blew up 50 years of company history. She says the hardest part is still ahead
By Nick LichtenbergApril 29, 2026
2 days ago
Google Cloud revenue is now 18% of Alphabet's business. Is this the beginning of the end of Google's search identity?
Big Tech
Google Cloud revenue is now 18% of Alphabet's business. Is this the beginning of the end of Google's search identity?
By Alexei OreskovicApril 29, 2026
1 day ago
With no end in sight, Trump considers new options in Iran war—including the ‘Dark Eagle’ hypersonic missile
Big Tech
With no end in sight, Trump considers new options in Iran war—including the ‘Dark Eagle’ hypersonic missile
By Jim EdwardsApril 30, 2026
1 day ago
‘The cost of compute is far beyond the costs of the employees’: Nvidia executive says right now AI is more expensive than paying human workers
AI
‘The cost of compute is far beyond the costs of the employees’: Nvidia executive says right now AI is more expensive than paying human workers
By Sasha RogelbergApril 28, 2026
3 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.