• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic

2

MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year

3

Amazon's record Prime Day masks a darker truth: Americans are spending more and getting less

1

Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic

2

MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year

3

Amazon's record Prime Day masks a darker truth: Americans are spending more and getting less
AIAnthropic

Anthropic warns AI could soon build itself without human involvement—and urges a global pause on development

By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
June 5, 2026, 10:27 AM ET
Anthropic co-founder Jack Clark.
Anthropic cofounder Jack ClarkSAUL LOEB—AFP/Getty Images
Add Fortune on Google for similar content.

Anthropic has published a new account of how quickly its AI models are advancing, warning that the technology may soon be capable of improving itself without meaningful human involvement. Just as the AI lab, valued at almost $1 trillion, prepares to go public, it’s also urging an industrywide pause in AI development.

Recommended Video

In the now-viral blog post on Thursday, authors Marina Favaro and Jack Clark argue that AI development at Anthropic has already shifted dramatically: More than 80% of code merged into the company’s codebase is now written by Claude, and engineers are shipping roughly eight times as much code per quarter as they were before 2025. The authors say this trajectory is heading toward “recursive self-improvement”—a process in which AI systems autonomously design, build, and train their own successors, without humans driving each step.

The authors warn that while this threshold has not yet been crossed, it “could come sooner than most institutions are prepared for,” and that if it arrives without adequate safeguards, it could make it significantly harder for humans to maintain meaningful control over AI development.

The company also took the time to advocate for a pause on AI development, but only if “multiple well-resourced labs at or near the frontier, in multiple countries, agree to stop under the same conditions.” Presumably Anthropic is referring to competitors including OpenAI, Google, xAI, and Meta. Most of these labs are currently engaged in a high-stakes race to develop ever more powerful AI models, and, with IPOs looming over three of the main labs, it seems unlikely that these companies will come together to agree on a coordinated pause on AI development. 

The timing is raising some eyebrows. Just last week, the AI company filed confidential paperwork to prepare for an IPO. In the past month, it also leapfrogged OpenAI to become the most valuable AI lab at a $965 billion valuation. 

While Anthropic has long presented itself as more safety-conscious than other major AI labs, the timing—just before what could be one of the largest tech IPOs in history—has some observers questioning whether it’s also a way to stir up hype before the company’s public debut. 

Critics have previously accused the company of using safety rhetoric as a form of competitive positioning. Trump advisor David Sacks has previously accused Anthropic of running a “regulatory capture agenda” designed to slow rivals under the guise of responsible AI development—a characterization the company rejects. 

The AI lab is also in fierce competition with old rival OpenAI, with both labs racing to go public this year in an attempt to seize what could be a first-mover advantage with investors. 

It’s also worth noting that Anthropic, despite advocating for a pause on AI development, recently dropped a key safety pledge that promised to do something similar. In February, Time magazine reported that Anthropic had overhauled its Responsible Scaling Policy—scrapping its central commitment to never train an AI system unless it could guarantee in advance that its safety measures were adequate. Chief science officer Jared Kaplan said at the time that the company felt it “wouldn’t actually help anyone” to stop training models unilaterally while competitors pressed ahead.

The company argued the overhaul was a pragmatic response to a changed political and competitive landscape, rather than a capitulation to market pressure. The new policy commits to transparency and matching rivals’ safety efforts; still, it leaves Anthropic significantly less constrained by its own rules than before.

Thursday’s post does make it clear that, whatever its motivation, Anthropic believes the window for meaningful deliberation on AI safety is narrowing. The company says it plans to convene policymakers, researchers, and civil society in the coming months to work through the questions recursive self-improvement raises.

“The window to investigate the questions together is here,” the authors wrote. “And people outside AI companies should be involved in this deliberation.”

Subscribe to Fortune Gulf Brief. Every Tuesday, this new newsletter delivers clear-eyed, authoritative intelligence on the deals, decisions, policies, and power shifts shaping one of the world’s most consequential regions, written for the people who need to act on it. Sign up here.
About the Author
By Beatrice NolanTech Reporter
Twitter icon

Beatrice Nolan is a tech reporter on Fortune’s AI team, covering artificial intelligence and emerging technologies and their impact on work, industry, and culture. She's based in Fortune's London office and holds a bachelor’s degree in English from the University of York. You can reach her securely via Signal at beatricenolan.08

See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in AI

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in AI

stock
InvestingMarkets
How one chip stock reversed the global tech selloff, exposed AI’s ‘memory tax’ and made the case for an entire valuation regime change
By Nick LichtenbergJune 25, 2026
4 hours ago
Softbank CEO dismisses Elon Musk’s extraterrestrial data center idea in favor of maximizing Earth-side construction now: ‘He who strikes first wins’
AITech
Softbank CEO dismisses Elon Musk’s extraterrestrial data center idea in favor of maximizing Earth-side construction now: ‘He who strikes first wins’
By Marco Quiroz-GutierrezJune 25, 2026
5 hours ago
VivaTech entrance in Paris.
NewslettersEye on AI
Europe’s AI wake-up call: cybersecurity threats, sovereignty fears, and a growing demand for ROI dominated VivaTech
By Beatrice NolanJune 25, 2026
6 hours ago
Digital transformation technology strategy, IoT, internet of things. Businessman using smart phone with AI and Digital Icons design.
AICFO Daily
Top CFOs warn AI success depends on training employees, not just buying technology
By Sheryl EstradaJune 25, 2026
7 hours ago
Samin Menon (left) Neil Movva (right)
Startups & VentureVenture Capital
Exclusive: A former Apple engineer thinks AI infrastructure is built for the wrong future. Investors just gave him $80 million to fix it
By Lily Mae LazarusJune 25, 2026
8 hours ago
What bubble? JPMorgan says the $5.5 trillion AI capex explosion is profitable–for now
AIFinance
What bubble? JPMorgan says the $5.5 trillion AI capex explosion is profitable–for now
By Sheryl EstradaJune 25, 2026
10 hours ago

Most Popular

Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic
Success
Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic
By Orianna Rosa RoyleJune 24, 2026
2 days ago
MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year
Success
MacKenzie Scott alone accounted for one-third of America's $19.2 billion in megagifts last year
By Sydney LakeJune 25, 2026
13 hours ago
Amazon's record Prime Day masks a darker truth: Americans are spending more and getting less
Retail
Amazon's record Prime Day masks a darker truth: Americans are spending more and getting less
By Nick LichtenbergJune 24, 2026
1 day ago
Ray Dalio just finished a 10-day trip to China. He says global leaders know America ‘doesn’t have what it takes to fight to maintain its empire’
Asia
Ray Dalio just finished a 10-day trip to China. He says global leaders know America ‘doesn’t have what it takes to fight to maintain its empire’
By Nick LichtenbergJune 24, 2026
1 day ago
After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
Success
After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
By Orianna Rosa RoyleJune 23, 2026
2 days ago
Ikea’s billionaire founder was so frugal that he bought clothes from flea markets and took free salt and pepper from restaurants
Success
Ikea’s billionaire founder was so frugal that he bought clothes from flea markets and took free salt and pepper from restaurants
By Orianna Rosa RoyleJune 25, 2026
13 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.