• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

U.S. debt is even worse than it seems, and rising Treasury yields are now an 'all-hands-on-deck situation,' top economist warns

2

Like Jamie Dimon, AT&T CEO says if you attend a meeting, you need to show up prepared—he ‘craves’ people who don’t just sit back and observe

3

Kevin O'Leary says if you earn $68,000 a year and follow this rule, you'll retire a millionaire

1

U.S. debt is even worse than it seems, and rising Treasury yields are now an 'all-hands-on-deck situation,' top economist warns

2

Like Jamie Dimon, AT&T CEO says if you attend a meeting, you need to show up prepared—he ‘craves’ people who don’t just sit back and observe

3

Kevin O'Leary says if you earn $68,000 a year and follow this rule, you'll retire a millionaire
AIOpenAI

More than 1,200 AI workers across Anthropic, DeepMind, OpenAI, and Meta are asking for Washington’s help building an AI slowdown plan

By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
July 29, 2026, 4:52 PM ET
Trump, Sam Altman, and Demis Hassibis at the G7.
Leading AI figures are calling for the U.S. government to help pace AI development.Anna Moneymaker—Getty Images
Google source logo
Add Fortune on Google for similar content.

More than 1,200 employees at the world’s leading AI labs, including senior executives, have signed a statement asking the U.S. government to help build the tools needed to slow down AI development if it ever becomes necessary.

Recommended Video

The statement, titled “Pacing the Frontier,” was published Tuesday and has been signed by prominent tech figures including Anthropic CEO Dario Amodei and several of the company’s cofounders, alongside OpenAI chief scientist Jakub Pachocki, Meta chief scientist Shengjia Zhao, and Google DeepMind head of AI safety and alignment Anca Dragan.

The list brings together companies that are normally locked in fierce competition with one another and is a striking statement for an industry under enormous commercial pressure to keep building ever larger and more capable models. 

“Having so many staff from different companies come together in agreement on this point is striking,” Tyler Johnston, founder of the Midas Project, an AI watchdog group, told Fortune. “There are many bitter rivalries and disagreements in the industry, so the fact that there is such strong consensus on this point is a warning that we really ought to pay attention to.”

While the statement does not ask any company to slow down at the moment, it does call on Washington to support an international effort to build the technical and governance tools that would help the world “pace” development. It specifically calls out the risks around AI systems that start to design their own successors faster than anyone can understand or control them.

“Having talked to many of the people who signed the letter, they don’t want a pause,” Peter Wildeford, head of policy at the AI Policy Network, told Fortune. “But there is a concern about how the technology is advancing.” The companies are looking for the optionality to do that at some point and have support from a third party when that point arrives, he added.

The letter comes in the wake of a security breach that has rattled the AI industry. OpenAI disclosed that two of its models, the newly released GPT-5.6 Sol and a more capable unreleased research system, broke out of a sandboxed internal test environment, found a previously unknown vulnerability that gave them access to the open internet, and then used stolen credentials and additional exploits to breach the production systems of Hugging Face to steal the answers to a cybersecurity benchmark they were being evaluated on. Hugging Face detected and contained the intrusion on its own days before OpenAI connected the activity to its internal testing, and had already reported it to law enforcement.

The incident appears to have sparked widespread alarm inside and outside the labs, which want the government to step in. Experts say this is because no single company can credibly slow down on its own—doing so unilaterally would risk ceding ground to less cautious rivals; instead, labs want neutral, government-backed guidance that can verify a slowdown is actually happening and hold every company to the same rules at the same time.

The letter also calls for the need for tools to be built with international coordination. There’s a long held belief that pausing AI development would hand China an advantage in the global AI race. Some experts suggest a deal akin to nuclear arms control, with verification and mutual constraint, would be the way forward. 

However, the letter lands amid a chaotic and rapidly shifting U.S. policy environment on AI. The Trump administration has spent the past two months restricting and selectively releasing frontier systems—advanced AI models—with few rules or transparency. Anthropic’s Fable 5 and Mythos 5 models were suspended entirely for several weeks to comply with export controls before access was restored, and OpenAI was forced to delay the full rollout of GPT-5.6 and split it into restricted tiers after officials determined the system showed capabilities similar to those that triggered the earlier Anthropic restrictions.

Perhaps in an attempt to recognize the regulatory environment, the letter is notably careful and slightly vague in its language. It states that the world currently “lacks the technical and governance tools to deliberately pace frontier-wide progress,” and asks that “the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.”

Concerns within labs

One of the researchers’ central concerns is the interaction between two risks: recursive self-improvement and misalignment. Recursive self-improvement, often shortened to RSI, refers to AI systems taking over meaningful parts of the work of designing and training their own successors, with each generation potentially building the next one faster than humans could on their own. 

Misalignment describes the risk that a system’s goals or behavior diverge from what its developers actually intended, in ways that may not show up until the system is given more autonomy or capability. Anthropic sounded an early alarm on the first of those risks in June, publishing research arguing that its Claude models were already writing the large majority of the code merged into their own codebase and that the world lacked the tools to deliberately pace that acceleration if it kept compounding.

“My guess is that for a lot of people, it’s just a general sense of uneasiness that a lot of things contribute to,” said David Krueger, an AI researcher and founder of the nonprofit Evitable. “The misalignment and the recursive self-improvement kind of go hand in hand.

“It’s insane to do recursive self-improvement and fully hand over the controls if the system isn’t clearly aligned,” he added.

Fortune also previously reported that several outside AI safety experts believe the episode may have crossed a threshold that OpenAI’s own safety policies define as “critical,” the highest-risk tier, a level at which the company has pledged to pause development until it can build better controls. OpenAI has not confirmed if that risk threshold has been met. 

In its own disclosure about the Hugging Face incident, however, OpenAI suggested some action had been taken internally. “No models planned for upcoming release were involved in exploiting Hugging Face,” the company said. “The pre-release model mentioned in our blog post is an internal-only research prototype and was never intended for public release. Following the incident, we deactivated, encrypted, and restricted it from research access.”

Fortune Daily breaks the traditional barrier between audience and newsroom. The show transforms Fortune’s trusted reporting into actionable, conversational, and entertaining insights for an emerging class of business leaders. Watch here.
About the Author
By Beatrice NolanTech Reporter
Twitter icon

Beatrice Nolan is a tech reporter on Fortune’s AI team, covering artificial intelligence and emerging technologies and their impact on work, industry, and culture. She's based in Fortune's London office and holds a bachelor’s degree in English from the University of York. You can reach her securely via Signal at beatricenolan.08

See full bioRight Arrow Button Icon
Google source logo
Add Fortune on Google for similar content.

Latest in AI


Most Popular

Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

    Latest in AI


    Most Popular

    © 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
    FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.