• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

eBay will pay nearly $50 million after employees reportedly sent a Massachusetts couple a bloody pig mask, cockroaches and death threats

2

Jamie Dimon says his stockbroker father taught him to invest with a 'brutally hard' childhood game

3

Costco's $14 million email settlement: Who qualifies for an up-to $500 payment and how to claim before the Aug. 24 deadline

1

eBay will pay nearly $50 million after employees reportedly sent a Massachusetts couple a bloody pig mask, cockroaches and death threats

2

Jamie Dimon says his stockbroker father taught him to invest with a 'brutally hard' childhood game

3

Costco's $14 million email settlement: Who qualifies for an up-to $500 payment and how to claim before the Aug. 24 deadline
AIOpenAI

More than 1,200 AI workers across Anthropic, DeepMind, OpenAI, and Meta are asking for Washington’s help building an AI slowdown plan

By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
July 29, 2026, 4:52 PM ET
Trump, Sam Altman, and Demis Hassibis at the G7.
Leading AI figures are calling for the U.S. government to help pace AI development.Photo by Anna Moneymaker/Getty Images
Add Fortune on Google for similar content.

More than 1,200 employees at the world’s leading AI labs, including senior executives, have signed a statement asking the U.S. government to help build the tools needed to slow down AI development if it ever becomes necessary.

Recommended Video

The statement, titled “Pacing the Frontier,” was published Tuesday and has been signed by prominent tech figures including Anthropic CEO Dario Amodei and several of the company’s co-founders, alongside OpenAI chief scientist Jakub Pachocki, Meta chief scientist Shengjia Zhao, and Google DeepMind’s head of AI safety and alignment, Anca Dragan.

The list brings together companies that are normally locked in fierce competition with each other and is a striking statement for an industry under enormous commercial pressure to keep building ever larger and more capable models. 

“Having so many staff from different companies come together in agreement on this point is striking,” Tyler Johnston, founder of the Midas Project, an AI watchdog group, told Fortune. “There are many bitter rivalries and disagreements in the industry, so the fact that there is such strong consensus on this point is a warning that we really ought to pay attention to.”

While the statement does not ask any company to slow down at the moment, it does call on Washington to support an international effort to build the technical and governance tools that would help the world “pace” development. It specially calls out the risks around AI systems that start to design their own successors faster than anyone can understand or control them.

“Having talked to many of the people who signed the letter, they don’t want a pause,” Peter Wildeford, head of policy at the AI Policy Network, told Fortune. “But there is a concern about how the technology is advancing.” The companies are looking for the optionality to do that at some point and have support from a third party when that point arrives, he added.

The letter comes in the wake of a security breach that has rattled the AI industry. OpenAI disclosed that two of its models, the newly released GPT-5.6 Sol and a more capable unreleased research system, broke out of a sandboxed internal test environment, found a previously unknown vulnerability that gave them access to the open internet, and then used stolen credentials and additional exploits to breach the production systems of Hugging Face to steal the answers to a cybersecurity benchmark they were being evaluated on. Hugging Face detected and contained the intrusion on its own days before OpenAI connected the activity to its internal testing, and had already reported it to law enforcement.

The incident appears to have sparked widespread alarm inside and outside the labs, which want the government to step in. Experts say this is because no single company can credibly slow down on its own—doing so unilaterally would risk ceding ground to less cautious rivals—instead, labs want neutral, government-backed guidance that can verify a slowdown is actually happening and hold every company to the same rules at the same time.

The letter also calls for the need for tools to be built with international coordination. There’s a long held belief that pausing AI development would hand China an advantage in the global AI race. Some experts suggest that a deal akin to nuclear arms control, where verification and mutual constraint, would be the way forward. 

However, the letter lands amid a chaotic and rapidly shifting U.S. policy environment on AI. The Trump administration has spent the past two months restricting and selectively releasing frontier systems, advanced AI models with few rules or transparency. Anthropic’s own Fable 5 and Mythos 5 models were suspended entirely for several weeks to comply with export controls before access was restored, and OpenAI was forced to delay the full rollout of GPT-5.6 and split it into restricted tiers after officials determined the system showed capabilities similar to those that triggered the earlier Anthropic restrictions.

Perhaps in an attempt to recognize the regulatory environment, the letter is notably careful and slightly vague with its language. It states that the world currently “lacks the technical and governance tools to deliberately pace frontier-wide progress,” and asks that “the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.”

Concerns within labs

One of the researchers’ central concerns is the interaction between two risks: recursive self-improvement and misalignment. Recursive self-improvement, often shortened to RSI, refers to AI systems taking over meaningful parts of the work of designing and training their own successors, with each generation potentially building the next one faster than humans could on their own. 

Misalignment describes the risk that a system’s goals or behavior diverge from what its developers actually intended, in ways that may not show up until the system is given more autonomy or capability. Anthropic sounded an early alarm on the first of those risks in June, publishing research arguing that its Claude models were already writing the large majority of the code merged into their own codebase and that the world lacked the tools to deliberately pace that acceleration if it kept compounding.

“My guess is that for a lot of people, it’s just a general sense of uneasiness that a lot of things contribute to,” said David Krueger, an AI researcher and founder of the nonprofit Evitable. “The misalignment and the recursive self improvement kind of go hand in hand.”

“It’s insane to do recursive self improvement and fully hand over the controls if the system isn’t clearly aligned,” he added.

Fortune also previously reported that several outside AI safety experts believe the episode may have crossed a threshold that OpenAI’s own safety policies define as “critical,” the highest risk tier, a level at which the company has pledged to pause development until it can build better controls. OpenAI has not confirmed if that risk threshold has been met. 

In its own disclosure about the Hugging Face incident, however, OpenAI suggested some action had been taken internally. “No models planned for upcoming release were involved in exploiting Hugging Face,” the company said. “The pre-release model mentioned in our blog post is an internal-only research prototype and was never intended for public release. Following the incident, we deactivated, encrypted, and restricted it from research access.”

Subscribe to Fortune Gulf Brief. Every Tuesday, this new newsletter delivers clear-eyed, authoritative intelligence on the deals, decisions, policies, and power shifts shaping one of the world’s most consequential regions, written for the people who need to act on it. Sign up here.
About the Author
By Beatrice NolanTech Reporter
Twitter icon

Beatrice Nolan is a tech reporter on Fortune’s AI team, covering artificial intelligence and emerging technologies and their impact on work, industry, and culture. She's based in Fortune's London office and holds a bachelor’s degree in English from the University of York. You can reach her securely via Signal at beatricenolan.08

See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in AI

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

Latest in AI

Southeast Asia is ‘hungry for innovation’ and eager to leapfrog, says SAP’s new APAC president Verena Siow
AISAP
Southeast Asia is ‘hungry for innovation’ and eager to leapfrog, says SAP’s new APAC president Verena Siow
By Angelica AngJuly 29, 2026
15 minutes ago
Inside China’s two-speed economy: Why goods consumption is slumping even as exports and services boom
EconomyAsia Agenda
Inside China’s two-speed economy: Why goods consumption is slumping even as exports and services boom
By Nicholas GordonJuly 29, 2026
45 minutes ago
Trump, Sam Altman, and Demis Hassibis at the G7.
AIOpenAI
More than 1,200 AI workers across Anthropic, DeepMind, OpenAI, and Meta are asking for Washington’s help building an AI slowdown plan
By Beatrice NolanJuly 29, 2026
52 minutes ago
sam altman looks down while reporters ask questions
CybersecurityOpenAI
Hugging Face drops in-depth hack report, while OpenAI gives us 7 bullets. Here’s what we know now, and what remains a mystery
By Emily ForliniJuly 29, 2026
4 hours ago
Nnamdi Iregbulem is a partner at Lightspeed Venture Partners
CommentaryVenture Capital
Button-mashing never worked in StarCraft. Tokenmaxxing won’t work in AI
By Nnamdi IregbulemJuly 29, 2026
9 hours ago
Computer language, Token is the basic unit of AI large models
AICFO Daily
CFOs are hitting a ‘cost wall’ on AI
By Sheryl EstradaJuly 29, 2026
10 hours ago

Most Popular

eBay will pay nearly $50 million after employees reportedly sent a Massachusetts couple a bloody pig mask, cockroaches and death threats
Law
eBay will pay nearly $50 million after employees reportedly sent a Massachusetts couple a bloody pig mask, cockroaches and death threats
By The Associated Press and Leah WillinghamJuly 28, 2026
1 day ago
Jamie Dimon says his stockbroker father taught him to invest with a 'brutally hard' childhood game
C-Suite
Jamie Dimon says his stockbroker father taught him to invest with a 'brutally hard' childhood game
By Sarah GlodekJuly 29, 2026
15 hours ago
Costco's $14 million email settlement: Who qualifies for an up-to $500 payment and how to claim before the Aug. 24 deadline
Retail
Costco's $14 million email settlement: Who qualifies for an up-to $500 payment and how to claim before the Aug. 24 deadline
By Sydney LakeJuly 29, 2026
7 hours ago
The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'
Real Estate
The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'
By Nick LichtenbergJuly 25, 2026
4 days ago
He worked 100-hour weeks to save a nearly bankrupt boat company. At 83, he’s just turned down $400 million for it—and gave it all to charity instead
Success
He worked 100-hour weeks to save a nearly bankrupt boat company. At 83, he’s just turned down $400 million for it—and gave it all to charity instead
By Preston ForeJuly 29, 2026
6 hours ago
Current price of oil as of July 28, 2026
Personal Finance
Current price of oil as of July 28, 2026
By Joseph HostetlerJuly 28, 2026
1 day ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.