• Home
  • News
  • Fortune 500
  • Tech
  • Finance
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechUK

U.K. Prime Minister Rishi Sunak pushes countries to label AI as capable of causing ‘catastrophic harm’

By
Ellen Milligan
Ellen Milligan
,
Jillian Deutsch
Jillian Deutsch
and
Bloomberg
Bloomberg
Down Arrow Button Icon
By
Ellen Milligan
Ellen Milligan
,
Jillian Deutsch
Jillian Deutsch
and
Bloomberg
Bloomberg
Down Arrow Button Icon
October 19, 2023, 5:37 AM ET
British Prime Minister Rishi Sunak speaks to a TV reporter
British Prime Minister Rishi Sunak speaks to a TV reporterFrank Augstein - WPA Pool/Getty Images

Prime Minister Rishi Sunak is pushing for nations to label artificial intelligence as capable of causing “catastrophic harm” at the AI Safety Summit the UK is hosting next month as it seeks to forge a common international approach on the rapidly advancing technology.

Recommended Video

Britain wants countries to sign up to a joint position that outlines particular concerns for AI’s impact on cybersecurity and biotechnology, according to a draft communique circulated to attendees and seen by Bloomberg. Officials aim to hammer out final wording of the communique by Oct. 25, a separate document showed.

“There is potential for significant, even catastrophic, harm, either deliberate or unintentional, stemming from the most dangerous capabilities of these AI models,” according to the draft, dated Oct. 16. 

The draft also highlights the “transformative opportunities” of AI, particularly in public services like health, education, science and clean energy. This will form a prominent part of the summit, according to a person familiar with the matter.

The meeting at Bletchley Park, home to British code breakers including Alan Turing during World War II, is part of an initiative by Sunak to position the UK at the vanguard of AI and help inform regulatory approaches and establish “guardrails” for the industry around the world. Some 100 people from 28 nations are expected to attend, including business executives, industry experts and global leaders.

The document was still subject to change, although Sunak’s administration is close to producing a final version, said the person, who asked not to be named while discussing information that hasn’t yet been publicly released.  

Global leaders are also set to call for increased transparency by companies developing AI technologies, and will focus on creating “clear evaluation metrics, tools for safety testing, and developing relevant public sector capability and scientific research,” according to the document.

“Particular safety risks arise at the ‘frontier’ of general-purpose AI, as well as in some cases specific narrow AI that could exhibit dangerous capabilities,” the draft says. “The most significant of these risks arise from potential intentional misuse or issues of control, where AI systems may seek to increase their own influence and reduce human control, and these issues are in part because those capabilities are not fully understood.”

The draft and other documents circulated among participants also say:

  • The European Commission is pushing for a process for international collaboration on frontier AI safety.
  • The bloc is also keen for any agreed approach to fall in line with its own legislation on AI, including a focus on its potential misuse in cyber-attacks and the ability for advanced systems to lose control.
  • Developers of “unusually powerful and potentially dangerous frontier AI capabilities have a particularly strong responsibility for ensuring the safety of these capabilities.”
  • All “relevant actors” are urged to “provide context-appropriate transparency and accountability on their plans to measure, monitor and mitigate potentially dangerous capabilities and the associated effects that may emerge.”

The UK is aiming to have follow-up meetings on progress toward managing the opportunities and risks of AI every six months following the summit, according to another person familiar with the discussions. 

The UK has also proposed assembling an expert panel of academics from different countries to compile an annual “state of the science” report on AI safety, according to one of the documents accompanying the draft. The annual report would summarize existing research rather than producing new material. Under the plan, countries attending the summit will nominate their own experts to join the panel.

“For the common good, AI must be designed, developed, deployed, and used in such a way as to be human-centric, safe, trustworthy and responsible,” the draft communique says.

Fortune Brainstorm AI returns to San Francisco Dec. 8–9 to convene the smartest people we know—technologists, entrepreneurs, Fortune Global 500 executives, investors, policymakers, and the brilliant minds in between—to explore and interrogate the most pressing questions about AI at another pivotal moment. Register here.
About the Authors
By Ellen Milligan
See full bioRight Arrow Button Icon
By Jillian Deutsch
See full bioRight Arrow Button Icon
By Bloomberg
See full bioRight Arrow Button Icon

Latest in Tech

AIMeta
It’s ‘kind of jarring’: AI labs like Meta, Deepseek, and Xai earned some of the worst grades possible on an existential safety index
By Patrick Kulp and Tech BrewDecember 5, 2025
3 hours ago
Elon Musk
Big TechSpaceX
Musk’s SpaceX discusses record valuation, IPO as soon as 2026
By Edward Ludlow, Loren Grush, Lizette Chapman, Eric Johnson and BloombergDecember 5, 2025
3 hours ago
data center
EnvironmentData centers
The rise of AI reasoning models comes with a big energy tradeoff
By Rachel Metz, Dina Bass and BloombergDecember 5, 2025
3 hours ago
netflix
Arts & EntertainmentAntitrust
Hollywood writers say Warner takeover ‘must be blocked’
By Thomas Buckley and BloombergDecember 5, 2025
3 hours ago
person
CybersecurityDigital
Dictionaries’ words of the year are trying to tell us something about being online in 2025
By Roger J. KreuzDecember 5, 2025
4 hours ago
Greg Peters
Big TechMedia
Top analyst says Netflix’s $72 billion bet on Warner Bros. isn’t about the ‘death of Hollywood’ at all. It’s really about Google
By Nick LichtenbergDecember 5, 2025
6 hours ago

Most Popular

placeholder alt text
Economy
Two months into the new fiscal year and the U.S. government is already spending more than $10 billion a week servicing national debt
By Eleanor PringleDecember 4, 2025
2 days ago
placeholder alt text
Success
‘Godfather of AI’ says Bill Gates and Elon Musk are right about the future of work—but he predicts mass unemployment is on its way
By Preston ForeDecember 4, 2025
1 day ago
placeholder alt text
Success
Nearly 4 million new manufacturing jobs are coming to America as boomers retire—but it's the one trade job Gen Z doesn't want
By Emma BurleighDecember 4, 2025
1 day ago
placeholder alt text
Success
Nvidia CEO Jensen Huang admits he works 7 days a week, including holidays, in a constant 'state of anxiety' out of fear of going bankrupt
By Jessica CoacciDecember 4, 2025
1 day ago
placeholder alt text
Real Estate
‘There is no Mamdani effect’: Manhattan luxury home sales surge after mayoral election, undercutting predictions of doom and escape to Florida
By Sasha RogelbergDecember 4, 2025
1 day ago
placeholder alt text
Economy
Tariffs and the $38 trillion national debt: Kevin Hassett sees ’big reductions’ in deficit while Scott Bessent sees a ‘shrinking ice cube’
By Nick LichtenbergDecember 4, 2025
1 day ago
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.