• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechUK

U.K. Prime Minister Rishi Sunak pushes countries to label AI as capable of causing ‘catastrophic harm’

By
Ellen Milligan
Ellen Milligan
,
Jillian Deutsch
and
Bloomberg
Bloomberg
Down Arrow Button Icon
October 19, 2023, 5:37 AM ET
British Prime Minister Rishi Sunak speaks to a TV reporter
British Prime Minister Rishi Sunak speaks to a TV reporterFrank Augstein - WPA Pool/Getty Images

Prime Minister Rishi Sunak is pushing for nations to label artificial intelligence as capable of causing “catastrophic harm” at the AI Safety Summit the UK is hosting next month as it seeks to forge a common international approach on the rapidly advancing technology.

Recommended Video

Britain wants countries to sign up to a joint position that outlines particular concerns for AI’s impact on cybersecurity and biotechnology, according to a draft communique circulated to attendees and seen by Bloomberg. Officials aim to hammer out final wording of the communique by Oct. 25, a separate document showed.

“There is potential for significant, even catastrophic, harm, either deliberate or unintentional, stemming from the most dangerous capabilities of these AI models,” according to the draft, dated Oct. 16. 

The draft also highlights the “transformative opportunities” of AI, particularly in public services like health, education, science and clean energy. This will form a prominent part of the summit, according to a person familiar with the matter.

The meeting at Bletchley Park, home to British code breakers including Alan Turing during World War II, is part of an initiative by Sunak to position the UK at the vanguard of AI and help inform regulatory approaches and establish “guardrails” for the industry around the world. Some 100 people from 28 nations are expected to attend, including business executives, industry experts and global leaders.

The document was still subject to change, although Sunak’s administration is close to producing a final version, said the person, who asked not to be named while discussing information that hasn’t yet been publicly released.  

Global leaders are also set to call for increased transparency by companies developing AI technologies, and will focus on creating “clear evaluation metrics, tools for safety testing, and developing relevant public sector capability and scientific research,” according to the document.

“Particular safety risks arise at the ‘frontier’ of general-purpose AI, as well as in some cases specific narrow AI that could exhibit dangerous capabilities,” the draft says. “The most significant of these risks arise from potential intentional misuse or issues of control, where AI systems may seek to increase their own influence and reduce human control, and these issues are in part because those capabilities are not fully understood.”

The draft and other documents circulated among participants also say:

  • The European Commission is pushing for a process for international collaboration on frontier AI safety.
  • The bloc is also keen for any agreed approach to fall in line with its own legislation on AI, including a focus on its potential misuse in cyber-attacks and the ability for advanced systems to lose control.
  • Developers of “unusually powerful and potentially dangerous frontier AI capabilities have a particularly strong responsibility for ensuring the safety of these capabilities.”
  • All “relevant actors” are urged to “provide context-appropriate transparency and accountability on their plans to measure, monitor and mitigate potentially dangerous capabilities and the associated effects that may emerge.”

The UK is aiming to have follow-up meetings on progress toward managing the opportunities and risks of AI every six months following the summit, according to another person familiar with the discussions. 

The UK has also proposed assembling an expert panel of academics from different countries to compile an annual “state of the science” report on AI safety, according to one of the documents accompanying the draft. The annual report would summarize existing research rather than producing new material. Under the plan, countries attending the summit will nominate their own experts to join the panel.

“For the common good, AI must be designed, developed, deployed, and used in such a way as to be human-centric, safe, trustworthy and responsible,” the draft communique says.

Join us at the Fortune Workplace Innovation Summit May 19–20, 2026, in Atlanta. The next era of workplace innovation is here—and the old playbook is being rewritten. At this exclusive, high-energy event, the world’s most innovative leaders will convene to explore how AI, humanity, and strategy converge to redefine, again, the future of work. Register now.
About the Authors
By Ellen Milligan
See full bioRight Arrow Button Icon
By Jillian Deutsch
See full bioRight Arrow Button Icon
By Bloomberg
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

Latest in Tech

AsiaSemiconductors
Why Singapore is the only Southeast Asian country in Pax Silica, the U.S.’s new AI ‘inner circle’
By Angelica AngDecember 30, 2025
2 hours ago
InnovationRobots
Silicon Valley summit offers rare insight into humanoid robots—and China is the clear winner
By Matt O'Brien and The Associated PressDecember 29, 2025
11 hours ago
Sam Altman, standing in front of a large window, gestures with one hand and furrows his brow as he speaks.
AIOpenAI
OpenAI is hiring a ‘head of preparedness’ with a $550,000 salary to mitigate AI dangers that CEO Sam Altman warns will be ‘stressful’
By Sasha RogelbergDecember 29, 2025
13 hours ago
TechYouTube
YouTube’s cofounder and former tech boss doesn’t want his kids to watch short videos, warning short-form content ‘equates to shorter attention spans’
By Marco Quiroz-GutierrezDecember 29, 2025
16 hours ago
SuccessThe Interview Playbook
Gen Z could wave goodbye to résumés because most companies have turned to skills-based recruitment—and find it more effective, research shows
By Orianna Rosa RoyleDecember 29, 2025
17 hours ago
AIthe future of work
‘Godfather of AI’ Geoffrey Hinton predicts 2026 will see the technology get even better and gain the ability to ‘replace many other jobs’
By Jason MaDecember 28, 2025
2 days ago

Most Popular

placeholder alt text
Success
Gen Z could wave goodbye to résumés because most companies have turned to skills-based recruitment—and find it more effective, research shows
By Orianna Rosa RoyleDecember 29, 2025
17 hours ago
placeholder alt text
Success
MacKenzie Scott's close relationship with Toni Morrison long before Amazon put her on the path give more than $1 billion to HBCUs
By Sasha RogelbergDecember 28, 2025
2 days ago
placeholder alt text
Arts & Entertainment
Gen Zers and millennials flock to so-called analog islands 'because so little of their life feels tangible'
By Michael Liedtke and The Associated PressDecember 28, 2025
2 days ago
placeholder alt text
Future of Work
Malcolm Gladwell tells young people if they want a STEM degree, 'don’t go to Harvard.' You may end up at the bottom of your class and drop out
By Sasha RogelbergDecember 27, 2025
3 days ago
placeholder alt text
Banking
Russian official warns a banking crisis is possible amid nonpayments. 'I don’t want to think about a continuation of the war or an escalation'
By Jason MaDecember 27, 2025
2 days ago
placeholder alt text
AI
'Godfather of AI' Geoffrey Hinton predicts 2026 will see the technology get even better and gain the ability to 'replace many other jobs'
By Jason MaDecember 28, 2025
2 days ago

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.