• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Jeff Bezos pledged $10 billion for climate change. With the 2030 clock ticking, his wife, Lauren Sánchez Bezos, is leading the charge to spend it

2

'I literally was crying last night because I’m nervous about what I’m going to find out': a record 51% of Americans aren't 'cost secure' on health

3

Nvidia CEO Jensen Huang says electricians and plumbers will be needed by the hundreds of thousands in the new working world

1

Jeff Bezos pledged $10 billion for climate change. With the 2030 clock ticking, his wife, Lauren Sánchez Bezos, is leading the charge to spend it

2

'I literally was crying last night because I’m nervous about what I’m going to find out': a record 51% of Americans aren't 'cost secure' on health

3

Nvidia CEO Jensen Huang says electricians and plumbers will be needed by the hundreds of thousands in the new working world
ConferencesBrainstorm AI

AI platforms are grappling with a flood of user-generated content: ‘This will be used by bad people to do bad things, that’s for sure’

By
Dylan Sloan
Dylan Sloan
Down Arrow Button Icon
By
Dylan Sloan
Dylan Sloan
Down Arrow Button Icon
April 15, 2024, 12:53 PM ET
Synthesia co-founder Victor Riparbelli
Victor Riparbelli, cofounder and CEO of AI-generated video platform Synthesia, said that content moderation is an emerging area of focus for his company at the Fortune Brainstorm AI London conference on Monday.Joe Maher—Fortune
Add Fortune on Google for similar content.

AI-generated audio and video platforms are rapidly improving, proving themselves potentially useful in areas from entertainment to HR. But its leaders acknowledge that there are risks—and that they’ll have to be careful about enforcing moderation policies that prevent users from deploying AI to impersonate public figures or commit fraud.

Recommended Video

Speaking with Fortune senior writer Jeremy Kahn at our Brainstorm AI London conference, Synthesia CEO Victor Riparbelli and ElevenLabs CEO Mati Staniszewski said that they’re still figuring out how to ensure that the voice-cloning and video-generation tech their companies provide is used for good.

“As with most new tech, we immediately go to what things can go wrong. In this case, that’s right—this will be used by bad people to do bad things, that’s for sure,” Riparbelli, cofounder of the video-generation platform, said.

Using AI-generated audio or video to impersonate public figures has emerged as a controversial topic. The past few months have seen the creation of explicit deepfakes of Taylor Swift and fake Joe Biden robocalls, leading observers to worry about how AI-generated content will influence this fall’s U.S. presidential election. 

OpenAI recently announced it would delay the rollout of its AI voice cloning tool owing to risks of misuse and highlighting the possible political implications: “We recognize that generating speech that resembles people’s voices has serious risks, which are especially top of mind in an election year,” it wrote in a statement.

Staniszewski, cofounder of AI voice cloning company ElevenLabs, told Fortune’s Kahn that his company invests in know-your-customer protocols and mandatory disclosures to ensure that all content generated on the platform is linked back to a specific user’s profile. The company is also exploring different ways to make it clear to users what content is AI-generated and what’s not, he said.

“All the content that is generated by ElevenLabs can be traced back to a specific account,” Staniszewski said. “One thing we are advocating for is going beyond watermarking what’s AI and watermarking what’s real content.”

Riparbelli said that Synthesia has protocols in place requiring users to verify their identity and give their consent before creating AI-generated videos.

“It is impossible today to go in and take a YouTube video and make clones of someone [on Synthesia]. We take control that way,” Riparbelli said. “We have pretty heavy content moderation, rules about what you can create and what you cannot create.”

A reporter asked about the potential risks of audio deepfakes in reference to London Mayor Sadiq Khan, who was the target of a viral audio clip impersonating him criticizing pro-Palestine marches last November.

“Parliament needs to wake up and understand that if they don’t take action, it’ll provide opportunities for mischief-makers to be bolder,” Khan told the BBC.

“All the content out there should be known as AI-generated, and there should be tools that allow you to quickly get that information as a user … so Sadiq Khan can send out a message, and we can verify that this is a real message,” Staniszewski said.

Riparbelli said that it would likely take time for the industry and lawmakers to come to a consensus regarding how best to use and regulate the tools like the one his and Staniszewski’s companies are offering.

“As with any new technology, you will have these years where people are figuring out what’s right and what’s wrong,” Riparbelli said. 

The Fortune 500 Innovation Forum will convene Fortune 500 executives, U.S. policy officials, top founders, and thought leaders to help define what’s next for the American economy, Nov. 16-17 in Detroit. Apply here.
About the Author
By Dylan Sloan
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest from our Conferences

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest from our Conferences

At Fortune Brainstorm Tech 2026, Chris Bedi, Chief Customer Officer and Enterprise AI Advisor, ServiceNow; China Widener, Vice Chair and US Technology, Media & Telecommunications Industry Leader, Deloitte; and Phil Wiser, Chief Technology Officer, Paramount, speak on a panel with Kristin Stoller, Fortune editorial director.
NewslettersFortune Workplace Innovation
This tech CEO fired 80% of his workforce over AI resistance. Here’s what he’s learned since then
By Kristin StollerJune 15, 2026
6 days ago
Courtney Robinson, head of policy and communications, at Akoya speaks on a panel at Fortune Brainstorm Tech 2026.
RetailBrainstorm Tech
AI shopping agents are coming. No one is ready for them
By Jeremy KahnJune 12, 2026
8 days ago
The head of Claude Code hasn’t ‘written a line of code by hand’ in 8 months
ConferencesBrainstorm Tech
The head of Claude Code hasn’t ‘written a line of code by hand’ in 8 months
By Nick LichtenbergJune 11, 2026
10 days ago
Sarah Franklin, Chief Executive Officer of Lattice, and Francine Katsoudas, EVP and Chief People, Policy and Purpose Officer at Cisco, speak at Fortune's COO Summit with Kristin Stoller, Editorial Director at Fortune.
NewslettersFortune Workplace Innovation
AI disruption arrived 6 years early—now executives are drawing the line
By Kristin StollerJune 8, 2026
13 days ago
Fortune Brainstorm Tech 2026 livestream
ConferencesBrainstorm Tech
Fortune Brainstorm Tech 2026 livestream
By Fortune EditorsJune 8, 2026
13 days ago
dw
ConferencesCOO Summit
This CEO has had 6 major jobs in Silicon Valley: How Dennis Woodside built a career on saying yes to hard problems
By Nick LichtenbergJune 3, 2026
18 days ago

Most Popular

Jeff Bezos pledged $10 billion for climate change. With the 2030 clock ticking, his wife, Lauren Sánchez Bezos, is leading the charge to spend it
Environment
Jeff Bezos pledged $10 billion for climate change. With the 2030 clock ticking, his wife, Lauren Sánchez Bezos, is leading the charge to spend it
By Sydney LakeJune 19, 2026
2 days ago
'I literally was crying last night because I’m nervous about what I’m going to find out': a record 51% of Americans aren't 'cost secure' on health
Health
'I literally was crying last night because I’m nervous about what I’m going to find out': a record 51% of Americans aren't 'cost secure' on health
By Ali Swenson, Amelia Thomson-Deveaux and The Associated PressJune 20, 2026
13 hours ago
Nvidia CEO Jensen Huang says electricians and plumbers will be needed by the hundreds of thousands in the new working world
Success
Nvidia CEO Jensen Huang says electricians and plumbers will be needed by the hundreds of thousands in the new working world
By Preston ForeJune 20, 2026
18 hours ago
The Great Recession’s missing children are finally bringing college’s financial crisis into sight. Welcome to the ‘enrollment volatility’ era
Economy
The Great Recession’s missing children are finally bringing college’s financial crisis into sight. Welcome to the ‘enrollment volatility’ era
By Tristan BoveJune 20, 2026
22 hours ago
Microsoft boss Steve Ballmer publicly dismissed Chrome as a 'rounding error'—but Google’s CEO says he used the jab as fuel to win the browser-wars
Success
Microsoft boss Steve Ballmer publicly dismissed Chrome as a 'rounding error'—but Google’s CEO says he used the jab as fuel to win the browser-wars
By Preston ForeJune 17, 2026
4 days ago
Anne Hathaway says she was spammed with ChatGPT-written thank you notes after hiring for a recent role: ‘Nobody on that list gets that job’
Success
Anne Hathaway says she was spammed with ChatGPT-written thank you notes after hiring for a recent role: ‘Nobody on that list gets that job’
By Orianna Rosa RoyleJune 18, 2026
3 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.