• Home
  • News
  • Fortune 500
  • Tech
  • Finance
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechAI

California lawmakers pass bills to ban deepfakes and set safety measures on large AI models

By
Trân Nguyễn
Trân Nguyễn
and
The Associated Press
The Associated Press
By
Trân Nguyễn
Trân Nguyễn
and
The Associated Press
The Associated Press
September 1, 2024, 10:52 AM ET
Gavin Newsom clapping
California Gov. Gavin Newsom at the Democratic National Convention on Aug. 19.Tom Williams—CQ-Roll Call, Inc via Getty Images

California lawmakers approved a host of proposals this week aiming to regulate the artificial intelligence industry, combat deepfakes and protect workers from exploitation by the rapidly evolving technology.

Recommended Video

The California Legislature, which is controlled by Democrats, is voting on hundreds of bills during its final week of the session to send to Gov. Gavin Newsom’s desk. Their deadline is Saturday.

The Democratic governor has until Sept. 30 to sign the proposals, veto them or let them become law without his signature. Newsom signaled in July he will sign a proposal to crack down on election deepfakes but has not weighed in other legislation.

He warned earlier this summer that overregulation could hurt the homegrown industry. In recent years, he often has cited the state’s budget troubles when rejecting legislation that he would otherwise support.

Here is a look at some of the AI bills lawmakers approved this year.

Combatting deepfakes

Citing concerns over how AI tools are increasingly being used to trick voters and generate deepfake pornography of minors, California lawmakers approved several bills this week to crack down on the practice.

Lawmakers approved legislation to ban deepfakes related to elections and require large social media platforms to remove the deceptive material 120 days before Election Day and 60 days thereafter. Campaigns also would be required to publicly disclose if they’re running ads with materials altered by AI.

A pair of proposals would make it illegal to use AI tools to create images and videos of child sexual abuse. Current law does not allow district attorneys to go after people who possess or distribute AI-generated child sexual abuse images if they cannot prove the materials are depicting a real person.

Tech companies and social media platforms would be required to provide AI detection tools to users under another proposal.

Settng safety guardrails

California could become the first state in the nation to set sweeping safety measures on large AI models.

The legislation sent by lawmakers to the governor’s desk requires developers to start disclosing what data they use to train their models. The efforts aim to shed more light into how AI models work and prevent future catastrophic disasters.

Another measure would require the state to set safety protocols preventing risks and algorithmic discrimination before agencies could enter any contract involving AI models used to define decisions.

Protecting workers

Inspired by the months-long Hollywood actors strike last year, lawmakers approved a proposal to protect workers, including voice actors and audiobook performers, from being replaced by their AI-generated clones. The measure mirrors language in the contract the SAG-AFTRA made with studios last December.

State and local agencies would be banned from using AI to replace workers at call centers under one of the proposals.

California also may create penalties for digitally cloning dead people without consent of their estates.

Keeping up with the technology

As corporations increasingly weave AI into Americans’ daily lives, state lawmakers also passed several bills to increase AI literacy.

One proposal would require a state working group to consider incorporating AI skills into math, science, history and social science curriculums. Another would develop guideline on how schools could use AI in the classrooms.

Fortune Brainstorm AI returns to San Francisco Dec. 8–9 to convene the smartest people we know—technologists, entrepreneurs, Fortune Global 500 executives, investors, policymakers, and the brilliant minds in between—to explore and interrogate the most pressing questions about AI at another pivotal moment. Register here.
About the Authors
By Trân Nguyễn
See full bioRight Arrow Button Icon
By The Associated Press
See full bioRight Arrow Button Icon
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.