• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup

2

The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting

3

Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock

1

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup

2

The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting

3

Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock
TechAI

Ensuring customers have confidence, trust in AI models falls to AI chiefs

By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
May 16, 2024, 10:00 AM ET
Chief AI officers must think about customers' privacy concerns.
Chief AI officers must think about customers' privacy concerns.Illustration by Michele Marconi
Add Fortune on Google for similar content.

Arnab Chakraborty, a senior managing director at consulting giant Accenture, recently recalled a conversation he had with a C-suite leader at a multinational restaurant chain. The executive admitted that leadership still wasn’t fully aware of all the ways artificial intelligence was being used by its workforce. 

Recommended Video

“For them to scale AI, and generative AI more importantly across the enterprise, we need to address these risks,” says Chakraborty. Lately, the conversations Chakraborty has with chief executives, board members, and chief security officers focus on understanding the risks of AI and figuring out how to comply with evolving regulations. 

The gap in AI awareness at that restaurant company may explain why over the past five years, 17 states have enacted 29 bills regulating AI. Of those, 12 were focused on ensuring data privacy and accountability. These laws generally aim to protect consumers from the unauthorized use of their data and ensure they have clear insight into how AI systems collect and use the data they willingly share. Hundreds more are aimed at targeting deepfakes, preventing discrimination, or addressing how the tools can be used for hiring.

“Name your favorite state,” says Intuit chief privacy officer Elise Houlik. “I bet they have an AI regulation proposed.”

Millions use Intuit’s financial products, including TurboTax, QuickBooks, and Credit Karma, giving Intuit a lot of direct access to highly sensitive data. “It is a powerful responsibility,” says Houlik. “When someone makes the decision to give us their data, we have to take that super seriously.”

With new generative AI capabilities emerging, Intuit takes a cross-functional approach to thinking through product development, including perspectives from technologists, security professionals, compliance, and legal.

“There has to be that balancing act between the commercial value of the technology and doing it the right way,” says Houlik.

“I think the legislative surface is becoming more and more stringent,” says Vijay Sankaran, chief technology officer at Johnson Controls, which makes industrial products that make buildings more sustainable. “We try to be very proactive about that.”

Johnson Controls has put up “significant” controls around data and to protect from different aspects of risk. It follows the National Institute of Standards and Technology, or NIST, framework to manage cybersecurity risks. Johnson Controls also practices DevSecOps, which is short for “development, security, and operations,” and integrates security practices at every phase of the software development life cycle, from design to testing to deployment. 

In 2022, Johnson Controls launched a privacy center that sought to proactively share with customers what data Johnson Controls used, how it ensured that data was secure, and the frameworks the company followed to ensure it was compliant with applicable laws in all jurisdictions. 

Johnson Controls also set up an AI council that established principles around data security and explained the company’s use of AI in a digestible manner. “I think it is really important for us to make sure that our customers have confidence in the types of AI models that we’re producing,” says Sankaran.

Each year, Accenture helps clients work through roughly 50,000 AI projects. Before any project begins, it goes through an assessment process that determines level of risk. As an example, one client may be working on developing a loan origination AI system, models that could create bias based on age, race, or gender and thus impact final loan decisions. 

Because that project was deemed high-risk at the start, “it will then initiate a whole series of testing that has to happen in terms of what datasets we are actually looking to use for this particular solution,” says Chakraborty. That could help the client avoid running afoul of emerging laws regulating bias in AI—lawmakers in at least seven states are considering proposals on the issue. 

When Jeremy Barnes thinks about data privacy at cloud-based software provider ServiceNow, he says consistency is key. 

“Our principals, because we’ve been thinking about them for a long time for the most part, they stayed fairly stable,” says Barnes, ServiceNow’s vice president of AI product and platform. That steadiness helps employees stay educated on ensuring that the data they do touch, especially when intersected with artificial intelligence, is safe.

But what continues to evolve is how ServiceNow applies those principles. How do they turn them into policies employees can follow? What are the standard operating procedures for customer data? When a product is built, what are the proper AI guidelines and data privacy requirements that need to be considered? 

“There is no one solution you can turn on, tick the box, and it’s done. You have to be able to adapt,” says Barnes. “The world is changing so fast with AI. Anyone who says they know the full solution is probably not looking in the right places.”

Data breaches like the ongoing saga at UnitedHealth Group highlight the elevated risks that companies are facing, especially as AI gives bad actors new tools to play with to create deepfake images, audio, and video that can more easily trip up employees. A survey from consulting firm Ernst & Young found that one-third of workers are worried they may be responsible for causing a cybersecurity breach, with Gen Z and millennial workers less likely to feel equipped to respond to those threats than older colleagues.

“You have to have a level of adaptability,” says Ibrahim Gokcen, chief data and analytics officer at management consulting firm Aon. “How do you then quickly adopt the organization—the right training and upskilling of the employees—because ultimately, a lot of these data protection, data privacy, and cyber-related things sit with an individual employee? The weakest point is usually an individual employee.”

Aon closely monitors data protection laws that are emerging in various markets, including the United Kingdom, Canada, and the state of California. As both a practitioner of AI and a consumer of Microsoft’s enterprise offerings, Aon says it acts as a “fast follower” on the technology. “That gives us ways of understanding the regulations and implications and making sure once they are law that we comply with them, because we have the right processes and infrastructure to operate in that environment,” says Gokcen.

This article is part of the Chief AI Officer’s must-read guide to AI’s potential.

About the Author
By John KellContributing Writer and author of CIO Intelligence

John Kell is a contributing writer for Fortune and author of Fortune’s CIO Intelligence newsletter.

See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Jack Schlossberg built a sardonic social media campaign filled just to barely break 10% in Tuesday’s primary
PoliticsPolitics
Jack Schlossberg built a sardonic social media campaign filled just to barely break 10% in Tuesday’s primary
By The Associated Press, Danny Peltz and Anthony IzaguirreJune 24, 2026
59 minutes ago
Matt Garman
Successthe future of work
Amazon exec says AI won’t wipe out white-collar jobs—and is hiring 11,000 grads and interns, and has more developers than 2 years ago to prove it
By Preston ForeJune 24, 2026
1 hour ago
NYC Mayor Zohran Mamdani 3 for 3 on his ‘better Democrats’ endorsements: ‘Put working people back at the heart of politics’
PoliticsNew York City
NYC Mayor Zohran Mamdani 3 for 3 on his ‘better Democrats’ endorsements: ‘Put working people back at the heart of politics’
By The Associated Press, Jesse Bedayn, Thomas Beaumont and HUMERA LODHIJune 24, 2026
1 hour ago
a
RetailAmazon
Amazon’s record Prime Day masks a darker truth: Americans are spending more and getting less
By Nick LichtenbergJune 24, 2026
1 hour ago
Current price of Ethereum for June 24, 2026
Personal FinanceEthereum
Current price of Ethereum for June 24, 2026
By Joseph HostetlerJune 24, 2026
3 hours ago
Taktile cofounders Maik Taro Wehmeyer (left) and Maximilian Eber (right) stand side by side, smiling at the camera.
Startups & VentureVenture Capital
Exclusive: Taktile raises $110 million from Goldman Sachs, Tiger Global to automate high-stakes financial decisions 
By Camila Grigera NaónJune 24, 2026
3 hours ago

Most Popular

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
Success
After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
By Orianna Rosa RoyleJune 23, 2026
1 day ago
The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting
Economy
The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting
By Jacqueline MunisJune 24, 2026
9 hours ago
Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock
Banking
Markets tumble worldwide as Fed resets expectations: $400 billion wiped off SpaceX stock
By Jim EdwardsJune 23, 2026
1 day ago
Current price of oil as of June 23, 2026
Personal Finance
Current price of oil as of June 23, 2026
By Joseph HostetlerJune 23, 2026
1 day ago
Current price of gold as of June 23, 2026
Personal Finance
Current price of gold as of June 23, 2026
By Danny BakstJune 23, 2026
1 day ago
Texas and Charlotte used to build huge McMansions—now they're copying the California design tricks they once mocked
Real Estate
Texas and Charlotte used to build huge McMansions—now they're copying the California design tricks they once mocked
By Sydney LakeJune 22, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.