• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

I wrote that Boomers were choking America’s economy. Their responses to me were revealing

2

If Elon Musk merges SpaceX with Tesla he'll create a $3.4 trillion behemoth—with zero profits

3

A rare 'super' El Niño is looking more likely. Here’s what to expect

1

I wrote that Boomers were choking America’s economy. Their responses to me were revealing

2

If Elon Musk merges SpaceX with Tesla he'll create a $3.4 trillion behemoth—with zero profits

3

A rare 'super' El Niño is looking more likely. Here’s what to expect
TechAI

Ensuring customers have confidence, trust in AI models falls to AI chiefs

By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
By
John Kell
John Kell
Contributing Writer and author of CIO Intelligence
Down Arrow Button Icon
May 16, 2024, 10:00 AM ET
Chief AI officers must think about customers' privacy concerns.
Chief AI officers must think about customers' privacy concerns.Illustration by Michele Marconi

Arnab Chakraborty, a senior managing director at consulting giant Accenture, recently recalled a conversation he had with a C-suite leader at a multinational restaurant chain. The executive admitted that leadership still wasn’t fully aware of all the ways artificial intelligence was being used by its workforce. 

Recommended Video

“For them to scale AI, and generative AI more importantly across the enterprise, we need to address these risks,” says Chakraborty. Lately, the conversations Chakraborty has with chief executives, board members, and chief security officers focus on understanding the risks of AI and figuring out how to comply with evolving regulations. 

The gap in AI awareness at that restaurant company may explain why over the past five years, 17 states have enacted 29 bills regulating AI. Of those, 12 were focused on ensuring data privacy and accountability. These laws generally aim to protect consumers from the unauthorized use of their data and ensure they have clear insight into how AI systems collect and use the data they willingly share. Hundreds more are aimed at targeting deepfakes, preventing discrimination, or addressing how the tools can be used for hiring.

“Name your favorite state,” says Intuit chief privacy officer Elise Houlik. “I bet they have an AI regulation proposed.”

Millions use Intuit’s financial products, including TurboTax, QuickBooks, and Credit Karma, giving Intuit a lot of direct access to highly sensitive data. “It is a powerful responsibility,” says Houlik. “When someone makes the decision to give us their data, we have to take that super seriously.”

With new generative AI capabilities emerging, Intuit takes a cross-functional approach to thinking through product development, including perspectives from technologists, security professionals, compliance, and legal.

“There has to be that balancing act between the commercial value of the technology and doing it the right way,” says Houlik.

“I think the legislative surface is becoming more and more stringent,” says Vijay Sankaran, chief technology officer at Johnson Controls, which makes industrial products that make buildings more sustainable. “We try to be very proactive about that.”

Johnson Controls has put up “significant” controls around data and to protect from different aspects of risk. It follows the National Institute of Standards and Technology, or NIST, framework to manage cybersecurity risks. Johnson Controls also practices DevSecOps, which is short for “development, security, and operations,” and integrates security practices at every phase of the software development life cycle, from design to testing to deployment. 

In 2022, Johnson Controls launched a privacy center that sought to proactively share with customers what data Johnson Controls used, how it ensured that data was secure, and the frameworks the company followed to ensure it was compliant with applicable laws in all jurisdictions. 

Johnson Controls also set up an AI council that established principles around data security and explained the company’s use of AI in a digestible manner. “I think it is really important for us to make sure that our customers have confidence in the types of AI models that we’re producing,” says Sankaran.

Each year, Accenture helps clients work through roughly 50,000 AI projects. Before any project begins, it goes through an assessment process that determines level of risk. As an example, one client may be working on developing a loan origination AI system, models that could create bias based on age, race, or gender and thus impact final loan decisions. 

Because that project was deemed high-risk at the start, “it will then initiate a whole series of testing that has to happen in terms of what datasets we are actually looking to use for this particular solution,” says Chakraborty. That could help the client avoid running afoul of emerging laws regulating bias in AI—lawmakers in at least seven states are considering proposals on the issue. 

When Jeremy Barnes thinks about data privacy at cloud-based software provider ServiceNow, he says consistency is key. 

“Our principals, because we’ve been thinking about them for a long time for the most part, they stayed fairly stable,” says Barnes, ServiceNow’s vice president of AI product and platform. That steadiness helps employees stay educated on ensuring that the data they do touch, especially when intersected with artificial intelligence, is safe.

But what continues to evolve is how ServiceNow applies those principles. How do they turn them into policies employees can follow? What are the standard operating procedures for customer data? When a product is built, what are the proper AI guidelines and data privacy requirements that need to be considered? 

“There is no one solution you can turn on, tick the box, and it’s done. You have to be able to adapt,” says Barnes. “The world is changing so fast with AI. Anyone who says they know the full solution is probably not looking in the right places.”

Data breaches like the ongoing saga at UnitedHealth Group highlight the elevated risks that companies are facing, especially as AI gives bad actors new tools to play with to create deepfake images, audio, and video that can more easily trip up employees. A survey from consulting firm Ernst & Young found that one-third of workers are worried they may be responsible for causing a cybersecurity breach, with Gen Z and millennial workers less likely to feel equipped to respond to those threats than older colleagues.

“You have to have a level of adaptability,” says Ibrahim Gokcen, chief data and analytics officer at management consulting firm Aon. “How do you then quickly adopt the organization—the right training and upskilling of the employees—because ultimately, a lot of these data protection, data privacy, and cyber-related things sit with an individual employee? The weakest point is usually an individual employee.”

Aon closely monitors data protection laws that are emerging in various markets, including the United Kingdom, Canada, and the state of California. As both a practitioner of AI and a consumer of Microsoft’s enterprise offerings, Aon says it acts as a “fast follower” on the technology. “That gives us ways of understanding the regulations and implications and making sure once they are law that we comply with them, because we have the right processes and infrastructure to operate in that environment,” says Gokcen.

This article is part of the Chief AI Officer’s must-read guide to AI’s potential.

About the Author
By John KellContributing Writer and author of CIO Intelligence

John Kell is a contributing writer for Fortune and author of Fortune’s CIO Intelligence newsletter.

See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

A man sits at desk and looks anxiously at a computer screen
Economychief executive officer (CEO)
CEOs are losing confidence in the economy and expect conditions to worsen in the next six months, survey finds
By Jacqueline MunisJune 1, 2026
1 hour ago
Torsten Slok, chief economist of Apollo Management
SuccessJobs
Apollo chief economist says there’s ‘zero evidence’ AI is killing jobs—in fact, he says it’s creating them
By Emma BurleighJune 1, 2026
2 hours ago
The elderly and injured are using robots as home care support to help them get around their home
Innovationrobot
The elderly and injured are using robots as home care support to help them get around their home
By The Associated Press and Matt O'BrienJune 1, 2026
2 hours ago
Jensen Huang says Nvidia is ‘reinventing the personal computer’ as it unveils new powerful AI chips
AINvidia
Jensen Huang says Nvidia is ‘reinventing the personal computer’ as it unveils new powerful AI chips
By The Associated Press, Chan Ho-Him and TAIJING WUJune 1, 2026
3 hours ago
Malaysia bans children under 16 from using social media
AsiaSocial Media
Malaysia bans children under 16 from using social media
By The Associated Press and Eileen NgJune 1, 2026
3 hours ago
Elon Musk holding a glass of wine during a U.S. diplomatic visit to China
CryptoSpaceX
SpaceX’s $1.4 billion Bitcoin hoard is a strategic reserve—and an accounting headache
By Jack KubinecJune 1, 2026
3 hours ago

Most Popular

I wrote that Boomers were choking America’s economy. Their responses to me were revealing
Personal Finance
I wrote that Boomers were choking America’s economy. Their responses to me were revealing
By Nick LichtenbergMay 31, 2026
1 day ago
If Elon Musk merges SpaceX with Tesla he'll create a $3.4 trillion behemoth—with zero profits
Investing
If Elon Musk merges SpaceX with Tesla he'll create a $3.4 trillion behemoth—with zero profits
By Shawn TullyMay 31, 2026
1 day ago
A rare 'super' El Niño is looking more likely. Here’s what to expect
Environment
A rare 'super' El Niño is looking more likely. Here’s what to expect
By Brian K. Sullivan and BloombergMay 31, 2026
20 hours ago
When loyalty is rewarded: Top earners who stay in their jobs get much larger pay increases than those who switch
Future of Work
When loyalty is rewarded: Top earners who stay in their jobs get much larger pay increases than those who switch
By Jacqueline MunisMay 30, 2026
2 days ago
Ex–Google CEO Eric Schmidt warns U.S. tech workers: Competing with China’s grueling 12-hour workdays means sacrificing work-life balance
Future of Work
Ex–Google CEO Eric Schmidt warns U.S. tech workers: Competing with China’s grueling 12-hour workdays means sacrificing work-life balance
By Marco Quiroz-GutierrezMay 30, 2026
2 days ago
Jamie Dimon tells Gen Z to 'learn how to think, learn how to earn respect' as he describes 'great meeting' with Zohran Mamdani
Success
Jamie Dimon tells Gen Z to 'learn how to think, learn how to earn respect' as he describes 'great meeting' with Zohran Mamdani
By Nick LichtenbergMay 29, 2026
3 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.