• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
NewslettersCEO Daily

BCG consultants solving business problems with OpenAI’s GPT-4 performed 23% worse than those without it, new study finds

By
Claire Zillman
Claire Zillman
and
Alan Murray
Alan Murray
Down Arrow Button Icon
By
Claire Zillman
Claire Zillman
and
Alan Murray
Alan Murray
Down Arrow Button Icon
September 25, 2023, 4:15 AM ET
A new study suggests some Generative AI tools are best used on creative tasks—for now.
A new study suggests some Generative AI tools are best used on creative tasks—for now. Getty Images

Good morning.

Technology adoption in the computer era has generally started in the consumer sector and then moved—often slowly—into the enterprise, but Generative AI is different. While consumer adoption has been rapid, enterprise adoption has happened almost simultaneously. Fortune brought together a small group of CEOs on Friday, in partnership with BCG, to explore that change and identify both the opportunities and risks. Some excerpts.

Recommended Video

“You need to embrace Gen AI now to develop the muscle. The muscle will change over time. But it’s important to embrace it now. And make sure you have someone who’s responsible for it, at the top of the organization—don’t delegate it down. And then ensure that risk protection is embedded in your risk processes, but also your core processes, like product development, so that it really becomes a cultural element.”

— Sharon Marcil, managing director North America, BCG

“We’ve moved from a strategy supported by technology to a technology-driven strategy that requires a different kind of expertise….You need creativity, people who can think beyond the usual….So for us, it’s more about building the internal capabilities that we can’t get from the outside, and then making sure we have the right partnerships with the people who are outside, who can bring us their best thinking.”

— Tom Wilson, CEO, Allstate

“What happens if I knowingly or unknowingly infringe somebody’s IP?…The bulk of that concern today is coming from clients is in the area of code. Let’s take a maybe not-so-random example. If you are somebody in the payments industry, and you are going to use this for your deep developers to go write something, which is then going to be in place for 20 years, that means in year 15 somebody could come around and say, ‘Wait a moment. Those 10 lines look remarkably similar to what I did.’”

— Arvind Krishna, CEO, IBM

“I think about two ends of the spectrum. There is risk mitigation…making sure we have the guard rails to protect data. Then the question is, how do we refine it? And then, how do we innovate? We are working our way there with lots of experiments”

— Kim Keck, CEO, Blue Cross Blue Shield Association

“I think there is a bit of an overestimation of how fast and how big the immediate savings can be from Generative AI. I think it can be meaningful. But it takes time and a bit more work and expertise to get beyond the very first low-hanging fruits.”

— Barak Eilam, CEO, NICE

“Technology discontinuities in the past with enterprise software…really empowered developers to create great applications. With Generative AI, we are humanizing the technology, and handing over agency to the end user. It’s not developers being more productive. It’s users being more productive…That means you can create upward social mobility in jobs.”

— Ravi Kumar, CEO, Cognizant

If you are eager to dive further into these issues, I’d recommend a study that the folks at BCG published last week, which provides some interesting insight into where Gen AI improves productivity—creative ideation and content creation—and where it doesn’t—business problem solving. In the BCG study, participants using OpenAI’s GPT-4 for solving business problems actually performed 23% worse than those doing the task without GPT-4. Read more here.

Other news below. And read why the folks at Microsoft believe their Gen AI-powered “copilots” will help people navigate a hybrid workplace.


Alan Murray
@alansmurray

alan.murray@fortune.com

TOP NEWS

Writers strike ends

Hollywood writers, studios, and streamers reached a tentative agreement late Sunday that will likely end one of two months-long labor strikes. The three-year deal, the terms of which are not yet public, reportedly includes key concessions for workers, like increased royalties and protections related to the use of AI. The Wall Street Journal 

Lego’s sustainability setback

Lego has for years vowed to develop a brick that’s free of oil-based plastic. Now, the world’s largest toymaker is backtracking on that goal after realizing that the alternative brick, made of recycled plastic, resulted in more emissions. Instead, Lego will aim to make every component of its existing bricks more sustainable. Financial Times 

The 100-year-old CEO

Rupert Murdoch, 92, has retired, but there’s a big pool of CEOs in their 70s, 80s, and even 90s who have vowed to keep working deeper into their golden years. Longer life expectancy and later retirement ages demand that the corporate world come to grips with the prospect of a 100-year-old CEO, reports Fortune’s Lila MacLellan. Fortune

AROUND THE WATERCOOLER

Bill Gates gets real about climate change: Planting trees is ‘complete nonsense’ but the end of the oil and gas era is finally in sight by Paolo Confino

JPMorgan’s energy guru warns oil prices are headed to $100 per barrel. ‘Put your seatbelts on, it’s going to be a very volatile supercycle’ by Will Daniel

Gen Z is souring on college degrees as a path to success, sociology professor says. They have a good reason: Skills-based hiring is the way of the future by Jane Thier

Bill Ackman has employees in the office five days a week but makes an intriguing remote work concession by Steve Mollman

It’s not just you. From record canceled flights to $1,300 car rentals, summer travel this year was a nightmare by Alicia Adamczyk

Commentary: I left OpenAI to support the AI revolution. Here’s why real change won’t come from the epicenter by Zack Kass

This edition of CEO Daily was curated by Claire Zillman. 

This is the web version of CEO Daily, a newsletter of must-read insights from Fortune CEO Alan Murray. Sign up to get it delivered free to your inbox.

About the Authors
Claire Zillman
By Claire ZillmanEditor, Leadership
LinkedIn iconTwitter icon

Claire Zillman is a senior editor at Fortune, overseeing leadership stories. 

See full bioRight Arrow Button Icon
Alan Murray
By Alan Murray
LinkedIn iconTwitter icon
See full bioRight Arrow Button Icon

Latest in Newsletters

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Newsletters

Meta's Hyperion data-center site in Northeastern Louisiana.
NewslettersEye on AI
Big Tech will spend nearly $700 billion on AI this year. No one knows where the buildout ends
By Sharon GoldmanApril 30, 2026
9 hours ago
The Tory Burch Foundation is almost halfway to its $1 billion goal for women entrepreneurs
NewslettersMPW Daily
The Tory Burch Foundation is almost halfway to its $1 billion goal for women entrepreneurs
By Emma HinchliffeApril 30, 2026
12 hours ago
The startup that wants to give surgeons X-ray vision
NewslettersTerm Sheet
The startup that wants to give surgeons X-ray vision
By Allie GarfinkleApril 30, 2026
16 hours ago
Google Cloud CEO Thomas Kurian at Fortune Brainstorm AI 2025 in San Francisco. (Photo: Stuart Isett/Fortune)
NewslettersFortune Tech
Google Cloud is almost one-fifth of Alphabet’s business
By Andrew NuscaApril 30, 2026
17 hours ago
The $665 billion question: Will Big Tech’s AI gamble pay off?
NewslettersCEO Daily
The $665 billion question: Will Big Tech’s AI gamble pay off?
By Diane BradyApril 30, 2026
18 hours ago
How JPMorgan’s CIO is reshaping work at the bank with a $19.8 billion annual tech and AI budget
NewslettersCIO Intelligence
How JPMorgan’s CIO is reshaping work at the bank with a $19.8 billion annual tech and AI budget
By John KellApril 29, 2026
1 day ago

Most Popular

Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
Success
Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
By Preston ForeApril 27, 2026
4 days ago
Google Cloud revenue is now 18% of Alphabet's business. Is this the beginning of the end of Google's search identity?
Big Tech
Google Cloud revenue is now 18% of Alphabet's business. Is this the beginning of the end of Google's search identity?
By Alexei OreskovicApril 29, 2026
1 day ago
‘The cost of compute is far beyond the costs of the employees’: Nvidia executive says right now AI is more expensive than paying human workers
AI
‘The cost of compute is far beyond the costs of the employees’: Nvidia executive says right now AI is more expensive than paying human workers
By Sasha RogelbergApril 28, 2026
3 days ago
With no end in sight, Trump considers new options in Iran war—including the ‘Dark Eagle’ hypersonic missile
Big Tech
With no end in sight, Trump considers new options in Iran war—including the ‘Dark Eagle’ hypersonic missile
By Jim EdwardsApril 30, 2026
18 hours ago
China dominates the world's lithium supply. The U.S. just found 328 years' worth in its own backyard
North America
China dominates the world's lithium supply. The U.S. just found 328 years' worth in its own backyard
By Jake AngeloApril 30, 2026
10 hours ago
No, tariffs are not strengthening the economy
Commentary
No, tariffs are not strengthening the economy
By Alex DuranteApril 29, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.