• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
NewslettersCEO Daily

BCG consultants solving business problems with OpenAI’s GPT-4 performed 23% worse than those without it, new study finds

By
Claire Zillman
Claire Zillman
and
Alan Murray
Alan Murray
Down Arrow Button Icon
By
Claire Zillman
Claire Zillman
and
Alan Murray
Alan Murray
Down Arrow Button Icon
September 25, 2023, 4:15 AM ET
A new study suggests some Generative AI tools are best used on creative tasks—for now.
A new study suggests some Generative AI tools are best used on creative tasks—for now. Getty Images

Good morning.

Technology adoption in the computer era has generally started in the consumer sector and then moved—often slowly—into the enterprise, but Generative AI is different. While consumer adoption has been rapid, enterprise adoption has happened almost simultaneously. Fortune brought together a small group of CEOs on Friday, in partnership with BCG, to explore that change and identify both the opportunities and risks. Some excerpts.

Recommended Video

“You need to embrace Gen AI now to develop the muscle. The muscle will change over time. But it’s important to embrace it now. And make sure you have someone who’s responsible for it, at the top of the organization—don’t delegate it down. And then ensure that risk protection is embedded in your risk processes, but also your core processes, like product development, so that it really becomes a cultural element.”

— Sharon Marcil, managing director North America, BCG

“We’ve moved from a strategy supported by technology to a technology-driven strategy that requires a different kind of expertise….You need creativity, people who can think beyond the usual….So for us, it’s more about building the internal capabilities that we can’t get from the outside, and then making sure we have the right partnerships with the people who are outside, who can bring us their best thinking.”

— Tom Wilson, CEO, Allstate

“What happens if I knowingly or unknowingly infringe somebody’s IP?…The bulk of that concern today is coming from clients is in the area of code. Let’s take a maybe not-so-random example. If you are somebody in the payments industry, and you are going to use this for your deep developers to go write something, which is then going to be in place for 20 years, that means in year 15 somebody could come around and say, ‘Wait a moment. Those 10 lines look remarkably similar to what I did.’”

— Arvind Krishna, CEO, IBM

“I think about two ends of the spectrum. There is risk mitigation…making sure we have the guard rails to protect data. Then the question is, how do we refine it? And then, how do we innovate? We are working our way there with lots of experiments”

— Kim Keck, CEO, Blue Cross Blue Shield Association

“I think there is a bit of an overestimation of how fast and how big the immediate savings can be from Generative AI. I think it can be meaningful. But it takes time and a bit more work and expertise to get beyond the very first low-hanging fruits.”

— Barak Eilam, CEO, NICE

“Technology discontinuities in the past with enterprise software…really empowered developers to create great applications. With Generative AI, we are humanizing the technology, and handing over agency to the end user. It’s not developers being more productive. It’s users being more productive…That means you can create upward social mobility in jobs.”

— Ravi Kumar, CEO, Cognizant

If you are eager to dive further into these issues, I’d recommend a study that the folks at BCG published last week, which provides some interesting insight into where Gen AI improves productivity—creative ideation and content creation—and where it doesn’t—business problem solving. In the BCG study, participants using OpenAI’s GPT-4 for solving business problems actually performed 23% worse than those doing the task without GPT-4. Read more here.

Other news below. And read why the folks at Microsoft believe their Gen AI-powered “copilots” will help people navigate a hybrid workplace.


Alan Murray
@alansmurray

alan.murray@fortune.com

TOP NEWS

Writers strike ends

Hollywood writers, studios, and streamers reached a tentative agreement late Sunday that will likely end one of two months-long labor strikes. The three-year deal, the terms of which are not yet public, reportedly includes key concessions for workers, like increased royalties and protections related to the use of AI. The Wall Street Journal

Lego’s sustainability setback

Lego has for years vowed to develop a brick that’s free of oil-based plastic. Now, the world’s largest toymaker is backtracking on that goal after realizing that the alternative brick, made of recycled plastic, resulted in more emissions. Instead, Lego will aim to make every component of its existing bricks more sustainable. Financial Times

The 100-year-old CEO

Rupert Murdoch, 92, has retired, but there’s a big pool of CEOs in their 70s, 80s, and even 90s who have vowed to keep working deeper into their golden years. Longer life expectancy and later retirement ages demand that the corporate world come to grips with the prospect of a 100-year-old CEO, reports Fortune’s Lila MacLellan. Fortune

AROUND THE WATERCOOLER

Bill Gates gets real about climate change: Planting trees is ‘complete nonsense’ but the end of the oil and gas era is finally in sight by Paolo Confino

JPMorgan’s energy guru warns oil prices are headed to $100 per barrel. ‘Put your seatbelts on, it’s going to be a very volatile supercycle’ by Will Daniel

Gen Z is souring on college degrees as a path to success, sociology professor says. They have a good reason: Skills-based hiring is the way of the future by Jane Thier

Bill Ackman has employees in the office five days a week but makes an intriguing remote work concession by Steve Mollman

It’s not just you. From record canceled flights to $1,300 car rentals, summer travel this year was a nightmare by Alicia Adamczyk

Commentary: I left OpenAI to support the AI revolution. Here’s why real change won’t come from the epicenter by Zack Kass

This edition of CEO Daily was curated by Claire Zillman. 

This is the web version of CEO Daily, a newsletter of must-read insights from Fortune CEO Alan Murray. Sign up to get it delivered free to your inbox.

About the Authors
Claire Zillman
By Claire ZillmanEditor, Leadership
LinkedIn iconTwitter icon

Claire Zillman is a senior editor at Fortune, overseeing leadership stories. 

See full bioRight Arrow Button Icon
Alan Murray
By Alan Murray
LinkedIn iconTwitter icon
See full bioRight Arrow Button Icon

Latest in Newsletters

Goldman Sachs' logo seen displayed on a smartphone with an AI chip and symbol in the background.
NewslettersCFO Daily
Goldman Sachs CFO on the company’s AI reboot, talent, and growth
By Sheryl EstradaDecember 10, 2025
2 hours ago
NewslettersCIO Intelligence
Inside tractor maker CNH’s push to bring more artificial intelligence to the farm
By John KellDecember 10, 2025
3 hours ago
NewslettersTerm Sheet
5 VCs sounds off on the AI question du jour
By Amanda GerutDecember 10, 2025
4 hours ago
Hillary Super at the 2025 Victoria's Secret Fashion Show held at Steiner Studios on October 15, 2025 in New York, New York.
NewslettersCEO Daily
Activist investors are disproportionately targeting female CEOs—and it’s costing corporate America dearly
By Phil WahbaDecember 10, 2025
4 hours ago
Databricks co-founder and CEO Ali Ghodsi (right) with Fortune editorial director Andrew Nusca at Fortune Brainstorm AI 2025 in San Francisco. (Photo: Stuart Isett/Fortune)
NewslettersFortune Tech
How Databricks could achieve a trillion-dollar valuation
By Andrew NuscaDecember 10, 2025
4 hours ago
A man and robot sitting opposite each other.
AIEye on AI
The problem with ‘human in the loop’ AI? Often, it’s the humans
By Jeremy KahnDecember 9, 2025
19 hours ago

Most Popular

placeholder alt text
Economy
‘Fodder for a recession’: Top economist Mark Zandi warns about so many Americans ‘already living on the financial edge’ in a K-shaped economy 
By Eva RoytburgDecember 9, 2025
18 hours ago
placeholder alt text
Success
When David Ellison was 13, his billionaire father Larry bought him a plane. He competed in air shows before leaving it to become a Hollywood executive
By Dave SmithDecember 9, 2025
1 day ago
placeholder alt text
Banking
Jamie Dimon taps Jeff Bezos, Michael Dell, and Ford CEO Jim Farley to advise JPMorgan's $1.5 trillion national security initiative
By Nino PaoliDecember 9, 2025
19 hours ago
placeholder alt text
Uncategorized
Transforming customer support through intelligent AI operations
By Lauren ChomiukNovember 26, 2025
14 days ago
placeholder alt text
Economy
The 'forever layoffs' era hits a recession trigger as corporates sack 1.1 million workers through November
By Nick Lichtenberg and Eva RoytburgDecember 9, 2025
1 day ago
placeholder alt text
Success
Even the man behind ChatGPT, OpenAI CEO Sam Altman, is worried about the ‘rate of change that’s happening in the world right now’ thanks to AI
By Preston ForeDecember 9, 2025
23 hours ago
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.