• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
NewslettersCEO Daily

BCG consultants solving business problems with OpenAI’s GPT-4 performed 23% worse than those without it, new study finds

By
Claire Zillman
Claire Zillman
and
Alan Murray
Down Arrow Button Icon
September 25, 2023, 4:15 AM ET
A new study suggests some Generative AI tools are best used on creative tasks—for now.
A new study suggests some Generative AI tools are best used on creative tasks—for now. Getty Images

Good morning.

Technology adoption in the computer era has generally started in the consumer sector and then moved—often slowly—into the enterprise, but Generative AI is different. While consumer adoption has been rapid, enterprise adoption has happened almost simultaneously. Fortune brought together a small group of CEOs on Friday, in partnership with BCG, to explore that change and identify both the opportunities and risks. Some excerpts.

Recommended Video

“You need to embrace Gen AI now to develop the muscle. The muscle will change over time. But it’s important to embrace it now. And make sure you have someone who’s responsible for it, at the top of the organization—don’t delegate it down. And then ensure that risk protection is embedded in your risk processes, but also your core processes, like product development, so that it really becomes a cultural element.”

— Sharon Marcil, managing director North America, BCG

“We’ve moved from a strategy supported by technology to a technology-driven strategy that requires a different kind of expertise….You need creativity, people who can think beyond the usual….So for us, it’s more about building the internal capabilities that we can’t get from the outside, and then making sure we have the right partnerships with the people who are outside, who can bring us their best thinking.”

— Tom Wilson, CEO, Allstate

“What happens if I knowingly or unknowingly infringe somebody’s IP?…The bulk of that concern today is coming from clients is in the area of code. Let’s take a maybe not-so-random example. If you are somebody in the payments industry, and you are going to use this for your deep developers to go write something, which is then going to be in place for 20 years, that means in year 15 somebody could come around and say, ‘Wait a moment. Those 10 lines look remarkably similar to what I did.’”

— Arvind Krishna, CEO, IBM

“I think about two ends of the spectrum. There is risk mitigation…making sure we have the guard rails to protect data. Then the question is, how do we refine it? And then, how do we innovate? We are working our way there with lots of experiments”

— Kim Keck, CEO, Blue Cross Blue Shield Association

“I think there is a bit of an overestimation of how fast and how big the immediate savings can be from Generative AI. I think it can be meaningful. But it takes time and a bit more work and expertise to get beyond the very first low-hanging fruits.”

— Barak Eilam, CEO, NICE

“Technology discontinuities in the past with enterprise software…really empowered developers to create great applications. With Generative AI, we are humanizing the technology, and handing over agency to the end user. It’s not developers being more productive. It’s users being more productive…That means you can create upward social mobility in jobs.”

— Ravi Kumar, CEO, Cognizant

If you are eager to dive further into these issues, I’d recommend a study that the folks at BCG published last week, which provides some interesting insight into where Gen AI improves productivity—creative ideation and content creation—and where it doesn’t—business problem solving. In the BCG study, participants using OpenAI’s GPT-4 for solving business problems actually performed 23% worse than those doing the task without GPT-4. Read more here.

Other news below. And read why the folks at Microsoft believe their Gen AI-powered “copilots” will help people navigate a hybrid workplace.


Alan Murray
@alansmurray

alan.murray@fortune.com

TOP NEWS

Writers strike ends

Hollywood writers, studios, and streamers reached a tentative agreement late Sunday that will likely end one of two months-long labor strikes. The three-year deal, the terms of which are not yet public, reportedly includes key concessions for workers, like increased royalties and protections related to the use of AI. The Wall Street Journal 

Lego’s sustainability setback

Lego has for years vowed to develop a brick that’s free of oil-based plastic. Now, the world’s largest toymaker is backtracking on that goal after realizing that the alternative brick, made of recycled plastic, resulted in more emissions. Instead, Lego will aim to make every component of its existing bricks more sustainable. Financial Times 

The 100-year-old CEO

Rupert Murdoch, 92, has retired, but there’s a big pool of CEOs in their 70s, 80s, and even 90s who have vowed to keep working deeper into their golden years. Longer life expectancy and later retirement ages demand that the corporate world come to grips with the prospect of a 100-year-old CEO, reports Fortune’s Lila MacLellan. Fortune

AROUND THE WATERCOOLER

Bill Gates gets real about climate change: Planting trees is ‘complete nonsense’ but the end of the oil and gas era is finally in sight by Paolo Confino

JPMorgan’s energy guru warns oil prices are headed to $100 per barrel. ‘Put your seatbelts on, it’s going to be a very volatile supercycle’ by Will Daniel

Gen Z is souring on college degrees as a path to success, sociology professor says. They have a good reason: Skills-based hiring is the way of the future by Jane Thier

Bill Ackman has employees in the office five days a week but makes an intriguing remote work concession by Steve Mollman

It’s not just you. From record canceled flights to $1,300 car rentals, summer travel this year was a nightmare by Alicia Adamczyk

Commentary: I left OpenAI to support the AI revolution. Here’s why real change won’t come from the epicenter by Zack Kass

This edition of CEO Daily was curated by Claire Zillman. 

This is the web version of CEO Daily, a newsletter of must-read insights from Fortune CEO Alan Murray. Sign up to get it delivered free to your inbox.

About the Authors
Claire Zillman
By Claire ZillmanEditor, Leadership
LinkedIn iconTwitter icon

Claire Zillman is a senior editor at Fortune, overseeing leadership stories. 

See full bioRight Arrow Button Icon
Alan Murray
By Alan Murray
LinkedIn iconTwitter icon
See full bioRight Arrow Button Icon

Latest in Newsletters

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Leadership
  • Success
  • Tech
  • Asia
  • Europe
  • Environment
  • Fortune Crypto
  • Health
  • Retail
  • Lifestyle
  • Politics
  • Newsletters
  • Magazine
  • Features
  • Commentary
  • Mpw
  • CEO Initiative
  • Conferences
  • Personal Finance
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map

© 2025 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.


Most Popular

placeholder alt text
Politics
Buddhist monks peace-walking from Texas to DC persist even after being run over on highway outside Houston
By The Associated PressDecember 30, 2025
2 days ago
placeholder alt text
Health
Lay's drastically rebrands after disturbing finding: 42% of consumers didn't know their chips were made out of potatoes
By Matty Merritt and Morning BrewDecember 31, 2025
1 day ago
placeholder alt text
Europe
George Clooney moves to France and sends a strong message about the American Dream
By Nick LichtenbergDecember 30, 2025
2 days ago
placeholder alt text
C-Suite
Exiting CEO left each employee at his family-owned company a $443,000 gift—but they have to stay 5 more years to get all of it
By Nick LichtenbergDecember 30, 2025
2 days ago
placeholder alt text
Retail
Starbucks CEO Brian Niccol says a Reddit thread about people interviewing at the company convinced him his 'Back to Starbucks' plan is working
By Sasha RogelbergDecember 31, 2025
1 day ago
placeholder alt text
Success
Melinda French Gates got her start at Microsoft because an IBM hiring manager told her to turn down its job offer—'It dumbfounded me'
By Emma BurleighDecember 31, 2025
1 day ago

Latest in Newsletters

NewslettersMPW Daily
Your predictions for women, AI, and the workplace in 2026
By Emma HinchliffeDecember 24, 2025
8 days ago
Vanguard CIO Nitin Tandon.
NewslettersCIO Intelligence
How investment giant Vanguard’s CIO is placing big tech bets today to create the AI digital advisor of tomorrow
By John KellDecember 24, 2025
8 days ago
NewslettersCFO Daily
How AI is redefining finance leadership: ‘There has never been a more exciting time to be a CFO’
By Sheryl EstradaDecember 24, 2025
8 days ago
NewslettersCEO Daily
Expedia CEO Ariane Gorin on the fight to ensure AI doesn’t turn her brands into invisible pipes consumers never see
By Diane BradyDecember 24, 2025
8 days ago
NewslettersTerm Sheet
The AI startups founders and VCs say could be acquisition targets in 2026
By Allie GarfinkleDecember 24, 2025
9 days ago
Thierry Breton, former European Commissioner for the Internal Market, in Paris on June 13, 2025. (Photo: Thomas Samson/AFP/Getty Images)
NewslettersFortune Tech
U.S. denies visas for five Europeans, alleging American censorship
By Andrew NuscaDecember 24, 2025
9 days ago