• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'

2

Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal

3

'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down

1

The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'

2

Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal

3

'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down
ConferencesBrainstorm AI

AI leaders provide a reality check about a technology they say is both ‘exciting’ and still a very ‘manual exercise’

By
Fortune Staff
Fortune Staff
Down Arrow Button Icon
By
Fortune Staff
Fortune Staff
Down Arrow Button Icon
December 13, 2024, 5:05 PM ET
Executives from AARP, Zillow, Glean and swsh discussing AI during a Fortune's Brainstorm AI conference.
Executives from AARP, Zillow, Glean and swsh discussing AI during a Fortune's Brainstorm AI conference.
Add Fortune on Google for similar content.

There’s still a lot of work to do before artificial intelligence products are truly useful.

Recommended Video

At a company like Costco, there are concerns that hallucinations, a common problem in which AI models and tools provide incorrect information, will inadvertently reroute container ships ferrying tens of millions of dollar’s worth of the retailer’s goods. At other companies, cleaning decades of data so that it’s useful enough to dump into a large language model sometimes requires years of work and investment.

These kinds of complications involving AI, and the technology’s huge potential, were the focus of a session at Fortune’s Brainstorm AI conference in San Francisco this week. AI vendors may pitch their products as being magic, but those who are trying to make it work often take a more cautious view.

“I feel like a lot of it is still useless,” one attendee told the panel of speakers, which included Najeeb Uddin, CIO of non-profit AARP; Arvind Jain, CEO of workplace AI chatbot Glean; Alexandra Debow, CEO of photo sharing service swsh, and Nicholas Stevens, vice president of AI product at real estate site Zillow.

Stevens said he sees “exciting” things coming in the next year from AI as it increasingly understands unstructured data, like unlabeled images. Yet, no one argued that AI solved every problem.

“We’re still pretty early,” Debow, of swsh, said about the current wave of AI development. “We’re too early to have a white glove solution. We need a second layer to be built.”

As for where to start building that second layer, Uddin of AARP, which recently developed its own online AI chatbot for its members, said even he was “surprised” at how much of AI remains “a manual exercise” to ensure it works and is accurate for users.

“Usually, it wasn’t the LLM that was the problem, it was our data,” said Uddin, referring to making internal data ready for training large language models that underpin much of AI.

Because AI technology is still a work in progress, Jain, from Glean, urged companies considering AI tools to think of the technology “very much as an enabler” that adds 10% to 20% rather than something that can do a lot more. Responding to concerns about AI steering a container ship loaded with goods to the wrong port, Jain argued that humans should always remain in control.

“There’s no need to eliminate a human in these examples,” Jain said. “When you think what AI can do for you, it shouldn’t really be the bottom line of ‘How can I replace a human?’”

The Fortune 500 Innovation Forum will convene Fortune 500 executives, U.S. policy officials, top founders, and thought leaders to help define what’s next for the American economy, Nov. 16-17 in Detroit. Apply here.
About the Author
By Fortune Staff
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest from our Conferences

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

Latest from our Conferences

At Fortune Brainstorm Tech 2026, Chris Bedi, Chief Customer Officer and Enterprise AI Advisor, ServiceNow; China Widener, Vice Chair and US Technology, Media & Telecommunications Industry Leader, Deloitte; and Phil Wiser, Chief Technology Officer, Paramount, speak on a panel with Kristin Stoller, Fortune editorial director.
NewslettersFortune Workplace Innovation
This tech CEO fired 80% of his workforce over AI resistance. Here’s what he’s learned since then
By Kristin StollerJune 15, 2026
1 month ago
Courtney Robinson, head of policy and communications, at Akoya speaks on a panel at Fortune Brainstorm Tech 2026.
RetailBrainstorm Tech
AI shopping agents are coming. No one is ready for them
By Jeremy KahnJune 12, 2026
1 month ago
The head of Claude Code hasn’t ‘written a line of code by hand’ in 8 months
ConferencesBrainstorm Tech
The head of Claude Code hasn’t ‘written a line of code by hand’ in 8 months
By Nick LichtenbergJune 11, 2026
2 months ago
Sarah Franklin, Chief Executive Officer of Lattice, and Francine Katsoudas, EVP and Chief People, Policy and Purpose Officer at Cisco, speak at Fortune's COO Summit with Kristin Stoller, Editorial Director at Fortune.
NewslettersFortune Workplace Innovation
AI disruption arrived 6 years early—now executives are drawing the line
By Kristin StollerJune 8, 2026
2 months ago
Fortune Brainstorm Tech 2026 livestream
ConferencesBrainstorm Tech
Fortune Brainstorm Tech 2026 livestream
By Fortune EditorsJune 8, 2026
2 months ago
dw
ConferencesCOO Summit
This CEO has had 6 major jobs in Silicon Valley: How Dennis Woodside built a career on saying yes to hard problems
By Nick LichtenbergJune 3, 2026
2 months ago

Most Popular

The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'
Real Estate
The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'
By Nick LichtenbergJuly 25, 2026
1 day ago
Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal
Middle East
Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal
By Jason MaJuly 25, 2026
22 hours ago
'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down
Economy
'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down
By Eleanor PringleJuly 24, 2026
2 days ago
An 11-year-old is cleaning his neighbors' trash cans for $10 each—he now has 100K followers as teens face the worst summer job market since 1948
Success
An 11-year-old is cleaning his neighbors' trash cans for $10 each—he now has 100K followers as teens face the worst summer job market since 1948
By Orianna Rosa RoyleJuly 25, 2026
1 day ago
Startups are installing tiny data centers in people’s homes to reduce strain on the beleaguered electrical grid
Environment
Startups are installing tiny data centers in people’s homes to reduce strain on the beleaguered electrical grid
By Sasha RogelbergJuly 25, 2026
1 day ago
College-educated women are snapping up the highest-earning men without college degrees, leaving the rest further behind
Economy
College-educated women are snapping up the highest-earning men without college degrees, leaving the rest further behind
By Mia OsmonbekovJuly 26, 2026
8 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.