• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

U.S. companies have finally gotten $71 billion in tariff refunds, but they’re using it to offset inflation caused by the Iran war

2

FedEx CEO says we are in the middle of the biggest supply chain shift he’s seen in 35 years: ‘We are the referendum’

3

Kevin O’Leary claimed opposition to his Utah data center was fueled by Chinese money. Now he and Fox News are being sued for defamation

1

U.S. companies have finally gotten $71 billion in tariff refunds, but they’re using it to offset inflation caused by the Iran war

2

FedEx CEO says we are in the middle of the biggest supply chain shift he’s seen in 35 years: ‘We are the referendum’

3

Kevin O’Leary claimed opposition to his Utah data center was fueled by Chinese money. Now he and Fox News are being sued for defamation
CommentarySemiconductors

We need more powerful processors for the A.I. revolution. Too bad the chip industry is not keeping up

By
Rakesh Kumar
Rakesh Kumar
Down Arrow Button Icon
By
Rakesh Kumar
Rakesh Kumar
Down Arrow Button Icon
June 12, 2023, 8:30 PM ET
Updated June 14, 2023, 1:31 PM ET
Rakesh Kumar, author of "Reluctant Technophiles," argues that the chip industry is surprisingly bad at innovating—meaning that we aren't getting more computing power right as we need it for A.I.
Rakesh Kumar, author of "Reluctant Technophiles," argues that the chip industry is surprisingly bad at innovating—meaning that we aren't getting more computing power right as we need it for A.I. VCG—VCG via Getty Images
Add Fortune on Google for similar content.

Everyone is talking about chips again, thanks to A.I and a rosy forecast from Nvidia. The news drove investors to flock to A.I.-related stocks to the tune of $300 billion in added value last month.

But all this optimism shouldn’t distract us from one of the chip industry’s key problems: Chips have stopped providing real jumps in computing power, right as we see an explosion of power-hungry applications like generative A.I.

Historically, the computing power of chips has doubled every two years in what became to be known as “Moore’s Law.” But we haven’t seen that jump in performance for a while. Now, a microprocessor’s performance increases by only about 10-15% each year—and the actual increase in speed for a given software application is often much smaller. And the process of rearchitecting software for these chips can be expensive and buggy.

This slowdown could not have come at a worse time. Chips are simply not able to keep up with some of the most computation-intensive applications yet seen. The size of models used for tasks like computer vision, natural language processing, and speech processing has increased by 15 times in just two years, an order of magnitude higher than the increase in computer power in chips over the same period. The most advanced machine learning models, like those that power GPT-4 and ChatGPT, have increased by 75 times, again much more than the power of the graphics processing units (GPUs) that underlie them.

The gap between what’s needed and what’s provided can only be filled by more chips. And that’s making computing expensive for everyone. It’s now so expensive to build advanced machine learning models that they are now the exclusive domain of rich, powerful corporations.

Why are chips lagging so far behind?

There are technical challenges. It’s hard to make chips smaller than they already are—transistors, at their thinnest dimension, are only a few atoms thick.

But it’s a partial explanation at best. Chips haven’t kept up with the needs of contemporary applications for quite some time—and even on the best of days, improvements in chip speed have lagged improvements in software algorithms.

A better reason is that the chip industry has not been all that innovative, especially recently. Microprocessors have worked in more or less the same way for 40 years, even as devices get smaller. We haven’t changed how we use computer memory in decades. And the GPUs that power advanced machine learning also haven’t changed much in the past 10 years.

Slowing miniaturization is exposing the lack of disruptive ideas in the industry. No chip company appears in recent lists of innovative companies. And the unchanging ranks at the top of the industry suggest an oligopoly.

Innovation needs an ecosystem where companies, typically startups, want to experiment in the hopes of a breakout success.

The chip industry doesn’t have many of those experiments.

First, the cost of experimentation is extremely high. It often takes $10-30 million just to get the first product, and another $70-100 million to scale up. These extraordinarily large sums of money discourage risk-taking, entrepreneurship, and funding. As a result, not many chip startups are formed, and the few that get funding come from teams of seasoned chip veterans. This recipe leads to incrementalism, not disruption.

Second, the gestation period for new ideas is too long. It typically takes a few years before the first product sample is created and it may take just as long again to see revenue. This long period, again, discourages both innovators and investors that typically prefer to “fail fast”.

Third, the chip industry is too consolidated, dropping from 160 companies in 2010 to 97 in 2020. A lack of buyers constrains the size of exits, further discouraging investors.

Chips attract less than 1% of total U.S. venture capital investment, despite the emergence of A.I., the Internet of Things, electric cars, and 5G.

Finally, the chip industry may not be attracting talent. Today’s STEM graduates see better prospects in industries with much faster growth (including, perhaps ironically, A.I.). This chip industry also has a branding problem—even chip industry executives agree that the sector has a weak brand. Young employees and future innovators want to tinker with software more than struggle with new hardware.

The U.S. government must use its CHIPS Act funding as a lever to make the chip industry more welcoming to innovation.

To bring down the cost and time needed for a new idea, the government should require recipients of government money to allocate money to more agile methods of hardware design, open-source tools, and open standards. It should require recipients to make commonly-used hardware components widely accessible at a low cost, so that other companies can combine them with innovative components to create new hardware platforms cheaply and quickly.

Academic CHIPS Act beneficiaries should be required to modernize chip design curriculums to emphasize accessibility and impact. 

The government should allocate some National Science and Technology Council funding to develop a shared, subsidized infrastructure for design and fabrication with mature, trailing technologies to reduce the cost of producing proof-of-concept hardware.

And, finally, it can encourage the passage of right-to-repair legislation to help stimulate a culture of tinkering with hardware.

The chip industry has managed to mask its struggle with disruptive innovation for some time. And as miniaturization comes to a close, or at least loses its effectiveness, it’s time to address the innovation head on. Technological progress—literally—depends on it.

Rakesh Kumar is a Professor in the Electrical and Computer Engineering department at the University of Illinois and author of Reluctant Technophiles: India’s Complicated Relationship with Technology.

The opinions expressed in Fortune.com Commentary pieces are solely the views of their authors, and do not reflect the opinions and beliefs of Fortune.

Correction, June 15, 2023: An earlier version of this article misstated the length of time that the industry has relied on current frameworks for computer processors.

About the Author
By Rakesh Kumar
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Commentary

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Commentary

time
CommentaryDaylight Saving Time
It’s time to dump time zones
By Steve H. HankeJuly 18, 2026
8 hours ago
Svenja Gudell, Chief Economist, Indeed
Commentaryaging
Indeed chief economist: Aging Baby Boomers are America’s real labor problem, not AI
By Svenja GudellJuly 18, 2026
12 hours ago
shelton
Commentarydisruption
Former Obama official on AI anxiety and the depression nobody remembers — and the training model that gives him hope
By Jim SheltonJuly 17, 2026
1 day ago
dollar
CommentaryCurrency
The dollar’s demise has been predicted for 55 years. The BCG Institute says it’s still overstated
By Philipp Carlsson-Szlezak, Nikolaus Lang and Paul SwartzJuly 17, 2026
1 day ago
Europe optimized its supply chains for cost. Now it must pay for resilience  
Commentarysupply chains
Europe optimized its supply chains for cost. Now it must pay for resilience  
By Richard SaynorJuly 16, 2026
2 days ago
tony
Commentarydisruption
Genesys CEO: We can see firsthand how AI is changing — not replacing — work
By Tony BatesJuly 16, 2026
2 days ago

Most Popular

U.S. companies have finally gotten $71 billion in tariff refunds, but they’re using it to offset inflation caused by the Iran war
Economy
U.S. companies have finally gotten $71 billion in tariff refunds, but they’re using it to offset inflation caused by the Iran war
By Sasha RogelbergJuly 17, 2026
2 days ago
FedEx CEO says we are in the middle of the biggest supply chain shift he’s seen in 35 years: ‘We are the referendum’
C-Suite
FedEx CEO says we are in the middle of the biggest supply chain shift he’s seen in 35 years: ‘We are the referendum’
By Fortune EditorsJuly 15, 2026
3 days ago
Kevin O’Leary claimed opposition to his Utah data center was fueled by Chinese money. Now he and Fox News are being sued for defamation
Law
Kevin O’Leary claimed opposition to his Utah data center was fueled by Chinese money. Now he and Fox News are being sued for defamation
By Marco Quiroz-GutierrezJuly 17, 2026
2 days ago
Trump may have to choose between an endless quagmire and ceding the Strait of Hormuz to Iran
Energy
Trump may have to choose between an endless quagmire and ceding the Strait of Hormuz to Iran
By Jordan BlumJuly 18, 2026
14 hours ago
Indeed chief economist: Aging Baby Boomers are America's real labor problem, not AI
Commentary
Indeed chief economist: Aging Baby Boomers are America's real labor problem, not AI
By Svenja GudellJuly 18, 2026
12 hours ago
Peter Thiel just gave the public its closest look yet at his 'Antichrist' theory—and it's a tech and climate regulator
Politics
Peter Thiel just gave the public its closest look yet at his 'Antichrist' theory—and it's a tech and climate regulator
By Nick LichtenbergJuly 18, 2026
11 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.