• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

The big data employment boom

By
Clay Dillow
Clay Dillow
Down Arrow Button Icon
By
Clay Dillow
Clay Dillow
Down Arrow Button Icon
September 4, 2013, 5:00 AM ET

FORTUNE — Big data has been favorably cast as “the new oil” and held up as the economic counterweight to America’s sinking manufacturing sector. And while the “data is the new oil” analogy isn’t perfect or even necessarily sound (data is both abundant and renewable, after all), there’s some merit to the metaphor. As oil did at the beginning of the last century, big data is going to drive economies in the century ahead. But it may not do so in the way that many people think it will.

As with oil, companies know data is out there in large quantities and that it’s not enough to simply know where it is — it has to be extracted, refined, and delivered in a usable format to be valuable. And like the energy economy before it, the data economy needs dedicated people — 4.4 million of them by 2015 in the IT field alone, according to an oft-cited Gartner Research analysis.

But here the similarities end. The oil patch has never had much trouble finding and training enough roughnecks to get oil out of the ground, but training up skilled big data professionals is a different enterprise entirely. In the U.S. alone, a McKinsey & Company report projects a shortfall of between 140,000 and 190,000 “deep analytical” big data professionals by 2018 — that is, people with highly technical skills in machine learning, statistics, and/or computer science, the actual hands-on big data people that know how to crunch huge data sets into meaningful information.

But what’s often overlooked in this dim projection of the big data labor market is that the impact of big data on employment goes far deeper than the deep analytics and IT fields. Companies need professionals at all levels that are not necessarily schooled in deep analytics but are nonetheless big data-savvy. These professionals don’t need degrees in computer science or statistics.

MORE: The myth of America’s missing software engineers

A VP at management consulting and technology advisory outfit Booz Allen Hamilton recently told InformationWeek that the company has had great success bringing physicists and music majors onto data science teams — creative thinkers who know less about computer science and more about how to look at big data problems in a different way. Though companies and economies will certainly need data scientists to manage their massive databases and information technology teams to support them, to a far greater degree they’ll need professionals knowledgeable and creative enough to leverage big data to the greatest possible advantage.

“Advances in software, in interface design, and things like that will make it easier to analyze big data in the future,” says Dr. Betsy Page Sigman, a professor at Georgetown University’s McDonough School of Business and an expert on technology and information systems. “So it won’t be as big of a technological hurdle. The more important thing for companies will be to have a lot of people that understand not just how to produce statistics and analytics, but understand how to make better decisions because they have this information.”

Any employment bump tied to the proliferation of big data analytics won’t be confined to IT departments or even to dedicated “data divisions” that emerge within companies. And it isn’t just big data specialists like data scientists and statisticians that stand to benefit from this boom. Big data opportunities are already being exploited in data-centered pursuits like risk management, marketing, and research science, but the applications are virtually limitless.

Academically, big data is playing a role in decidedly non-data disciplines, like some portions of the social sciences and humanities, says Jim Spohrer, computer scientist and director of IBM’s Global University Relations Programs. It will increasingly become integral in medical research, various kinds of product development and modeling, and all types of research science. To remain competitive, companies will require professionals at all levels that fundamentally grasp big data concepts and and know how to use them to their advantage.

“What we’re seeing now is the tip of the iceberg,” Spohrer says. “You think of all the different jobs that exist today. How is all the data associated with each person’s job going to change the job and the skills they need?”

MORE: Don’t cry for Nokia, Finland

Part of this shift will simply require the retooling of existing jobs, but there is also a new class of positions and skills emerging as well, Spohrer says, positions like “chief data officer” that will become more common within existing companies large and small. These jobs won’t necessarily be occupied by deep analytics-types either, but by non-data professionals educated and experienced in their chosen industry while also skilled in the use of big data tools (which, as Sigman noted above, will only become easier for non-data professionals to use).

Existing companies will expand as they deploy more big data resources — both human and technological — to leverage big data to their advantage. But the space to watch isn’t necessarily existing companies reorganizing to embrace big data, but the emerging big data industry where deep analytical job growth is likely to make its biggest economic impacts.

As with so many other specialized endeavors that fall outside the purview of core business — things like advertising and marketing, the latter of which is itself being completely transformed by big data analytics — many big data applications will be farmed out to outside contractors who specialize in big data analysis and problem solving, Sigman says. Scores of big data startups are already emerging (largely with the help of venture capital) to meet this demand, including MapR, ParStream, ScaleArc, and Cloudant. The ones who are able to best meet their customers’ data analytics needs are poised to become home to many of those many millions jobs big data will generate over the next few years.

About the Author
By Clay Dillow
See full bioRight Arrow Button Icon

Latest in

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in

Trump says a ‘final proposal’ for a taxpayer-funded takeover of Spirit Airlines is under consideration
PoliticsAirline industry
Trump says a ‘final proposal’ for a taxpayer-funded takeover of Spirit Airlines is under consideration
By Michelle L. Price, Rio Yamat and The Associated PressMay 1, 2026
6 hours ago
U.S. to withdraw 5,000 troops from Germany as Trump feuds with Merz over the Iran war
EuropeGermany
U.S. to withdraw 5,000 troops from Germany as Trump feuds with Merz over the Iran war
By Ben Finley and The Associated PressMay 1, 2026
6 hours ago
EBay soars on report that GameStop is preparing a takeover bid
Investingecommerce
EBay soars on report that GameStop is preparing a takeover bid
By Spencer Soper, Cecilia D'Anastasio and BloombergMay 1, 2026
6 hours ago
ExxonMobil CEO Darren Woods, far right, listens as U.S. President Donald Trump,left, speaks during a meeting with oil company executives in the East Room of the White House on Jan. 9. President Trump is aiming to convince oil executives to support his plans in Venezuela, a country whose energy resources he says he expects to control for years to come. US forces seized Venezuelan president Nicolas Maduro in a sweeping military operation on January 3, with Trump making no secret that control of Venezuela's oil was at the heart of his actions.
EnergyIran
Exxon Mobil CEO sees ‘more to come’ on price spikes from Iran war as Exxon, Chevron beat on earnings despite plunging profits
By Jordan BlumMay 1, 2026
8 hours ago
trump
PoliticsIran
Trump on Iran: ‘They want to make a deal, I’m not satisfied with it, so we’ll see what happens’
By Toqa Ezzidin, Munir Ahmed, Collin Binkley and The Associated PressMay 1, 2026
10 hours ago
infantino
North AmericaWorld Cup
Fifa’s Infantino predicted sellouts and ‘1,000 years of World Cups at once,’ but fans aren’t biting
By James Robson and The Associated PressMay 1, 2026
10 hours ago

Most Popular

Scott Bessent on financial literacy: 'it drives me crazy' to see young men in blue-collar construction jobs playing the lottery
Personal Finance
Scott Bessent on financial literacy: 'it drives me crazy' to see young men in blue-collar construction jobs playing the lottery
By Fatima Hussein and The Associated PressMay 1, 2026
16 hours ago
China dominates the world's lithium supply. The U.S. just found 328 years' worth in its own backyard
North America
China dominates the world's lithium supply. The U.S. just found 328 years' worth in its own backyard
By Jake AngeloApril 30, 2026
1 day ago
The U.S. economy is booming — just not where 50 million Americans live
Commentary
The U.S. economy is booming — just not where 50 million Americans live
By Derek KilmerMay 1, 2026
20 hours ago
Accenture's Julie Sweet blew up 50 years of company history. She says the hardest part is still ahead
Conferences
Accenture's Julie Sweet blew up 50 years of company history. She says the hardest part is still ahead
By Nick LichtenbergApril 29, 2026
3 days ago
Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
Success
Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
By Preston ForeApril 27, 2026
5 days ago
A Chick-fil-A worker got fired and then showed up behind the register to allegedly refund himself over $80,000 in mac and cheese
Law
A Chick-fil-A worker got fired and then showed up behind the register to allegedly refund himself over $80,000 in mac and cheese
By Catherina GioinoMay 1, 2026
11 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.