• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it

2

Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI

3

Current price of oil as of July 6, 2026

1

Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it

2

Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI

3

Current price of oil as of July 6, 2026
TechBig Data

Has big data finally found its killer app?

By
Derrick Harris
Derrick Harris
Down Arrow Button Icon
By
Derrick Harris
Derrick Harris
Down Arrow Button Icon
September 17, 2015, 5:03 PM ET
Gadget Show Sense
Sen.se's smart sensors called Mother and Motion Cookies are on display at the Sen.se booth at the International CES Wednesday, Jan. 7, 2015, in Las Vegas. (AP Photo/Jae C. Hong)Photograph by Jae C. Hong — AP
Add Fortune on Google for similar content.

For years, the open source Hadoop project for managing huge amounts of data has been in the spotlight, but it hasn’t necessarily lived up to its hype. Now it might have finally found its killer app in the Internet of things.

As more companies collect data from devices such as industrial sensors, mobile phones and cars, companies selling Hadoop software can try to swoop in and make sales. During the past couple of quarters, revenue at one of those companies, Hortonworks (HDP), has been growing rapidly—more than doubling on a year-over-year basis—partly because the Internet of things is driving demand for its software, CEO Rob Bearden told Fortune.

“Absolutely, beyond a question of a doubt, it is a functioning, seriously monetizable, fast-growing market,” Bearden said. “…If [companies] can get visibility in real time, and act and react in real time, it completely changes the dynamic of that transaction.”

Earlier this summer, Hortonworks helped advance its story for collecting these new data types by acquiring a startup called Onyara. It spun out of the National Security Agency, and was commercializing NSA-built software used for moving data from its source to other systems that might need to process it.

“The reception in our customer base has been astonishingly positive,” Bearden said of the Onyara acquisition. “Some of the biggest enterprise on planet earth are instantly aligning with this.”

Other open source technologies including Apache Kafka and Apache Spark have also helped to make Hadoop better suited to the Internet of things. They have made getting data into Hadoop and then processing it much faster than before.

For companies trying to profit from Hadoop, the rush to connect devices and analyze their data could not be better. Despite the early hype, fewer customers adopted Hadoop than expected, which limited the market for companies hoping to sell them additional software and support (the core software is open source, even in its commercial form).

Annual revenue at the two most well-known companies in the space, Cloudera and Hortonworks, is around $100 million. But that’s tiny compared with the billions brought in every year by legacy data-management companies such as Oracle (ORCL) and even Teradata.

Analysts point to several factors for the underwhelming adoption, including the complaint that the original set of technologies were quite slow, and therefore helpful for only a limited set of uses. Bearden said that although public market investors are beginning to understand the company’s open source business model and the associated revenue flows, other influential voices still do not.

“The flipside is the financial journalists clearly didn’t go to accounting school,” he said. “… We have not been able to get the level of education that we need there.”

If the Internet of things can help Hortonworks, and its peers Cloudera and MapR (which are eyeing initial public offerings), start making more money, perhaps they’ll have to do less explaining to do. The numbers will be able to speak for themselves. Or perhaps everyone will have to come around to Bearden’s view of the world whether they like it or not.

“The enterprise software companies are in meltdown mode, in general,” he said. As more open source companies go public in the next several quarters, he added before referring to critics and the open source business model, “They’ll be forced to learn it and understand it and absorb it and get it right.”

For more about the business value of data analytics, watch this Fortune video:

Sign up for Data Sheet, Fortune’s daily newsletter about the business of technology.

About the Author
By Derrick Harris
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Presidents aren’t supposed to pick winners, former White House ethics lawyer says. Trump keeps choosing Dell
PoliticsDonald Trump
Presidents aren’t supposed to pick winners, former White House ethics lawyer says. Trump keeps choosing Dell
By Mia OsmonbekovJuly 7, 2026
2 hours ago
Palantir CEO Alex Karp with his arms outstretched while making a point on stage.
NewslettersEye on AI
Palantir CEO Alex Karp is wrong about the threat Anthropic and OpenAI pose to most enterprises. That doesn’t mean he doesn’t have something to lose
By Jeremy KahnJuly 7, 2026
3 hours ago
Scott Wu, in front of a blue background, sits in a gray chair and speaks to a person out of frame.
AIProductivity
Cognition CEO says tech companies got ‘carried away’ with token leaderboards and should measure employees on output instead
By Sasha RogelbergJuly 7, 2026
3 hours ago
Tech worker walks to office
SuccessJobs
AI start-ups are snubbing entry-level talent in favor of Silicon Valley men with top degrees, research shows
By Emma BurleighJuly 7, 2026
6 hours ago
South Korean law targeting ‘fake news’ takes effect, but journalists say it discourages critical reporting and can lead to self-censorship
AsiaSouth Korea
South Korean law targeting ‘fake news’ takes effect, but journalists say it discourages critical reporting and can lead to self-censorship
By The Associated Press and Kim Tong-HyungJuly 7, 2026
6 hours ago
Trump is building a helipad with ‘carved granite’ White House seal to handle new presidential choppers
PoliticsDonald Trump
Trump is building a helipad with ‘carved granite’ White House seal to handle new presidential choppers
By The Associated PressJuly 7, 2026
7 hours ago

Most Popular

Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it
Success
Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it
By Preston ForeJuly 6, 2026
1 day ago
Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
AI
Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
By Marco Quiroz-GutierrezJuly 5, 2026
2 days ago
Current price of oil as of July 6, 2026
Personal Finance
Current price of oil as of July 6, 2026
By Joseph HostetlerJuly 6, 2026
1 day ago
Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
Success
Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
By Preston ForeJuly 4, 2026
4 days ago
The man who ran Bernie's campaign says Democrats are still making the same mistakes with Democratic Socialists, and they should laud Mamdani's win
Politics
The man who ran Bernie's campaign says Democrats are still making the same mistakes with Democratic Socialists, and they should laud Mamdani's win
By Catherina GioinoJuly 6, 2026
24 hours ago
China’s birth rate just hit its lowest point since 1949—and Trip.com cofounder James Liang thinks that’s a threat to innovation
Asia
China’s birth rate just hit its lowest point since 1949—and Trip.com cofounder James Liang thinks that’s a threat to innovation
By Nicholas GordonJuly 7, 2026
14 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.