• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechBig Data

Pivotal open sources tech for SQL and machine learning on Hadoop

By
Derrick Harris
Derrick Harris
Down Arrow Button Icon
By
Derrick Harris
Derrick Harris
Down Arrow Button Icon
September 29, 2015, 12:32 PM ET
Pivotal chief executive Paul Maritz speaks at the 2014 Fortune Brainstorm Tech conference in Aspen, Colorado.
Pivotal chief executive Paul Maritz speaks at the 2014 Fortune Brainstorm Tech conference in Aspen, Colorado.Kevin Moloney/Fortune Brainstorm TECH

Pivotal, the software company that spun out of EMC (EMC) and VMware (VMW) in 2013, is open sourcing technologies for performing advanced analytics on data stored in the Hadoop big data platform.

The two technologies—HAWQ, a scale-out SQL database on Hadoop, and MADlib, a library of machine learning algorithms for databases like HAWQ—will be released as open source projects to the Apache Software Foundation. (MADlib was technically open source already, but was not an Apache project). The move is a continuation of what Pivotal started in February, when it open sourced the code for its Greenplum database software and its proprietary distribution of the Hadoop software.

As part of that February announcement, Pivotal created an organization called the Open Data Platform, along with former competitor Hortonworks (HDP) and a handful of other companies. All of them vowed to build Hadoop technologies around a standard core that’s essentially the core of the Hortonworks software platform, but reserved the right to add proprietary technology around the edges.

A generous take on all this activity would be to say that Pivotal is making a noble gesture by open sourcing these technologies in the name of the greater big data community.

Probably a more realistic view is that Pivotal knows it cannot sell a suite of proprietary software products into a space dominated by companies such as Cloudera, Hortonworks and MapR that exist solely to sell big data software, and that are already pushing largely open source technologies. Viewed in this light, Pivotal hopes that open source versions of its software will spur more companies to start using them, and maybe paying for support down the line, and that the open source community will help pick up the pace of development on these technologies.

When Pivotal spun out from EMC and VMware, it brought along with it a slew of technologies old and new for cloud computing and big data processing. It has yet to really merge them into a holistic platform and, in fact, the cloud business (powered by another open source technology called Cloud Foundry) appears to have taken off while the big data business and tech looks a little staid. Releasing its big data technologies into the open is a good way to minimize investment while holding onto the possibility of generating some revenue should they finally take off.

For more about the business value of data analytics, watch this Fortune video:

Sign up for Data Sheet, Fortune’s daily newsletter about the business of technology.

About the Author
By Derrick Harris
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

crew aboard artemis II
Innovationspace
‘It’s 13 minutes of things that have to go right’: Artemis II splashes down despite faulty heat shield
By Catherina GioinoApril 10, 2026
3 hours ago
The Navy confirmed an ‘abundant amount’ of Uncrustables when the Artemis II crew lands. Smucker’s just offered them a lifetime supply
PoliticsFood and drink
The Navy confirmed an ‘abundant amount’ of Uncrustables when the Artemis II crew lands. Smucker’s just offered them a lifetime supply
By Catherina GioinoApril 10, 2026
5 hours ago
Three people sit behind a desk and look at the phone screen of the person in the middle.
Future of WorkConsulting
Meet ‘trendslop,’ the new, AI-fueled scourge of workplace consultants everywhere
By Sasha RogelbergApril 10, 2026
5 hours ago
Amazon is still paying Jeff Bezos an $80,000 yearly salary—but $1.6 million for travel and security
Big TechCEO salaries and executive compensation
Amazon is still paying Jeff Bezos an $80,000 yearly salary—but $1.6 million for travel and security
By Marco Quiroz-GutierrezApril 10, 2026
7 hours ago
Kash Patel sits with his two fingers on lips
CybersecurityIran
First they went after medtech, then Kash Patel. Iranian hackers’ next target is likely ‘low-hanging fruit’ in water, energy, and tourism, experts say
By Jacqueline MunisApril 10, 2026
8 hours ago
scott bessent
CybersecurityFederal Reserve
The AI that found 27-year-old vulnerabilities no human ever caught before just forced an emergency meeting with every major Wall Street CEO
By Jake AngeloApril 10, 2026
9 hours ago

Most Popular

A Meta employee created a dashboard so coworkers can compete to be the company's No. 1 AI token user—and Zuckerberg doesn't even rank in the top 250
AI
A Meta employee created a dashboard so coworkers can compete to be the company's No. 1 AI token user—and Zuckerberg doesn't even rank in the top 250
By Fortune EditorsApril 9, 2026
2 days ago
The U.S. government is spending $88 billion a month in interest on national debt—equal to spending on defense and education combined
Economy
The U.S. government is spending $88 billion a month in interest on national debt—equal to spending on defense and education combined
By Fortune EditorsApril 9, 2026
2 days ago
Mark Cuban admits he made a mistake letting go of the Mavericks: 'I don't regret selling. I regret who I sold to'
Investing
Mark Cuban admits he made a mistake letting go of the Mavericks: 'I don't regret selling. I regret who I sold to'
By Fortune EditorsApril 9, 2026
1 day ago
Schools across America are quietly admitting that screens in classrooms made students worse off and are reversing years of tech-first policies
Innovation
Schools across America are quietly admitting that screens in classrooms made students worse off and are reversing years of tech-first policies
By Fortune EditorsApril 10, 2026
19 hours ago
Scottie Scheffler joined Tiger Woods and Rory McIlroy in golf's $100M club—and donated his entire Ryder Cup stipend to charity
Success
Scottie Scheffler joined Tiger Woods and Rory McIlroy in golf's $100M club—and donated his entire Ryder Cup stipend to charity
By Fortune EditorsApril 10, 2026
11 hours ago
'I hate working 5 days': Zoom CEO says traditional work schedules are becoming obsolete—and predicts a 3-day workweek by 2031
Success
'I hate working 5 days': Zoom CEO says traditional work schedules are becoming obsolete—and predicts a 3-day workweek by 2031
By Fortune EditorsApril 9, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.