• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock

2

‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion

3

OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation

1

Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock

2

‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion

3

OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
TechBig Data

IBM blesses Spark in its latest big data push

Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
June 15, 2015, 8:00 AM ET
Inside IBM Research Headquarters
The International Business Machines Corp. (IBM) signage is displayed in front of the Thomas J. Watson Research Center, the headquarters of the company's research, in Yorktown Heights, New York, U.S., on Tuesday, Feb. 11, 2014. IBM is spending $1 billion to build a new division around its Watson supercomputer, which can analyze large volumes of data and answer questions. Photographer: Scott Eells/Bloomberg via Getty ImagesPhotograph by Scott Eells — Bloomberg/Getty Images
Add Fortune on Google for similar content.

IBM is a big proponent of big data and the successful application of big data techniques to help businesses run better.

Increasingly, big data jockeys are looking beyond Hadoop, the distributed file system that is the foundation of many big data applications, to Spark for analyzing that information.

By way of introduction, Sparkis an open-source project for in-memory data processing that aims to speed up the crunching of huge amounts of data, typically data held in Hadoop. Spark’s claim to fame, in fact, is that it can do that data crunching faster and easier than MapReduce, the tool typically used along with Hadoop for these applications.

So, on Monday, IBM (IBM), which always likes to wrap its stated intentions in press releases, said it is opening a Spark Technology Center in San Francisco. It also vowed to incorporate Spark in all of its analytics and e-commerce products and to dedicate 3,500 developers to Spark-related work, although it’s unclear where all those developers will come from. Spark itself will be also offered as a service on IBM’s Bluemix development platform.

News of the effort leaked last week but now it’s official.

IBM’s endorsement of open-source projects like Spark has proven fruitful in the past. IBM was an early booster of the Linux operating system and Eclipse Java tool set, for example.

The Spark project isn’t just about fast, in-memory processing. The overall Spark umbrella also includes a file system, machine learning, stream processing components.

IBM moves comes as it tries to bolster revenue from data analytics projects, and recruit more developers to use its tools—including Bluemix—to develop next-generation applications. In this arena it faces a raft of newer companies like Cloudera and Hortonworks (HDP), that have already endorsed Spark and don’t have to support the legacy businesses that IBM has to keep running.

Subscribe to Data Sheet, Fortune’s daily newsletter on the business of technology.

About the Author
Barb Darrow
By Barb Darrow
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

Latest in Tech

t
AIMarkets
Billionaire Mike Bloomberg warns Trump’s AI ownership plan would make ‘George Orwell blush’
By Eva RoytburgJuly 21, 2026
7 hours ago
U.N. reports Southeast Asia’s criminal networks are using tech to build a global illicit economy
AsiaTech
U.N. reports Southeast Asia’s criminal networks are using tech to build a global illicit economy
By The Associated PressJuly 21, 2026
7 hours ago
Anthropic to pay authors $1.5 billion over pirated books used to train Claude in first major AI copyright settlement
LawAnthropic
Anthropic to pay authors $1.5 billion over pirated books used to train Claude in first major AI copyright settlement
By The Associated PressJuly 21, 2026
7 hours ago
kid lying down on phone
PoliticsSocial Media
Lawmakers say they’re protecting kids—but their age checks are quietly building an ID requirement for the entire internet
By Catherina GioinoJuly 21, 2026
7 hours ago
holland
Arts & EntertainmentMovies
‘The audience is telling the industry something’: even IMAX is stunned by Christopher Nolan’s runaway ‘Odyssey’
By Tatiana SatauaJuly 21, 2026
9 hours ago
OpenAI CEO Sam Altman looking up.
CybersecurityOpenAI
OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
By Jeremy Kahn and Emily ForliniJuly 21, 2026
9 hours ago

Most Popular

Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock
Success
Mark Cuban says he has the solution to growing income inequality, and it's to reward every employee—from CEO to janitor—with company stock
By Sasha RogelbergJuly 20, 2026
1 day ago
‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion
Success
‘I want to die broke’: Billionaire philanthropist Denny Sanford dies after giving away $4 billion
By Sydney LakeJuly 20, 2026
2 days ago
OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
Cybersecurity
OpenAI says its AI models secretly broke out of a secure test environment and hacked into AI company Hugging Face in order to cheat on an evaluation
By Jeremy Kahn and Emily ForliniJuly 21, 2026
9 hours ago
Mathematicians grapple with a ‘very rapid and very unsettling change’ as AI cracks yet another century-old problem
AI
Mathematicians grapple with a ‘very rapid and very unsettling change’ as AI cracks yet another century-old problem
By Eva RoytburgJuly 21, 2026
12 hours ago
'Dr. Doom' Nouriel Roubini says we're headed for universal basic income or 'some form of socialism' as AI revolutionizes work—He calls that optimistic
AI
'Dr. Doom' Nouriel Roubini says we're headed for universal basic income or 'some form of socialism' as AI revolutionizes work—He calls that optimistic
By Jason MaJuly 18, 2026
3 days ago
Despite a $156 million contract, Knicks star Jalen Brunson still calls his parents for financial advice any time he makes a big purchase
Success
Despite a $156 million contract, Knicks star Jalen Brunson still calls his parents for financial advice any time he makes a big purchase
By Emma BurleighJuly 21, 2026
13 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.