Social data as a business is dead. Long live big data services
FORTUNE — Yesterday morning, Twitter (TWTR) announced it had acquired Gnip, a company which packages, filters, and sells data from social media streams. The deal raised questions about the hot category of “big data” for social media, particularly for a startup called Datasift, which has raised $71.7 million million in funding from a long list of prominent venture capital firms.
Aside from a Japanese company called NTT Data, Datasift is the sole independent reseller of Twitter’s “full firehose” of data. The others have been acquired — Topsy by Apple (AAPL) in December, and now Gnip by Twitter itself.
Now that Twitter owns Gnip, it has no motivation to continue licensing its data to Datasift, a Gnip competitor. The companies have said their relationship with Datasift won’t change, but there’s precedent for change: Twitter is likely to wind down its relationship with Topsy, now that Topsy is owned by Apple, after its contract expires.
In recent years, the big social media platforms such as Facebook, Twitter, LinkedIn, Pinterest, and even Foursquare have discovered there’s great value in the data they produce. Knowing that, some are less likely to share that valuable data with third parties, which have, up until now, made a lot of money selling that data.
Shortly after the Gnip deal was announced, Datasift posted a statement on its blog, congratulating its competitor and calling the deal a milestone for the category. A conversation between Fortune and CEO Rob Bailey and CTO and Founder Nick Halstead later in the day revealed the company has been transitioning itself away from the “social” part of its “big data” mission for some time. An edited transcript appears below.
Do you really foresee no changes to your business in light of this deal?
Bailey: There’s always going to be changes to the business. Our business has evolved tremendously over the last few years. We started out as a simple Twitter syndicator and have worked our asses off to get to this point where we are now … We’ve been around seven years. Our business has always being based on business processing and licensing. The reason we’ve aggressively raised money is because our investors believe in a much bigger market of unstructured data processing, and the ability to join a whole range of data sets together.
What percentage of your business relies on Twitter vs. other social networks or sources of data?
Bailey: If you’d asked us three years ago, it would have been the majority. Now it makes up a small percentage. Do customers only buy us for access to Twitter licenses? Absolutely not. It’s a relatively small part of our business. Years ago, our main value proposition was, “We’ve got Twitter data.” But being the paranoid guys that we are, we realized an amazing value proposition one day is completely outdated later.
[The company would not specify how small the percentage is.]
If all the social networks pulled their data, would you still have a business?
Bailey: We wouldn’t suffer at all, because we still have independent sources of data from our clients. If you are a big customer like Dell and want a single view of many sources of data, you don’t want to have to integrate with 10 different APIs. We give a single view of the data through a single API, and we have spent years doing the data integration work. No one network can develop all of that functionality independently. If someone like Goldman Sachs wants access to 20 networks, they’re not going to hire 50 engineers to work on those APIs. They pay for us to be the layer that sits on top of those APIs.
Halstead: Gnip’s model was focused on licensing. We are very focused on being an engine for doing data processing. We like to do the licensing because there are a lot of advantages for the social networks to have us work on behalf of them.
We are still the Amazon of real-time data processing. We don’t mind if the licensing comes in independent of us as long as they pipe it through our platform. The key is we are an integration platform and a processing platform.
It sounds like you’re moving away from the focus on social data. Is that fair to say?
Bailey: The social data market is evolving. We’ve already expanded into news and private social networks and community forums. What we’re finding is companies want to work with one category integration platform across lots of different data sources.
What did you think when Apple bought your competitor Topsy?
Halstead: It blew our minds for thinking bigger about the potential for the platform we developed. If Apple purchased this company, to not even use this company for what it was intended, maybe we should look at our platform that way. It triggered a lot of creative thinking for us about what the possibilities were beyond social.
Bailey: Our venture capitalists would not have given us $70 million just to focus on the social data market. That would not make any sense. We have increasingly found out over the last year, especially with our partnership with [business analytics software company] Tableau (DATA), that when companies are making decisions, they don’t say, “Let me go check social.” They check the market, and social is a component of their decision.
Are you looking to sell now?
Bailey: On the contrary, actually. We want to be a big publicly traded company someday. When we think about the companies we look to for inspiration, in early days we looked to Gnip, but now we look at Informatica (INFA), Splunk, (SPLK), and tableau. We want to be a big public company.
What’s the time table on that?
Bailey: We could be there in two to three years.
How many customers do you have?
Bailey: Over 1,000.
How much do they pay?
Bailey: It ranges from $5,000 per month to over $50,000 per month.
And what’s your revenue?
Bailey: That information is not public, but it’s in the tens of millions.
Do you expect to be cut off from Twitter’s firehose?
Halstead: Twitter has made it very clear it won’t be cutting us off. We have a good relationship with Twitter. I’m the inventor of the retweet button — we’ve been working with Ev and Jack and Twitter since back when they were just 20 people. We put together a long-term contract and nothing is changing that.