Skip to main content

Twitter Announces Fire Hose Marketplace: Up to 10k Keyword Filters for 30 Cents!


 
Like a prism to a ray of sunlight, stream-hacking startup Mediasift CEO Nick Halstead took the stage today with Twitter's Ryan Sarver at the Data 2.0 conference to announce Twitter's second data resales channel partnership. Halstead's service will allow customers to parse the full Twitter fire hose along any of the 40 fields of data hidden inside every Tweet, with the addition of augmented data layers from services including Klout (influence metrics), PeerIndex (influence), Qwerly (linked social media accounts) and Lexalytics (text and sentiment analysis). Storage, post-processing and historical snapshots will also be available.
The price? Dirt cheap. Halstead told me after the announcement that customers would be able to apply as many as 10,000 keyword filters to the fire hose for as little as 30 cents an hour. The most computationally expensive filtering Mediasift will offer won't be priced above $8k per year. (Pricing approximate but indicative, Halstead says.) What does this mean? It means that far more developers than ever before will now have a stable, officially approved and very affordable way to access highly targeted slices of data. Twitter just found a way to hand developers an Amazon River's worth of golden tinker-toys, each with more than 40 points of contact, at commodity prices.

mikeqwerly.jpg
Above: Thanks to Qwerly integration, when you look at a Twitter @username - Mediasift sees more than just the Twitter profile. It sees @username who has bookmarks saved online, plans for public events to attend, photos shared publicly with friends, check-ins to places around town and much more. Any of those are like columns in a spreadsheet of Twitter search results. Show me Tweets with any of the following keywords by people planning to attend event A and who have been to place B or C. Thanks to Qwerly, Twitter didn't just get a giant new developer search and filter feature - it got integration with a whole lot of other social services. Throw in sentiment and authority filtering and it's like the social graph just exploded. (Update: Qwerly won't be live for another week, Halstead says. Likewise, thousands of people have requested and granted Mediasift invites but Halstead says the site will open to the public in coming weeks.) You can make a filtering rule, make it public or private, share and comment on other peoples' rules and more.
While Twitter's partnership with bulk data reseller Gnip (announced in November) offered half the fire hose in bulk for a whopping $360k or 5% of the fire hose for $60k per year - Mediasift prices and use cases will be very different. Pricing will be modeled like Amazon Cloud Computing and each function's cost will be spelled out as the user requests it. Geo-filtering is expensive, keyword filtering is cheap - for example. Keyword filtering is done, stable and available now. Storage of the data for post-processing and snapshots of historical data are described as in alpha stages.
Want a feed of negative Tweets written by C-level execs about any of 10,000 keywords? Trivial! Basic level service, Halstead says! Want just the Tweets that fit those criteria and are from the North Eastern United States? That you'll have to pay a little extra for. The possibilities are staggering.
All the message contents, all the bio contents, bio contents from other social services (like LinkedIn) associated to peoples' Twitter accounts via Qwerly, sentiment analysis - all of these will be points of contact where filtering can occur. Want a feed of negative Tweets written by C-level execs about any of 10,000 keywords? Trivial! Basic level service, Halstead says! Want just the Tweets that fit those criteria and are from the North Eastern United States? That you'll have to pay a little extra for. The possibilities are staggering. Below: This is what a Tweet looks like. Every little message has more than 40 different fields. Mediasift customers will be able to filter the full Twitter fire hose by any of those fields or by data from additional 3rd party services.

"Twitter are moving up the value chain by offering the high-level information that developers want," said ReadWriteWeb contributor and leading social data hacker Pete Warden about the announcement. "Rather than selling commodity information for further processing, this partnership offers a narrow but deep slice."
This is a bet on a future wherein greater value is built by widespread, low-cost access to social data on the part of many and diverse developers. It's not just raw data either, it's really rich. It's the opposite of what the Gnip announcement signalled and what many people have feared - that Twitter would horde its river of data and sell it just to high bidders.
More on this in the coming days. I'm very excited to start hacking on it all with ReadWriteWeb's team of developers.

Comments

  1. Very energetic article, I loved thаt a lot.
    Will there be a ρart 2?

    my blog - criar pagina profissional no facebook

    ReplyDelete

Post a Comment

Popular posts from this blog

Evolution Of Computer Virus [infographic]

4 Free Apps For Discovering Great Content On the Go

1. StumbleUpon The granddaddy of discovering random cool stuff online, StumbleUpon will celebrate its 10th anniversary later this year — but its mobile app is less than a year old. On the web, its eight million users have spent the last decade recommending (or disliking) millions of webpages with a thumbs up / thumbs down system on a specially installed browser bar. The StumbleUpon engine then passes on recommendations from users whose interests seem similar to yours. Hit the Stumble button and you’ll get a random page that the engine thinks you’ll like. The more you like or dislike its recommendations, the more these random pages will surprise and delight. Device : iPhone , iPad , Android 2. iReddit Reddit is a self-described social news website where users vote for their favorite stories, pictures or posts from other users, then argue vehemently over their meaning in the comments section. In recent years, it has gained readers as its competitor Digg has lost them.

‘Wireless’ humans could backbone new mobile networks

People could form the backbone of powerful new mobile internet networks by carrying wearable sensors. The sensors could create new ultra high bandwidth mobile internet infrastructures and reduce the density of mobile phone base stations.Engineers from Queen’s Institute of Electronics, Communications and Information Technology are working on a new project based on the rapidly developing science of body-centric communications.Social benefits could include vast improvements in mobile gaming and remote healthcare, along with new precision monitoring of athletes and real-time tactical training in team sports, an institute release said.The researchers are investigating how small sensors carried by members of the public, in items such as next generation smartphones, could communicate with each other to create potentially vast body-to-body networks.The new sensors would interact to transmit data, providing ‘anytime, anywhere’ mobile network connectivity.Simon Cotton from the i