Texifter was the first company to join as a paying customer in the alpha “Snapshot” offering from Gnip. You can still take part in that alpha by submitting a request for a free estimate of a snapshot from Twitter’s complete history. This is, however, a very fast-moving landscape for for social # bigdata. We are quickly transitioning from the alpha “Snaphot” tests to the beta of a cradle-to-grave system for building estimates for the cost of text analytic projects that feature either the real-time day-forward, Gnip-enabled PowerTrack (the Twitter fire hose), or the new historical PowerTrack. So if you have ever wished you could go back in time and collect all the tweets from an epic moment in history, your wish just came true. Contact us if you have any questions and submit a request for a free estimate today.
As a part of getting new users to test our sifter beta, every month this summer we are awarding 12 #datagrants to academics. All you need to do to be included in the July drawing is submit a valid historical Twitter estimate request using sifter and then send us your CV. These prizes shave thousands of dollars of costs off of your research. The June social data and tools prize winners were: Kelly Fincham The Department of Journalism, Media Studies, and Public Relations at Hofstra University
“I will use the data and software prize to further my research and analysis of journalism practice on Twitter. My research agenda explores journalists’ evolving norms and practices on social media, specifically Twitter, in the U.S. and Ireland. This grant will help me to research and analyze this subject area in more depth.” @kellyfincham
“I am hoping to use the data and software prize for my PhD research on the recovery and rebuild after the Christchurch earthquake of 2011. I am particularly interested in framing and sentiment of tweets and am hoping to compare a historical data set during disaster response and recovery to the conversation about the rebuilt of the city which is still ongoing today. I am hoping to study the differences and similarities of conversations on Twitter now and then.” @tinserella
“I will like to integrate the collected data (tweets) in my final essay in order to get my Masters degree. The subject of my essay is: racism online.” @CarminaGodoy
“This award will be used to collect and analyze select data from the early group stages of the 2014 World Cup. Social media – including but not limited to Twitter – are increasingly integrated into traditional (TV, radio, print) media campaigns. At the 2014 World Cup, the hashtags #becausefootball and #becausefutbol were promoted throughout the televising of the games. Exploratory thematic analysis of these Tweets – enabled by Sifter and Discovertext – will describe how the use of these commercially-oriented hashtags are used in comparison to what we know about live event Twitter usage in the current body of research.” @warrensallen
“I plan to use the prize to capture and analyze online discussion and commentary about police use of automated license plate recognition (ALPR) systems and wearable cameras. In particular, I hope to examine discussions related to the public disclosure of data generated by these systems under freedom of information laws.” @newmedialaw
“This project will survey the current use of online social media by health organization for health campaign and analyze the reach and diffusion of campaign messages. Despite the ever growing number of online social media-based health campaigns, little work has been done to understand how interactive natures of online social media are used for public health promotion. For this project, Twitter data will be analyzed to enhance our understanding of how health organizations use social media for public health promotion and how such uses of online media platforms are received by the public.”
Abhay Gupta Lecturer at Fairleigh Dickinson University
“I plan to use it to understand the dynamics of public opinion. In particular, I want to test various hypotheses on how major events (e.g. election wins, market crash, sports results) impact the sentiment and whether pre-event opinion analysis has any predictive power in explaining actual outcomes.” @EmpForesights
“I am looking forward to using the Texifter data and software to investigate how consumers and brands communicate on social media. In particular, I’m interested in how language use affects consumer behavior in online contexts. Given the extent to which consumers have and are continuing to adopt social media, this research should have important implications for marketing practitioners.” @vabarger
“I am studying the influence of social movements on changes in the law — specifically land law. I hope to use the prize to access Twitter data that can tell me about the relationships between movement actors, how they form their interests, and how these change over time.” @jrgbaxter
“I will use the software and data to continue my study of the lifecycle of policy initiatives. I used DiscoverText in my latest book Interpreting Hashtag Politics (Palgrave Macmillan, 2014). Historic Twitter data reveals the first mention of policies that enjoy several months of widespread attention before disappearing without trace. To understand why and how this occurs, I will continue use DiscoverText to de-duplicate the dat
a and develop thematic code sets with a team of research assistants.” @SRJeffares
Cristian Vaccari Lecturer in Politics at the Royal Holloway University of London
“I am planning on using the data and software to analyze how politically motivated users of social media engage with mediated political events, such as televised leader debates and high-profile interviews, to better understand the interplay between television and social media in the flow of political messages.” 25lettori
Bill D. Herman Remember: All you need to do to be included in the July drawing is submit a valid historical Twitter estimate request using sifter and then send us your CV.
We could not be happier to announce that Texifter, a developer of advanced text data analytics software, is partnering with Gnip, the world’s largest provider of social data. Our Plugged In to Gnip partnership certifies Texifter as an industry leader committed to building innovative analytics solutions on top of reliable, sustainable, and complete social data. In joining Gnip’s partner program, Texifter joins the list of leading analytics providers like Microsoft, Salesforce, and Adobe. “The Plugged In program was created to really highlight the companies that are doing the most innovative things in social data,” according to Chris Moody, CEO of Gnip, “and Texifter is a great example of that.” Texifter’s DiscoverText platform provides advanced data analytics solutions for social researchers in public and private institutions. Combining powerful tools with accessible interfaces, DiscoverText provides “five pillars of text analytics” – search, filtering, clustering, human-coding, and machine-learning. By partnering with Gnip, Texifter has access to historical Twitter data. Texifter recently launched “Sifter”, a tool to help users estimate Twitter volume associated with historical searches. The Sifter product gives users a free estimate of Twitter volume over a specific date range using advanced Gnip PowerTrack filtering. Customers who license historical Twitter data from Gnip can then access it for text analytics via a 30-day trial of DiscoverText.
“Texifter welcomes this opportunity to work even more closely with a company that we have admired and worked with for years,” said Stu Shulman, CEO of Texifter. “Gnip is an exceptionally reliable provider of social data products and services. Texifter customers will continue to see more benefit as we work with Gnip to deliver high quality products and services.”
We could not be happier about the initial response to the beta test of “Sifter” (https://sifter.texifter.com), a self-serve tool to get free estimates of the cost to pull samples from the complete (un-deleted) history of Twitter. Using the powerful Gnip-enabled Power Track operators, we have a few hundred early adopters testing out rules that allow them to pull highly selective samples going back to the very first day of Twitter. For information on pricing to license the Twitter data, please visit: https://sifter.texifter.com/Home/Pricing.
The evolution of the API opens the door for third-party developers to access information on social media networks. In the best case, this provides a healthy, democratic flow of information. Yesterday, DiscoverText had “rate limits” imposed in terms of its access to Twitter data. As written, the Twitter API allows unauthenticated calls of 150 per hour, per IP address. Authorized calls (users logged on using their Twitter credentials, also known as OAuth) allow for up to 350 calls per hour, per person. In addition, the Twitter Search API has internal rate limiting mechanisms, but Twitter does not publish those specific limitations for fear of abuse. Going over any of these limits results in the user being presented with “Error 420”, which simply means that the user is being rate limited. This hampers the ability to harvest twitter feeds within DiscoverText. We have never had rate limit problems prior to this, but according to timestamps on articles posted on Twitter’s developer website, Twitter might have become more cognizant of those harvesting large amounts of data (not just us), and as a result, are cracking down on heavy users. At Texifter, we fully respect the rules and regulations of the Twitter API, and in no way seek to disobey or bend these set rules in our flagship software product, DiscoverText. On August 18, 2011, the same day we learned of the 420 errors, we performed emergency maintenance to better cope with Twitter rate limitations. We also wanted to more gracefully handle rate limitation errors and to ensure we abide by Twitter Terms of Service. With that said, in order to continue our ability to harvest information from Twitter and perform our cutting-edge research, we are currently exploring easier and more reliable ways to harvest data. The maintenance performed on DiscoverText stills allow 1500 items per fetch as determined by Twitter’s architecture on the public API. In addition, no extraneous error messages should result when DiscoverText is being rate limited. Some searches might be silently delayed for 5 minutes, however, these fetches will catch up as soon as they can. In the near future, look for new developments for DiscoverText. We’ve got big plans for our social media API fetching that will greatly enhance our user’s ability to receive timely and actionable social media feeds. We don’t want to reveal too much right this moment, but we’re sure you’ll like what we have in store and in traditional Texifter style, we’ll plan a large announcement when the time is right.