I am looking to run a Map Reduce framework and do some analysis on a Twitter dataset for the FIFA 2014 World Cup event. I couldn't find a place to get these datasets for free. Can someone suggest a place to get at least a sample of this dataset for free? The dataset I'm looking for is actual tweets posted by the users, which contain related hashtags like #FIFA,#GER Vs #ARG, #BRZ, #Neymar, etc. for the duration of the entire World Cup.
Getting access to historical Twitter data may end up coming with a price. Here are some options:
- I've had great luck using Topsy in looking at a wide variety of tweets ranging from disease vectors in Africa to sentiment analysis. Here's the link for 86K #FIFA tweets for the last 30 days. You can expand to "all time", search by language, and look at influencers.
- Use the Twitter API to get the data you can for free. Good developer resources are available.
- The most comprehensive historical archive may be via Gnip, but unfortunately it is not free and it's unclear what the actual costs are.