Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-request]

Indicates a request for relevant open data sources. Please read https://opendata.meta.stackexchange.com/questions/284/how-a-good-data-request-question-should-look-like for writing a good request.

123
votes
14answers
201k views

Is there a global database of all products with EAN 13 barcodes?

EAN 13 is an international system. Is there an API or database that contains all items that have these barcodes? Like all food, goods you can buy in a regular convenience store. Is there a global open ...
55
votes
6answers
59k views

Open API for nutritional information and/or food barcodes?

I've seen many applications (mobile and web) that use a database of nutritional information and barcodes to track daily food consumption. Smartphones have the ability to scan barcodes, and many mobile ...
35
votes
12answers
8k views

Multinational list of popular first names and surnames?

Is there a database containing the list of the most popular first names and surnames (with occurrence count, or at least sorted by popularity) for many nations/countries? I need such data for the ...
31
votes
12answers
2k views

Is there a list of all US Government agencies and sub agencies and is it available via API?

Specifically I'm looking for: Agency canonical names Agency abbreviature/acronym Hierarchy of agencies e.g. Census Bureau is part of Department of Commerce Agency logos Website/social media accounts ...
31
votes
10answers
16k views

Downloadable archive of weather conditions for Europe?

Is there a downloadable archive of weather conditions in Europe? Also, the temperature, humidity, precipitation by location? So the database would enable, for example, to draw the chart with ...
27
votes
6answers
48k views

Cryptocurrency historical prices

I'm looking for cryptocurrency historical data, including prices and market cap (either from exchanges or average price) of the main cryptocurrencies, namely: Bitcoin, Ripple, Litecoin, Ethereum, Dash....
25
votes
15answers
42k views

Are there any open datasets for soccer statistics?

I'm mainly interested in soccer related statistics. There are quite a few different API's relating to soccer, but most of them are commercial and far, far out of my price range. I've looked at DBpedia,...
24
votes
3answers
434 views

Are there any regular Open Data conferences?

I'm interested in any Open Data conferences which are held on a regular basis (e.g., yearly). Are there any such conferences?
24
votes
7answers
543 views

Evidence for the economic impact of open data?

Open Data is discussed in many contexts, ranging from transparency, government accountability, and their economical benefits. Are there up-to-date studies and publications analyzing the real and ...
24
votes
7answers
6k views

How can I download the complete Wikidata database?

Wikidata is a new Wikimedia project: It centralizes access to and management of structured data, such as interwiki references and statistical information. This data would be of enormous interest ...
23
votes
7answers
26k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
22
votes
10answers
17k views

Free database or API of all North American businesses

I'm looking for a free/open source downloadable database/API of all the businesses in North America. The sort of data that I'm looking for includes: name, address, industry, email address, website, ......
21
votes
2answers
228 views

Data for word hierarchies

I'm looking for a dataset which will give me is-a and has-a type relations between senses (and give senses from words). WordNet seems to be the most popular model, but I'm trying to evaluate other ...
21
votes
2answers
9k views

Bulk download Sci-Hub papers

I wonder whether it is possible to bulk download all papers stored in Sci-Hub. I am aware of the questions: Is there a more user-friendly way to download multiple articles from arXiv? Bulk download ...
20
votes
6answers
18k views

Any CDR (call data record) dataset?

I would like to do some analytics on CDR data, preferably mobile, but anything will do. Ideally I would like to have between 100MB to 10GB of data. I have been trying to look for this type of data ...
20
votes
3answers
9k views

Historical Weather Forecasts

Does anybody know if there is a place I can find historical data of weather forecasts by forecaster? I'm mainly interested in forecasts of high temperature and low temperature, but precipitation ...
19
votes
8answers
631 views

How can I trust the authenticity of an open data source?

If some site claims to offer a definitive data source, how can I trust that it is not purposely biased? Even excluding elaborate conspiracies, how could I know that it isn't just a big hoax? It ...
19
votes
6answers
20k views

Any Open Data Sets for the (Football) World Cup (in Brazil 2014)?

Are there any public data sets for the World Cup in Brazil 2014? Didn't find anything for download on the official FIFA site (besides a single-page PDF booklet for the match schedule). Ideally the ...
19
votes
5answers
2k views

Is there a complete list of all US tax-exempt nonprofits in machine-readable format?

I've seen they can be purchased from Guidestar, but wondered if there was an freely available open data source.
19
votes
7answers
6k views

Database with monthly climate/weather data by country

I am searching for a online database for climate data (especially temperature) for non-european countries on a monthly basis. 1990-2014 would be nice. Thank you!
19
votes
6answers
2k views

De-identified patient data

Are there any medical or clinical data sources that have de-identified patient data (name, date of birth, sex) as well as basic physical parameters such as weight, or height? I'm specifically ...
19
votes
3answers
201 views

Is there an official/complete list of all US government agency “developers' pages”?

The FCC's developers page happens to have a sidebar linking to many other US government agencies' developers pages, APIs, etc. It's a handy list, but I assume the FCC hosts it only out of the goodness ...
18
votes
13answers
8k views

2014 Ebola outbreak dataset

I'm looking for a dataset on the 2014 Ebola outbreak with as many following fields as possible: For each individual contaminated with ebola: Estimated datetime and location of detection Datetime and ...
18
votes
4answers
9k views

Downloading the Panama Papers

I wonder where the Panama Papers can be downloaded. I have looked around, I couldn't find them. Where can I find them? What is the legality, and sensibility of requesting and downloading leaked ...
18
votes
4answers
1k views

Sources of weather data

Barry, could you abuse this site's "answer your own question" feature to create a community wiki answer for sources of weather data (both current and historical), since it gets asked so often?
18
votes
3answers
5k views

List of public holidays by countries?

When working across country border it makes things easier to know in advance if people in a specific country are going to be on public holiday a certain day. While some calendars application offer to ...
18
votes
2answers
48k views

Where to get IMDb datasets

IMDb offers a great deal of useful structured information for research. There're multiple ways to get small pieces of its database: Download a subset of data from http://www.imdb.com/interfaces Use ...
17
votes
6answers
4k views

Examples of useful applications that are being developed using open data

I am looking for news articles, tweets, or firms that everyone is talking about who are using open data. But, I have failed to find any useful application being developed that are using this open data ...
17
votes
6answers
9k views

Free icons of country flags, reusable in both open source and commercial products

I need icons for the flags of countries. PNG file format Small sizes such as 32x32 pixels or similar. Consistent size for all flags (even the flags with strange shapes like Nepal, they have to be fit ...
17
votes
9answers
30k views

Free database of vehicle data and images

I've been looking for a free database of vehicle manufacturer's specifications, data, and images for a long time with no luck, does anyone have any ideas?
17
votes
8answers
10k views

Downloadable smartphones data (name, specs)

I'm searching for product data, right now I only need smartphone data. I need like every smartphone name and specifications like width, CPU speed, etc. Now I found some reference to semantics3.com ...
17
votes
2answers
32k views

Open downloadable recipe database?

I'm interested in doing some analysis of recipes for fun. Ideally, I would like to obtain open recipe database(s) behind {foodily, allrecipes, recipes, bigoven, cooking, cooks}.com or something like ...
17
votes
2answers
20k views

Is there an open database of elementary, middle, and high schools in the United States?

Is there an up-to-date and regularly maintained open database of elementary, middle, and high schools in the United States? I'm looking for both public and private schools. Names alone would be a ...
16
votes
6answers
8k views

U.S. City and County Web Data (API)

Are there any websites that have basic City and County information for the U.S.?
16
votes
7answers
2k views

Is there a list, database or API that contains the URLs for United States city and town websites?

I'm looking for a database of URLs for every official city and town website. Ideally this list would be up to date and maintained. Freebase has some of the results and we have every city and town in ...
16
votes
2answers
3k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...
16
votes
5answers
12k views

Amazon price history dataset

Are there any datasets on Amazon products' price history? http://camelcamelcamel.com/ doesn't make it available and the Amazon Product Advertising API doesn't seem to give access to the price history.
16
votes
3answers
5k views

Stock market historical data

I was surprised not to find a similar question here. But what are the best sources of stock market daily (weekly, monthly) prices for all listed companies in a given market? Google Finance, Yahoo ...
16
votes
1answer
318 views

Dataset of weather as it was *forecast* at the time

I have been able to find very detailed weather datasets from noaa (ftp://ftp.ncdc.noaa.gov/pub/data/noaa/). But I realized that for my purposes I can not simply use weather prediction probabilities to ...
15
votes
7answers
2k views

Obtaining personal mail corpus

Are there any publicly available personal mailboxes except for the Enron corpus? Doesn't have to be a large corpus, even a single mailbox of a single person will help me (step by step...) ...
15
votes
5answers
26k views

Mapping counties to zip codes

Is there any freely available data that relates USA zip codes and USA counties (FIPS County codes)? Since counties can contain multiple zip codes, one can have multiple entries, in such a table: ...
15
votes
7answers
5k views

Looking for Open Data Source to Correlate Address to Latitude/Longitude (geocoding)

Are there any open data sources that can help correlate a given address to a latitude/longitude coordinate? aka geocoding
15
votes
8answers
6k views

Is there an open movie and/or music database available for commercial use?

I would like to know if there is an open database for movies that could have the same amount and quality of data as IMDB. I would like it for commercial use, and free if possible. Same for music, I ...
15
votes
8answers
1k views

Are there datasets prepared for machine learning?

These datasets would be structured and presented in a way that is accessible for students or scholars interested in machine learning. Students could use them to learn how to create applications that ...
15
votes
7answers
13k views

Are there free APIs for searching news articles that I can use to collect trend data in news coverage?

I am working on a data-visualization web application that looks at trends in American news media coverage over time. It takes a keyword (or keywords), a date range, and a time increment as parameters ...
15
votes
5answers
4k views

Credit card metadata database

Is there a database of credit card numbers that tells you what bank issued the credit card? 3 is American Express 4 is Visa/MasterCard 6 is Discover Typically the first 6 numbers will indicate what ...
15
votes
4answers
3k views

USA 2016 election demographic data

I am looking for demographic data (age, income, race, location) for individuals who voted in the 2016 US presidential election. The resolution that I am looking for can be at the state, county, or ...
15
votes
6answers
442 views

Collect a list of open data systems

for a research project we are trying to collect a list of relevant open data systems. I am aware that systems is very broad so I tried to categorize them a bit. Please help us extending this list ...
15
votes
3answers
9k views

World city database (with longitude, latitude) and population per year

I'm building a visualisation with cities' population around the globe for a website. I found the MaxMind free database that includes most cities around the globe with coordinates and population, which ...
15
votes
1answer
53k views

Any open public data sets for the English Premier League (EPL)?

The new 2014/15 season kicks off on Aug/16. Wondering what's the state of open data for the English Premier League. Any open data sets available (incl. teams, players, squads, stadiums, old seasons, ...