Questions tagged [data-request]
Indicates a request for relevant open data sources. Please read https://opendata.meta.stackexchange.com/q/284/17438 for writing a good request.
3,203
questions
172
votes
14
answers
296k
views
Is there a global database of all products with EAN 13 barcodes?
EAN 13 is an international system. Is there an API or database that contains all items that have these barcodes? Like all food, goods you can buy in a regular convenience store. Is there a global open ...
- 1,893
76
votes
5
answers
96k
views
Open API for nutritional information and/or food barcodes?
I've seen many applications (mobile and web) that use a database of nutritional information and barcodes to track daily food consumption. Smartphones have the ability to scan barcodes, and many mobile ...
- 2,088
51
votes
16
answers
29k
views
Multinational list of popular first names and surnames?
Is there a database containing the list of the most popular first names and surnames (with occurrence count, or at least sorted by popularity) for many nations/countries?
I need such data for the ...
user139
40
votes
7
answers
69k
views
Cryptocurrency historical prices
I'm looking for cryptocurrency historical data, including prices and market cap (either from exchanges or average price) of the main cryptocurrencies, namely: Bitcoin, Ripple, Litecoin, Ethereum, Dash....
- 1,022
38
votes
10
answers
23k
views
Downloadable archive of weather conditions for Europe?
Is there a downloadable archive of weather conditions in Europe?
Also, the temperature, humidity, precipitation by location?
So the database would enable, for example, to draw the chart with ...
user139
33
votes
12
answers
4k
views
Is there a list of all US Government agencies and sub agencies and is it available via API?
Specifically I'm looking for:
Agency canonical names
Agency abbreviature/acronym
Hierarchy of agencies e.g. Census Bureau is
part of Department of Commerce
Agency logos
Website/social media accounts
...
- 1,552
33
votes
3
answers
22k
views
Bulk download Sci-Hub papers
I wonder whether it is possible to bulk download all papers stored in Sci-Hub.
I am aware of the questions:
Is there a more user-friendly way to download multiple articles from arXiv?
Bulk download ...
- 7,740
31
votes
4
answers
62k
views
Open downloadable recipe database?
I'm interested in doing some analysis of recipes for fun. Ideally, I would like to obtain open recipe database(s) behind {foodily, allrecipes, recipes, bigoven, cooking, cooks}.com or something like ...
- 1,540
30
votes
19
answers
64k
views
Are there any open datasets for soccer statistics?
I'm mainly interested in soccer related statistics. There are quite a few different API's relating to soccer, but most of them are commercial and far, far out of my price range. I've looked at DBpedia,...
- 409
30
votes
8
answers
11k
views
How can I download the complete Wikidata database?
Wikidata is a new Wikimedia project:
It centralizes access to and management of structured data, such as interwiki references and statistical information.
This data would be of enormous interest ...
- 5,770
30
votes
4
answers
21k
views
List of public holidays by countries?
When working across country border it makes things easier to know in advance if people in a specific country are going to be on public holiday a certain day.
While some calendars application offer to ...
- 403
27
votes
9
answers
22k
views
Free database or API of all North American businesses
I'm looking for a free/open source downloadable database/API of all the businesses in North America. The sort of data that I'm looking for includes: name, address, industry, email address, website, ......
- 271
27
votes
3
answers
496
views
Are there any regular Open Data conferences?
I'm interested in any Open Data conferences which are held on a regular basis (e.g., yearly). Are there any such conferences?
- 709
27
votes
5
answers
42k
views
A list of cities of each country
Is there a free csv, xml or in some other format database of all (or least top 20-50 biggest) cities for each country in the world?
- 401
26
votes
6
answers
12k
views
Sources of weather data
Barry, could you abuse this site's "answer your own question" feature to create a community wiki answer for sources of weather data (both current and historical), since it gets asked so often?
user3856
26
votes
7
answers
578
views
Evidence for the economic impact of open data?
Open Data is discussed in many contexts, ranging from transparency, government accountability, and their economical benefits.
Are there up-to-date studies and publications analyzing the real and ...
- 361
26
votes
7
answers
31k
views
Twitter open datasets
Where can I get Twitter datasets available for analysis?
I found two:
The May 2011 Calufa Twitter Scrape
Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
- 3,641
25
votes
15
answers
3k
views
COVID19 - Coronavirus case data (country summary data)
There are some very good sites showing the state of infections 'now', but I would like to find a data set of COVID-19 infections, deaths and number of tests by day and by country. These are the best I ...
- 1,104
25
votes
8
answers
21k
views
Free icons of country flags, reusable in both open source and commercial products
I need icons for the flags of countries.
PNG file format
Small sizes such as 32x32 pixels or similar. Consistent size for all flags (even the flags with strange shapes like Nepal, they have to be fit ...
- 8,386
25
votes
3
answers
17k
views
Historical Weather Forecasts
Does anybody know if there is a place I can find historical data of weather forecasts by forecaster? I'm mainly interested in forecasts of high temperature and low temperature, but precipitation ...
- 353
23
votes
7
answers
26k
views
Any CDR (call data record) dataset?
I would like to do some analytics on CDR data, preferably mobile, but anything will do.
Ideally I would like to have between 100MB to 10GB of data.
I have been trying to look for this type of data ...
- 541
22
votes
6
answers
47k
views
Mapping counties to zip codes
Is there any freely available data that relates USA zip codes and USA counties (FIPS County codes)?
Since counties can contain multiple zip codes, one can have multiple entries, in such a table:
...
22
votes
8
answers
12k
views
Database with monthly climate/weather data by country
I am searching for an online database for climate data (especially temperature) for non-European countries on a monthly basis. 1990-2014 would be nice.
- 381
22
votes
3
answers
29k
views
Is there an open database of elementary, middle, and high schools in the United States?
Is there an up-to-date and regularly maintained open database of elementary, middle, and high schools in the United States?
I'm looking for both public and private schools. Names alone would be a ...
- 437
22
votes
9
answers
55k
views
Free database of vehicle data and images
I've been looking for a free database of vehicle manufacturer's specifications, data, and images for a long time with no luck, does anyone have any ideas?
- 221
21
votes
7
answers
30k
views
Age, Weight and Height dataset
I am trying to get a dataset (preferable worldwide) that has the attributes (height, weight and age). The only decent dataset that I have been able to find was from here: https://stats.stackexchange....
- 393
21
votes
8
answers
10k
views
Credit card metadata database
Is there a database of credit card numbers that tells you what bank issued the credit card?
3 is American Express
4 is Visa/MasterCard
6 is Discover
Typically the first 6 numbers will indicate what ...
- 624
21
votes
2
answers
294
views
Data for word hierarchies
I'm looking for a dataset which will give me is-a and has-a type relations between senses (and give senses from words). WordNet seems to be the most popular model, but I'm trying to evaluate other ...
- 311
20
votes
5
answers
11k
views
Open Source alternative to IMDB
Does anyone know of such a thing? I urgently need a database of all the movies and I want it to be free.
- 241
20
votes
7
answers
24k
views
Downloadable smartphones data (name, specs)
I'm searching for product data, right now I only need smartphone data. I need like every smartphone name and specifications like width, CPU speed, etc. Now I found some reference to semantics3.com ...
- 349
20
votes
4
answers
8k
views
Stock market historical data
I was surprised not to find a similar question here. But what are the best sources of stock market daily (weekly, monthly) prices for all listed companies in a given market?
Google Finance, Yahoo ...
- 3,641
20
votes
2
answers
61k
views
Where to get IMDb datasets
IMDb offers a great deal of useful structured information for research.
There're multiple ways to get small pieces of its database:
Download a subset of data from http://www.imdb.com/interfaces
Use ...
- 3,641
19
votes
8
answers
820
views
How can I trust the authenticity of an open data source?
If some site claims to offer a definitive data source, how can I trust that it is not purposely biased? Even excluding elaborate conspiracies, how could I know that it isn't just a big hoax?
It ...
- 699
19
votes
6
answers
22k
views
Any Open Data Sets for the (Football) World Cup (in Brazil 2014)?
Are there any public data sets for the World Cup in Brazil 2014?
Didn't find anything for download on the official FIFA site (besides a single-page PDF booklet for the match schedule).
Ideally the ...
- 880
19
votes
5
answers
2k
views
Is there a complete list of all US tax-exempt nonprofits in machine-readable format?
I've seen they can be purchased from Guidestar, but wondered if there was an freely available open data source.
- 1,278
19
votes
8
answers
8k
views
Is there an open movie and/or music database available for commercial use?
I would like to know if there is an open database for movies that could have the same amount and quality of data as IMDB. I would like it for commercial use, and free if possible.
Same for music, I ...
- 201
19
votes
3
answers
12k
views
Nicknames database
I'm interested in being able to identify a name like "Nick" as a short form of a name like "Nicholas" in a data set.
Is there any kind of open or somewhat standardized mapping of names and nicknames ...
- 331
19
votes
6
answers
15k
views
Which real-time open data APIs do you know?
As far as I can tell open data is mostly offered as some kind of file download, that contains the complete data set. I'm aware of some Web services, e. g. World Bank API, that allow you to feed a ...
- 1,046
19
votes
2
answers
5k
views
IPA phonology database
Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB)
Update: I tried to convert ...
- 493
19
votes
8
answers
8k
views
List of English words phonetics
The list actually doesn't have to be free! I just need something that I can buy once or whatever.
And if possible, but not needed, parts of speech.
Before you say anything, I have googled for this ...
- 191
19
votes
4
answers
11k
views
Historical weather data
I want to get historical weather data (Winter 2014) of temperature, humidity, air-pressure, wind_speed, wind direction, rain in specific latitude/longitude.
Is there any API that I can use to get ...
- 403
19
votes
6
answers
19k
views
Amazon price history dataset
Are there any datasets on Amazon products' price history? http://camelcamelcamel.com/ doesn't make it available and the Amazon Product Advertising API doesn't seem to give access to the price history.
- 7,740
18
votes
13
answers
9k
views
2014 Ebola outbreak dataset
I'm looking for a dataset on the 2014 Ebola outbreak with as many following fields as possible:
For each individual contaminated with ebola:
Estimated datetime and location of detection
Datetime and ...
- 7,740
18
votes
6
answers
14k
views
U.S. City and County Web Data (API)
Are there any websites that have basic City and County information for the U.S.?
- 1,404
18
votes
7
answers
9k
views
What is the most comprehensive resource for querying french and english books having an ISBN code?
I would like to know if a repository of all known ISBN exists; either a worldwide database, or per country.
If there is no such downloadable database, among all the available API's for querying ...
- 491
18
votes
9
answers
1k
views
Dataset on coronavirus government countermeasures (per country/region/city?)
I am looking for a machine readable dataset of what country has enacted what form of lockdown on what date, and possibly the "type" of lockdown (international travel/national and international travel, ...
- 497
18
votes
6
answers
3k
views
De-identified patient data
Are there any medical or clinical data sources that have de-identified patient data (name, date of birth, sex) as well as basic physical parameters such as weight, or height? I'm specifically ...
- 1,404
18
votes
8
answers
8k
views
Database of ships?
Is there a database of the ships that were built until now, containing the size, weight, displacement, cost, year of built, and optionally the amount of used materials?
It does not need to contain ...
user139
18
votes
3
answers
245
views
Is there an official/complete list of all US government agency "developers' pages"?
The FCC's developers page happens to have a sidebar linking to many other US government agencies' developers pages, APIs, etc. It's a handy list, but I assume the FCC hosts it only out of the goodness ...
- 363
17
votes
7
answers
3k
views
Obtaining personal mail corpus
Are there any publicly available personal mailboxes except for the Enron corpus?
Doesn't have to be a large corpus, even a single mailbox of a single person will help me (step by step...)
...
- 293