Questions tagged [data-request]
Indicates a request for relevant open data sources. Please read https://opendata.meta.stackexchange.com/q/284/17438 for writing a good request.
367
questions
26
votes
6
answers
12k
views
Sources of weather data
Barry, could you abuse this site's "answer your own question" feature to create a community wiki answer for sources of weather data (both current and historical), since it gets asked so often?
user3856
172
votes
14
answers
295k
views
Is there a global database of all products with EAN 13 barcodes?
EAN 13 is an international system. Is there an API or database that contains all items that have these barcodes? Like all food, goods you can buy in a regular convenience store. Is there a global open ...
- 1,893
51
votes
16
answers
29k
views
Multinational list of popular first names and surnames?
Is there a database containing the list of the most popular first names and surnames (with occurrence count, or at least sorted by popularity) for many nations/countries?
I need such data for the ...
user139
30
votes
19
answers
64k
views
Are there any open datasets for soccer statistics?
I'm mainly interested in soccer related statistics. There are quite a few different API's relating to soccer, but most of them are commercial and far, far out of my price range. I've looked at DBpedia,...
- 409
5
votes
1
answer
176
views
Seeking globally available road data for medium-scaled maps (1:200.000)
I am seeking open data of roads for medium scaled maps (1:200.000, 1:500.000 up to 1:1.000.000). For the whole world, at least Indonesia and Africa.
I know I could use OSM streets and somehow ...
- 151
26
votes
7
answers
31k
views
Twitter open datasets
Where can I get Twitter datasets available for analysis?
I found two:
The May 2011 Calufa Twitter Scrape
Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
- 3,641
25
votes
3
answers
17k
views
Historical Weather Forecasts
Does anybody know if there is a place I can find historical data of weather forecasts by forecaster? I'm mainly interested in forecasts of high temperature and low temperature, but precipitation ...
- 353
10
votes
2
answers
7k
views
Transactional data over multiple years (Customer ID, Date, Price)
To build models to predict customer behavior, I am searching for transactional data over multiple years (i.e. > 3 years). My focus is to assess the quality of long-term predictions, thus the longer ...
- 269
40
votes
7
answers
69k
views
Cryptocurrency historical prices
I'm looking for cryptocurrency historical data, including prices and market cap (either from exchanges or average price) of the main cryptocurrencies, namely: Bitcoin, Ripple, Litecoin, Ethereum, Dash....
- 1,022
30
votes
4
answers
21k
views
List of public holidays by countries?
When working across country border it makes things easier to know in advance if people in a specific country are going to be on public holiday a certain day.
While some calendars application offer to ...
- 403
25
votes
15
answers
3k
views
COVID19 - Coronavirus case data (country summary data)
There are some very good sites showing the state of infections 'now', but I would like to find a data set of COVID-19 infections, deaths and number of tests by day and by country. These are the best I ...
- 1,104
19
votes
4
answers
11k
views
Historical weather data
I want to get historical weather data (Winter 2014) of temperature, humidity, air-pressure, wind_speed, wind direction, rain in specific latitude/longitude.
Is there any API that I can use to get ...
- 403
13
votes
7
answers
5k
views
Dataset of domain names
There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
- 17.6k
38
votes
10
answers
23k
views
Downloadable archive of weather conditions for Europe?
Is there a downloadable archive of weather conditions in Europe?
Also, the temperature, humidity, precipitation by location?
So the database would enable, for example, to draw the chart with ...
user139
23
votes
7
answers
26k
views
Any CDR (call data record) dataset?
I would like to do some analytics on CDR data, preferably mobile, but anything will do.
Ideally I would like to have between 100MB to 10GB of data.
I have been trying to look for this type of data ...
- 541
20
votes
4
answers
8k
views
Stock market historical data
I was surprised not to find a similar question here. But what are the best sources of stock market daily (weekly, monthly) prices for all listed companies in a given market?
Google Finance, Yahoo ...
- 3,641
18
votes
8
answers
8k
views
Database of ships?
Is there a database of the ships that were built until now, containing the size, weight, displacement, cost, year of built, and optionally the amount of used materials?
It does not need to contain ...
user139
13
votes
4
answers
283
views
COVID-19 Clinical Data or Statistics
Is there anywhere a database that includes case-level information on COVID-19 cases?
Such data would typically include patient demographics and/or health information, location, time of onset/testing, ...
- 314
11
votes
2
answers
3k
views
1945 (spring) daily weather Germany
Perhaps understandably, I am having difficulty tracking down daily weather data for Germany in early 1945.
My specific interest is in daily temps and any other daily weather observations for January ...
- 111
9
votes
5
answers
2k
views
Wind energy vs. wind speed
Can anyone point me to logs of energy generated by a wind farm/turbine
vs. wind speed, over a year or two? 10% accuracy would be plenty. Data for flat land, not offshore, would be good, south Germany ...
- 456
3
votes
2
answers
416
views
Looking for corpus of Geographic Data
I was wondering if anyone has a lead on a corpus of geographic locations? City names and coordinate pairs would be ideal. I'm training a chatbot and I'd (ideally) like it to be able to pick up on ...
- 43
76
votes
5
answers
96k
views
Open API for nutritional information and/or food barcodes?
I've seen many applications (mobile and web) that use a database of nutritional information and barcodes to track daily food consumption. Smartphones have the ability to scan barcodes, and many mobile ...
- 2,088
30
votes
8
answers
11k
views
How can I download the complete Wikidata database?
Wikidata is a new Wikimedia project:
It centralizes access to and management of structured data, such as interwiki references and statistical information.
This data would be of enormous interest ...
- 5,770
21
votes
7
answers
30k
views
Age, Weight and Height dataset
I am trying to get a dataset (preferable worldwide) that has the attributes (height, weight and age). The only decent dataset that I have been able to find was from here: https://stats.stackexchange....
- 393
19
votes
8
answers
8k
views
List of English words phonetics
The list actually doesn't have to be free! I just need something that I can buy once or whatever.
And if possible, but not needed, parts of speech.
Before you say anything, I have googled for this ...
- 191
18
votes
9
answers
1k
views
Dataset on coronavirus government countermeasures (per country/region/city?)
I am looking for a machine readable dataset of what country has enacted what form of lockdown on what date, and possibly the "type" of lockdown (international travel/national and international travel, ...
- 497
17
votes
5
answers
12k
views
World city database (with longitude, latitude) and population per year
I'm building a visualisation with cities' population around the globe for a website. I found the MaxMind free database that includes most cities around the globe with coordinates and population, which ...
- 355
13
votes
3
answers
7k
views
Dataset of sentences translated into many languages
I'm looking for a dataset of human translated sentences.
The ideal dataset would look like this:
1, en, The weather is nice today.
1, de, Das Wetter ist heute schön.
1, es, El clima es agradable hoy....
- 17.6k
13
votes
2
answers
3k
views
List of abbreviations and acronyms
I am searching an list of abbreviations,acronyms which should be downloadable as a sql table or json or sth. like that so no api cause it might be not fast enough or has a limit like this one: http://...
- 335
10
votes
1
answer
488
views
Word list with learning age
I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned.
WordNet linkage is a big bonus.
- 261
10
votes
6
answers
5k
views
Searching for list(s) of babynames containing huge (10k+) amounts of unique names
I am looking for datasets or huge lists of human forenames. There's plenty of websites that curate lists of names. But none of these seems to offer functionality to export either raw data/lists of ...
- 203
9
votes
5
answers
1k
views
Electricity and (space) heating load curves for a city
I want to get a visual feeling for the distribution of electricity and heating load over the year. There are national load curves, then there are reference load curves for individual (mainly ...
- 2,804
6
votes
1
answer
24k
views
How can I get temperature data for each Country (Annual)
I need maximum and minimum temperature data of each countries annually.
I searched a lot but could not find the values.
Could you give links if it is possible?
33
votes
3
answers
22k
views
Bulk download Sci-Hub papers
I wonder whether it is possible to bulk download all papers stored in Sci-Hub.
I am aware of the questions:
Is there a more user-friendly way to download multiple articles from arXiv?
Bulk download ...
- 7,740
20
votes
2
answers
61k
views
Where to get IMDb datasets
IMDb offers a great deal of useful structured information for research.
There're multiple ways to get small pieces of its database:
Download a subset of data from http://www.imdb.com/interfaces
Use ...
- 3,641
19
votes
6
answers
19k
views
Amazon price history dataset
Are there any datasets on Amazon products' price history? http://camelcamelcamel.com/ doesn't make it available and the Amazon Product Advertising API doesn't seem to give access to the price history.
- 7,740
17
votes
7
answers
3k
views
Obtaining personal mail corpus
Are there any publicly available personal mailboxes except for the Enron corpus?
Doesn't have to be a large corpus, even a single mailbox of a single person will help me (step by step...)
...
- 293
16
votes
3
answers
13k
views
Data of vehicle traffic
Does anyone know/have good dataset or data feed of vehicle traffic on freeways/highways or urban area?
I'm searching for data from vehicle counters that have small interval of measurement, like 1 or ...
- 261
14
votes
7
answers
13k
views
Dataset of major newspapers content
I'm looking for the materials of major newspapers, such as The New York Times, Washington Post, and The Economist. A random sample of their articles or headlines would suffice, but each newspaper has ...
- 3,641
14
votes
4
answers
6k
views
How does one parse weather data?
Weather data is often cited as a "huge success" for the open data community. Where does this data sit, and how does one parse the data into something readable, like the 5 day forecast?
- 927
11
votes
5
answers
9k
views
Database world cities with their names in all languages of the world
I'm looking for a database of cities in the world with their names in all languages of the world. Where it is possible to download?
- 161
11
votes
7
answers
7k
views
Large French dataset for NLP (not formal, rather discussions/reviews)
What am I looking for ?
I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias).
Why this ...
- 413
11
votes
3
answers
18k
views
Where can I get private companies' financials?
Countries have mandatory disclosure of some financial indicators for certain industries. Some companies may disclose information about their financial performance at will.
While public corporations ...
- 3,641
11
votes
5
answers
2k
views
Looking for a list of major cities of the world
Wikipedia has pages for containing a list of towns and cities with 100,000 or more inhabitants. I'd like this same data in machine readable format, with country and city names.
- 371
9
votes
4
answers
19k
views
Free source of AIS data (API)
The automatic identification system (AIS) is an automatic tracking system that uses transponders on ships to locate them. There are also databases that provide information about the ship — size, type, ...
9
votes
1
answer
490
views
ATM locations in UK and/or Ireland
I know lots of organizations and websites are publishing some of these but is there an open dataset with at a minimum of location and operator for ATMs in the UK and possible Ireland?
- 323
9
votes
1
answer
527
views
Where to find key log data for keyboard usage?
I am wondering if theres a dataset of key logs for keyboards of computers or even smartphones. It only needs to have the time and the key character for each key pressed.
Such as:
9:00 4/2/2014, a
9:...
- 518
8
votes
8
answers
7k
views
German - English dictionary
I'm looking for a simple German - English dictionary (txt, CSV or some other easy-to-parse format)
I need only German nouns with their gender, plural form (optional) and translation to English. I've ...
- 191
8
votes
1
answer
300
views
Is there any international public transport data?
I want to create some proof of concept for an international public transport service. Is there any data or an API available that already normalizes this data across multiple countries, besides Google ...
- 83
8
votes
4
answers
6k
views
Is there any free weather database that one could use for correlations in business intelligence software?
I would like to see how big is the correlation between weather and visits to our website, but I can't seem to find any database that has option of downloading chosen datasets. Any ideas?
To be ...
- 103