Questions tagged [data-request]

Indicates a request for relevant open data sources. Please read https://opendata.meta.stackexchange.com/questions/284/how-a-good-data-request-question-should-look-like for writing a good request.

Filter by
Sorted by
Tagged with
19
votes
5answers
3k views

Sources of weather data

Barry, could you abuse this site's "answer your own question" feature to create a community wiki answer for sources of weather data (both current and historical), since it gets asked so often?
127
votes
14answers
218k views

Is there a global database of all products with EAN 13 barcodes?

EAN 13 is an international system. Is there an API or database that contains all items that have these barcodes? Like all food, goods you can buy in a regular convenience store. Is there a global open ...
40
votes
12answers
11k views

Multinational list of popular first names and surnames?

Is there a database containing the list of the most popular first names and surnames (with occurrence count, or at least sorted by popularity) for many nations/countries? I need such data for the ...
26
votes
17answers
46k views

Are there any open datasets for soccer statistics?

I'm mainly interested in soccer related statistics. There are quite a few different API's relating to soccer, but most of them are commercial and far, far out of my price range. I've looked at DBpedia,...
3
votes
1answer
72 views

Seeking globally available road data for medium-scaled maps (1:200.000)

I am seeking open data of roads for medium scaled maps (1:200.000, 1:500.000 up to 1:1.000.000). For the whole world, at least Indonesia and Africa. I know I could use OSM streets and somehow ...
23
votes
6answers
27k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
21
votes
3answers
11k views

Historical Weather Forecasts

Does anybody know if there is a place I can find historical data of weather forecasts by forecaster? I'm mainly interested in forecasts of high temperature and low temperature, but precipitation ...
10
votes
2answers
5k views

Transactional data over multiple years (Customer ID, Date, Price)

To build models to predict customer behavior, I am searching for transactional data over multiple years (i.e. > 3 years). My focus is to assess the quality of long-term predictions, thus the longer ...
28
votes
7answers
51k views

Cryptocurrency historical prices

I'm looking for cryptocurrency historical data, including prices and market cap (either from exchanges or average price) of the main cryptocurrencies, namely: Bitcoin, Ripple, Litecoin, Ethereum, Dash....
18
votes
3answers
9k views

Historical weather data

I want to get historical weather data (Winter 2014) of temperature, humidity, air-pressure, wind_speed, wind direction, rain in specific latitude/longitude. Is there any API that I can use to get ...
31
votes
10answers
17k views

Downloadable archive of weather conditions for Europe?

Is there a downloadable archive of weather conditions in Europe? Also, the temperature, humidity, precipitation by location? So the database would enable, for example, to draw the chart with ...
18
votes
3answers
6k views

Stock market historical data

I was surprised not to find a similar question here. But what are the best sources of stock market daily (weekly, monthly) prices for all listed companies in a given market? Google Finance, Yahoo ...
20
votes
3answers
7k views

List of public holidays by countries?

When working across country border it makes things easier to know in advance if people in a specific country are going to be on public holiday a certain day. While some calendars application offer to ...
59
votes
6answers
65k views

Open API for nutritional information and/or food barcodes?

I've seen many applications (mobile and web) that use a database of nutritional information and barcodes to track daily food consumption. Smartphones have the ability to scan barcodes, and many mobile ...
21
votes
6answers
20k views

Any CDR (call data record) dataset?

I would like to do some analytics on CDR data, preferably mobile, but anything will do. Ideally I would like to have between 100MB to 10GB of data. I have been trying to look for this type of data ...
10
votes
5answers
2k views

Dataset of domain names

There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
7
votes
5answers
2k views

Wind energy vs. wind speed

Can anyone point me to logs of energy generated by a wind farm/turbine vs. wind speed, over a year or two? 10% accuracy would be plenty. Data for flat land, not offshore, would be good, south Germany ...
11
votes
6answers
4k views

Is there a free list of English word phonetics?

The list actually doesn't have to be free! I just need something that I can buy once or whatever. And if possible, but not needed, parts of speech. Before you say anything, I have googled for this ...
13
votes
5answers
4k views

Database of ships?

Is there a database of the ships that were built until now, containing the size, weight, displacement, cost, year of built, and optionally the amount of used materials? It does not need to contain ...
11
votes
4answers
2k views

Searching for list(s) of babynames containing huge (10k+) amounts of unique names

I am looking for datasets or huge lists of human forenames. There's plenty of websites that curate lists of names. But none of these seems to offer functionality to export either raw data/lists of ...
8
votes
5answers
983 views

Electricity and (space) heating load curves for a city

I want to get a visual feeling for the distribution of electricity and heating load over the year. There are national load curves, then there are reference load curves for individual (mainly ...
25
votes
3answers
11k views

Bulk download Sci-Hub papers

I wonder whether it is possible to bulk download all papers stored in Sci-Hub. I am aware of the questions: Is there a more user-friendly way to download multiple articles from arXiv? Bulk download ...
19
votes
2answers
51k views

Where to get IMDb datasets

IMDb offers a great deal of useful structured information for research. There're multiple ways to get small pieces of its database: Download a subset of data from http://www.imdb.com/interfaces Use ...
17
votes
5answers
13k views

Amazon price history dataset

Are there any datasets on Amazon products' price history? http://camelcamelcamel.com/ doesn't make it available and the Amazon Product Advertising API doesn't seem to give access to the price history.
16
votes
7answers
2k views

Obtaining personal mail corpus

Are there any publicly available personal mailboxes except for the Enron corpus? Doesn't have to be a large corpus, even a single mailbox of a single person will help me (step by step...) ...
10
votes
5answers
2k views

Looking for a list of major cities of the world

Wikipedia has pages for containing a list of towns and cities with 100,000 or more inhabitants. I'd like this same data in machine readable format, with country and city names.
12
votes
4answers
5k views

How does one parse weather data?

Weather data is often cited as a "huge success" for the open data community. Where does this data sit, and how does one parse the data into something readable, like the 5 day forecast?
9
votes
3answers
4k views

Dataset of sentences translated into many languages

I'm looking for a dataset of human translated sentences. The ideal dataset would look like this: 1, en, The weather is nice today. 1, de, Das Wetter ist heute schön. 1, es, El clima es agradable hoy....
15
votes
3answers
10k views

World city database (with longitude, latitude) and population per year

I'm building a visualisation with cities' population around the globe for a website. I found the MaxMind free database that includes most cities around the globe with coordinates and population, which ...
7
votes
3answers
4k views

Is there any free weather database that one could use for correlations in business intelligence software?

I would like to see how big is the correlation between weather and visits to our website, but I can't seem to find any database that has option of downloading chosen datasets. Any ideas? To be ...
10
votes
3answers
17k views

Where can I get private companies' financials?

Countries have mandatory disclosure of some financial indicators for certain industries. Some companies may disclose information about their financial performance at will. While public corporations ...
7
votes
5answers
397 views

Where can I find data on the winner of the presidential popular vote by U.S. county, for as many elections as possible?

I'm trying to find data on the breakdown of the popular vote in each U.S. county, for each presidential election going back as far as possible. I realize that counties change over time, but are these ...
5
votes
2answers
575 views

Places to find credit risk data-sets

I am looking for places to get datasets regarding credit risk and risk analytics in financials services. I have tried many places but was unable find what I am looking for. Can I get any pointer or ...
5
votes
2answers
897 views

Historical weather forecast API

For a college project I need historical weather forecasts for europe up to 14 days for 2015 and 2106. The last two days I was desperately searching for API's with such data, but usually there is just ...
3
votes
2answers
93 views

Looking for corpus of Geographic Data

I was wondering if anyone has a lead on a corpus of geographic locations? City names and coordinate pairs would be ideal. I'm training a chatbot and I'd (ideally) like it to be able to pick up on ...
8
votes
1answer
215 views

Where to find key log data for keyboard usage?

I am wondering if theres a dataset of key logs for keyboards of computers or even smartphones. It only needs to have the time and the key character for each key pressed. Such as: 9:00 4/2/2014, a 9:...
7
votes
3answers
381 views

Geodata to make a map of the UK with counties outlined

I will be using AngularJS and D3.js, but that's not really important. This blog post by the developer of D3.js, which is a fantastic JavaScript charting library, shows how he made a map of the UK ...
5
votes
1answer
15k views

How can I get temperature data for each Country (Annual)

I need maximum and minimum temperature data of each countries annually. I searched a lot but could not find the values. Could you give links if it is possible?
3
votes
1answer
144 views

Ontological Database of Objects

I am searching for a Database containing a hierarchical Ontology of most objects. For example, an Apple is a special type of an edible Fruit, which is a special type of Fruit. A Fruit is a physical ...
8
votes
1answer
306 views

ATM locations in UK and/or Ireland

I know lots of organizations and websites are publishing some of these but is there an open dataset with at a minimum of location and operator for ATMs in the UK and possible Ireland?
6
votes
0answers
267 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
4
votes
2answers
1k views

List of common foodstuffs/meals?

I'm looking for a open-source list of common foodstuffs/meals that I can use to populate a database for some R&D. Ideally I'd just like a long list of food/meal names (as if you were browsing ...
3
votes
1answer
343 views

Customer Support Interactions data?

I need to answer some of the following questions: What is the average amount of time taken to close a customer issue? What is the average length of chat for a particular segment of the complaint? (...
2
votes
1answer
52 views

Business Location Test Data

I'm working through a book that deals with MEAN applications... and in the book it deals with geo-spatial data and creates a Review for Businesses (Think: Yelp. Look for businesses close to a location ...
24
votes
7answers
7k views

How can I download the complete Wikidata database?

Wikidata is a new Wikimedia project: It centralizes access to and management of structured data, such as interwiki references and statistical information. This data would be of enormous interest ...
17
votes
2answers
23k views

Is there an open database of elementary, middle, and high schools in the United States?

Is there an up-to-date and regularly maintained open database of elementary, middle, and high schools in the United States? I'm looking for both public and private schools. Names alone would be a ...
11
votes
4answers
3k views

Has any MOOC (Coursera, edX, Udacity or others) publicly released some of their student data?

I'm looking for educational datasets from MOOCs. PSLC DataShop contains some learning interaction data, but not from MOOCs. I'm especially interested in logs tracking students' activities such as ...
15
votes
8answers
6k views

Is there an open movie and/or music database available for commercial use?

I would like to know if there is an open database for movies that could have the same amount and quality of data as IMDB. I would like it for commercial use, and free if possible. Same for music, I ...
19
votes
8answers
7k views

Database with monthly climate/weather data by country

I am searching for a online database for climate data (especially temperature) for non-european countries on a monthly basis. 1990-2014 would be nice. Thank you!
16
votes
2answers
3k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...