All Questions

Barry, could you abuse this site's "answer your own question" feature to create a community wiki answer for sources of weather data (both current and historical), since it gets asked so often?

EAN 13 is an international system. Is there an API or database that contains all items that have these barcodes? Like all food, goods you can buy in a regular convenience store. Is there a global open ...

Is there a database containing the list of the most popular first names and surnames (with occurrence count, or at least sorted by popularity) for many nations/countries? I need such data for the ...

I'm mainly interested in soccer related statistics. There are quite a few different API's relating to soccer, but most of them are commercial and far, far out of my price range. I've looked at DBpedia,...

While there are many open databases available, is there a database or the project that would contain the information of such databases? In other words, is there an open meta-database of open ...

I am seeking open data of roads for medium scaled maps (1:200.000, 1:500.000 up to 1:1.000.000). For the whole world, at least Indonesia and Africa. I know I could use OSM streets and somehow ...

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape

Does anybody know if there is a place I can find historical data of weather forecasts by forecaster? I'm mainly interested in forecasts of high temperature and low temperature, but precipitation ...

To build models to predict customer behavior, I am searching for transactional data over multiple years (i.e. > 3 years). My focus is to assess the quality of long-term predictions, thus the longer ...

I'm looking for cryptocurrency historical data, including prices and market cap (either from exchanges or average price) of the main cryptocurrencies, namely: Bitcoin, Ripple, Litecoin, Ethereum, Dash....

If you are an open data researcher you will need to handle a lot of different file formats from datasets. Sadly, most of the time, you don’t have the opportunity to choose which file format is the ...

BitTorrent can be an efficient way to "host" a large data set that are static. Also, BitTorrent is a good mechanism distribute a large data set as part of a open data project without funding or ...

I want to get historical weather data (Winter 2014) of temperature, humidity, air-pressure, wind_speed, wind direction, rain in specific latitude/longitude. Is there any API that I can use to get ...

There are many web-based Application Programming Interfaces (API) that allow data-hungry people to get their hands on all sorts of data. It's a great way to collect data as-needed, instead of looking ...

Is there a downloadable archive of weather conditions in Europe? Also, the temperature, humidity, precipitation by location? So the database would enable, for example, to draw the chart with ...

I was surprised not to find a similar question here. But what are the best sources of stock market daily (weekly, monthly) prices for all listed companies in a given market? Google Finance, Yahoo ...

When working across country border it makes things easier to know in advance if people in a specific country are going to be on public holiday a certain day. While some calendars application offer to ...

Are there drawbacks to FOIAing (Freedom of Information Act, either federally or equivalent state/local laws) an agency? For example, can it lead to an adversarial relationship?

I've seen many applications (mobile and web) that use a database of nutritional information and barcodes to track daily food consumption. Smartphones have the ability to scan barcodes, and many mobile ...

I'm interested in the data listed in the tables listed here. Is there a good way to extract the information (as JSON, preferably) without resorting to HTML parsing?

I would like to do some analytics on CDR data, preferably mobile, but anything will do. Ideally I would like to have between 100MB to 10GB of data. I have been trying to look for this type of data ...

There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...

Can anyone point me to logs of energy generated by a wind farm/turbine vs. wind speed, over a year or two? 10% accuracy would be plenty. Data for flat land, not offshore, would be good, south Germany ...

The list actually doesn't have to be free! I just need something that I can buy once or whatever. And if possible, but not needed, parts of speech. Before you say anything, I have googled for this ...

Is there a database of the ships that were built until now, containing the size, weight, displacement, cost, year of built, and optionally the amount of used materials? It does not need to contain ...

I am looking for datasets or huge lists of human forenames. There's plenty of websites that curate lists of names. But none of these seems to offer functionality to export either raw data/lists of ...

I want to get a visual feeling for the distribution of electricity and heating load over the year. There are national load curves, then there are reference load curves for individual (mainly ...

I wonder whether it is possible to bulk download all papers stored in Sci-Hub. I am aware of the questions: Is there a more user-friendly way to download multiple articles from arXiv? Bulk download ...

This is a very simple question: Suppose that I have some sort of specialized data, perhaps that I've collected myself or been a part of the collection. And suppose that nothing prevents me from ...

IMDb offers a great deal of useful structured information for research. There're multiple ways to get small pieces of its database: Download a subset of data from http://www.imdb.com/interfaces Use ...

Are there any datasets on Amazon products' price history? http://camelcamelcamel.com/ doesn't make it available and the Amazon Product Advertising API doesn't seem to give access to the price history.

Are there any publicly available personal mailboxes except for the Enron corpus? Doesn't have to be a large corpus, even a single mailbox of a single person will help me (step by step...) ...

Wikipedia has pages for containing a list of towns and cities with 100,000 or more inhabitants. I'd like this same data in machine readable format, with country and city names.

Weather data is often cited as a "huge success" for the open data community. Where does this data sit, and how does one parse the data into something readable, like the 5 day forecast?

I'm looking for a dataset of human translated sentences. The ideal dataset would look like this: 1, en, The weather is nice today. 1, de, Das Wetter ist heute schön. 1, es, El clima es agradable hoy....

I'm building a visualisation with cities' population around the globe for a website. I found the MaxMind free database that includes most cities around the globe with coordinates and population, which ...

Relevant to this answer, I discovered that datahub.io has a 100MB limit on file uploads. I was disappointed to learn this, and it tooks many server errors to realize I should read the FAQ, where I ...

I would like to see how big is the correlation between weather and visits to our website, but I can't seem to find any database that has option of downloading chosen datasets. Any ideas? To be ...

I am doing a data mining project on "health prediction system". So, Is there any open dataset containing data for disease and symptoms.

Countries have mandatory disclosure of some financial indicators for certain industries. Some companies may disclose information about their financial performance at will. While public corporations ...

I'm trying to find data on the breakdown of the popular vote in each U.S. county, for each presidential election going back as far as possible. I realize that counties change over time, but are these ...

I am looking for places to get datasets regarding credit risk and risk analytics in financials services. I have tried many places but was unable find what I am looking for. Can I get any pointer or ...

For a college project I need historical weather forecasts for europe up to 14 days for 2015 and 2106. The last two days I was desperately searching for API's with such data, but usually there is just ...

I was wondering if anyone has a lead on a corpus of geographic locations? City names and coordinate pairs would be ideal. I'm training a chatbot and I'd (ideally) like it to be able to pick up on ...

Wikipedia is a significant source of data. Data from Wikipedia may be available in various formats via other servers (e.g., SPARQL end point). For a task of extracting all pairs of "ATC code" - "...

I am wondering if theres a dataset of key logs for keyboards of computers or even smartphones. It only needs to have the time and the key character for each key pressed. Such as: 9:00 4/2/2014, a 9:...

I will be using AngularJS and D3.js, but that's not really important. This blog post by the developer of D3.js, which is a fantastic JavaScript charting library, shows how he made a map of the UK ...

I need maximum and minimum temperature data of each countries annually. I searched a lot but could not find the values. Could you give links if it is possible?

I am searching for a Database containing a hierarchical Ontology of most objects. For example, an Apple is a special type of an edible Fruit, which is a special type of Fruit. A Fruit is a physical ...

I know lots of organizations and websites are publishing some of these but is there an open dataset with at a minimum of location and operator for ATMs in the UK and possible Ireland?