Questions tagged [data-request]

Indicates a request for relevant open data sources. Please read https://opendata.meta.stackexchange.com/questions/284/how-a-good-data-request-question-should-look-like for writing a good request.

19
votes
8answers
7k views

Database with monthly climate/weather data by country

I am searching for a online database for climate data (especially temperature) for non-european countries on a monthly basis. 1990-2014 would be nice. Thank you!
16
votes
2answers
3k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...
9
votes
2answers
2k views

publicly available spam dataset of social networks

I am trying to create a naive bayes spam filter for social networks and i need a spam dataset (containing posts/tweets etc.) of popular social networks like twitter/facebook. Is there any publicly ...
20
votes
8answers
656 views

How can I trust the authenticity of an open data source?

If some site claims to offer a definitive data source, how can I trust that it is not purposely biased? Even excluding elaborate conspiracies, how could I know that it isn't just a big hoax? It ...
11
votes
1answer
3k views

Database of English words difficulty

Data request I am looking for a database that describes the "difficulty" of each English word. Difficulty of a word is not easy to define, but it is probably a mix of: Level of study needed to ...
9
votes
3answers
734 views

Data sets for teaching

I'll be giving a (short) introductory course for Data Science within a couple of months. One of my ideas was, instead of giving lectures on theoretic aspects of it (which of course are important), ...
9
votes
3answers
3k views

Query medicine descriptions API

I am looking for publicly available API for querying medicine's descriptions. For example, if I supply Carbidopa/Levodopa or Sinemet the expected return data (in json or xml format) is a simple ...
8
votes
1answer
187 views

Word list with learning age

I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned. WordNet linkage is a big bonus.
3
votes
1answer
2k views

Structured movie/TV dataset

I am looking for a downloadable, always up to date and structured comprehensive dataset of movies and TV shows. I found this question and it does have some answers - DBPedia and Freebase, but they do ...
2
votes
1answer
1k views

Tagged (non-anonymized) GPS driver trip database

The AXA Kaggle challenge Driver Telematics Analysis provides a dataset of over 50,000 anonymized driver trips. Are there open databases of tagged, non-anonymized trips, with several trips for each ...
16
votes
6answers
9k views

U.S. City and County Web Data (API)

Are there any websites that have basic City and County information for the U.S.?
16
votes
7answers
2k views

Is there a list, database or API that contains the URLs for United States city and town websites?

I'm looking for a database of URLs for every official city and town website. Ideally this list would be up to date and maintained. Freebase has some of the results and we have every city and town in ...
13
votes
2answers
823 views

Rocket attacks dataset in Israel and State of Palestine

I'm looking for a dataset listing the rocket attacks in Israel and the State of Palestine with as many following fields as possible: timestamp GPS number of casualties reason for attack (e.g. a ...
12
votes
7answers
1k views

List of English words

I'm writing a program that requires a list of English words, such as that used by a spell checker. I have been unable to find any such word lists whatsoever, even after trying 2 search engines.
10
votes
3answers
621 views

List of all restaurants in a city (EU)?

Is there an open database where I can get the list of all restaurants (or bakeries, etc) for a given city ? Since I'd need theses places so as to be able to put them on a map, like Google maps, i ...
7
votes
3answers
6k views

A dataset of resumes

This is a question I found on /r/datasets. Does OpenData have any answers to add? I'm looking for a large collection or resumes and preferably knowing whether they are employed or not. Does such a ...
10
votes
4answers
6k views

Cost of living dataset

I'm trying to compare what the equivalent salary would be between two cities based upon the cost of living in each city. I want to be able to build something like CNN's cost of living calculator. ...
9
votes
6answers
355 views

Are there any international non-governmental data aggregators?

We are probably all familiar with Manyeyes and google public data explorer but those are always based on governmental Statistics bureau or OECD data. Are there any projects to aggregate data that is ...
8
votes
1answer
3k views

FIFA 2014 tweets dataset for academic project

I am looking to run a Map Reduce framework and do some analysis on a Twitter dataset for the FIFA 2014 World Cup event. I couldn't find a place to get these datasets for free. Can someone suggest a ...
6
votes
1answer
2k views

Where can I find a downloadable grocery store food ingredient database / data set?

I'm looking for a downloadable ingredient database / data set. I'd like to be able to write my own query to the data set, eliminating potentially harmful ingredients to see what would be potentially ...
5
votes
2answers
1k views

Open, big time-series dataset (ideally web traffic)

I'm working on a project for automatically identifying and sorting web analytics incidents. As part of testing of the software, I'm looking for time-series dataset (ideally >100K rows) with daily ...
4
votes
1answer
597 views

Green Button energy data

The Green Button Data program in the US allows energy consumers to easily download their consumption data in a standard XML format. With that exported file, they can upload to a 3rd party site or app, ...
3
votes
1answer
88 views

NEISS injury dataset - machine readable and decoded

The National Electronic Injury Surveillance System (NEISS) database offers both a query tool and bulk CSV downloads at maximum one calendar year. The available data dates back to 1991. Patient ...
3
votes
1answer
162 views

Open Data about the internet

Does anyone know where one can find (if any is available) open data about the internet, and generally any data about tier1 infrastructure, i.e internet backbone nodes with capacity, coordinates Also ...
11
votes
7answers
4k views

Large French dataset for NLP (not formal, rather discussions/reviews)

What am I looking for ? I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias). Why this ...
11
votes
3answers
2k views

Where could I find open data about ATM locations (in Paris)?

I'm thinking of building an application that shows you the nearest ATM machine, but I don't know where I can find open data about ATM locations (or if there even is such data available). I'm asking ...
7
votes
2answers
2k views

Music lyrics timing data

I wonder if there is a database or technique of collecting the timings of a song? I found this post linking to MusicXML. However, it seems MusicXML is for sheet music. I am looking for data relating ...
6
votes
4answers
4k views

Database world cities with their names in all languages of the world

I'm looking for a database of cities in the world with their names in all languages of the world. Where it is possible to download?
5
votes
2answers
565 views

Weather Web Service by Postal Code?

I'm looking for either a website, a web service, an RSS feed, etc. that would allow me to look up current and historic weather info for a particular zipcode or region in the U.S., specifically: ...
4
votes
2answers
4k views

Rugby Union data

Does anyone know of any open rugby union datasets? Looking to doing some data visualisations and I'm a rugby fan. I know that there has been a big increase of the use of rugby data metrics within ...
2
votes
1answer
117 views

Where can I find data set of tweets of users? [duplicate]

I am doing a project "Emotional prediction of user based on tweets", using data mining techniques. For this purpose, I need a data set of tweets of users. Please help.
2
votes
2answers
1k views

Alternatives to ImageNet

I'm interested in freely available crowdsourced images with semantic tagging similar to what ImageNet provides. Are there any alternatives to ImageNet here? Update: I just found NEIL http://www.neil-...
2
votes
1answer
59 views

SWIFT routing codes for all global banks

Does anyone know if it's possible to get SWIFT routing codes for all banks, or only on a per-country basis? (this came up in my Twitter feed - I thought it was a good question and I didn't find any ...
10
votes
4answers
1k views

IP Geocoding Data Sources and/or APIs

I am looking for IP address to geocoding data sources and/or APIs. Open to any formats, and the main concern is the quality, depth, and freshness of the data.
9
votes
2answers
1k views

1945 (spring) daily weather Germany

Perhaps understandably, I am having difficulty tracking down daily weather data for Germany in early 1945. My specific interest is in daily temps and any other daily weather observations for January ...
9
votes
3answers
272 views

Real-time location of trains in France, Germany, Switzerland, and other countries

In Great Britain, Real Time Trains shows the actual departure, arrival, and passing times at any control point (station stop or not) for any train (passenger, freight, or other) anywhere in Great ...
8
votes
4answers
4k views

English news dataset for sentiment analysis

I am looking for an English news dataset with (relevant) entities mentioned in the article labelled with the sentiment/connotation expressed on the entity by the article. e.g. A sense of the ...
8
votes
2answers
756 views

Looking for geo localization data of golf courses

I'm looking for free geo localization data of world wide golf courses. I can easily parse and store this information from several specialized websites... But I would like to find another way to get it ...
8
votes
2answers
1k views

London rail and tube station locations

I'm looking for a data set of rail and tube stations in the Transport for London network, specifically, stations where one could use an Oyster card. I'm interested in the locations of these stations ...
8
votes
1answer
243 views

Is there any international public transport data?

I want to create some proof of concept for an international public transport service. Is there any data or an API available that already normalizes this data across multiple countries, besides Google ...
6
votes
1answer
2k views

open database photos of human faces with age

Is there an open database with photos of the human face, with related data such as age, sex or ethnicity, but I am most interested in age.
4
votes
2answers
1k views

List of common foodstuffs/meals?

I'm looking for a open-source list of common foodstuffs/meals that I can use to populate a database for some R&D. Ideally I'd just like a long list of food/meal names (as if you were browsing ...
4
votes
1answer
2k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
4
votes
1answer
94 views

Dataset: Car types by country

I am looking for a free dataset that shows the number of car types sold/in use in every country. For example: Italy: SUV: 2.500.000 Sedan: 3.00.000 ... Spain: SUV: 3.500.000 ...
4
votes
2answers
791 views

Dataset of Home Appliance Usage

I'm interested in obtaining a dataset that includes the electricity usage of individual home appliances measured at hourly intervals. An example of such a dataset is the IRISE Project from REMODECE. ...
4
votes
1answer
2k views

Where can I find some publicly available dataset for retail/grocery store comapnies?

I am looking for some publicly available dataset for retail/grocery store companies which (preferably) includes data about there stores, number of employees and operations. I tried to look around but ...
4
votes
2answers
61 views

Source of aggressively toned texts for machine learning

I was looking for a source where there would be an extended amount of texts with aggressive tone. It can be intertwined with non-aggressive texts, but it would be good if the ratio of aggressive texts ...
3
votes
0answers
37 views

Overview on hospitals and medical services - in America, Asia, Africa and Europe

I am looking for a overview on hospitals and medical services provided by the public (and also by the private) healthcare sector in Europe, Asia America and Australia. public hospitals private ...
3
votes
1answer
3k views

Amazon ASIN and Category

On Amazon, clearly there is a tree where all the leaves are the products and you can narrow down a category to find the products. For example, what I am looking is actually under the category Cell ...
3
votes
0answers
123 views

Bacterial infectious diseases dataset

Does anyone know of a dataset relating: bacteria (not viruses or fungi) infectiousness symptoms ...or something of the sort? I'm looking to classify infectiousness (ie. infectious/not infectious) ...