All Questions

Filter by
Sorted by
Tagged with
6
votes
1answer
277 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
4
votes
2answers
1k views

List of common foodstuffs/meals?

I'm looking for a open-source list of common foodstuffs/meals that I can use to populate a database for some R&D. Ideally I'd just like a long list of food/meal names (as if you were browsing ...
3
votes
1answer
348 views

Customer Support Interactions data?

I need to answer some of the following questions: What is the average amount of time taken to close a customer issue? What is the average length of chat for a particular segment of the complaint? (...
2
votes
1answer
55 views

Business Location Test Data

I'm working through a book that deals with MEAN applications... and in the book it deals with geo-spatial data and creates a Review for Businesses (Think: Yelp. Look for businesses close to a location ...
97
votes
21answers
12k views

Is there a Git for data?

I know you can put CSV or XML in Git already, but there are issues for those wishing to collaborate on a dataset for creation, cleaning it up, pull requests, etc. Are there alternative version control ...
85
votes
20answers
146k views

How can I work with a 4GB csv file?

What's the best way to access a 4GB csv file? I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here http://nppes.viva-it.com/NPI_Files.html Specifically, ...
35
votes
11answers
29k views

Good tools to parse repetitive unstructured data

I'm looking to parse a large number of lines of repetitive but unstructured data. This is a task that happens at least once every project, in my experience, so I'm looking for a tool to transform ...
24
votes
7answers
7k views

How can I download the complete Wikidata database?

Wikidata is a new Wikimedia project: It centralizes access to and management of structured data, such as interwiki references and statistical information. This data would be of enormous interest ...
25
votes
12answers
3k views

Metadata standards and best practices for data dictionaries for CSV files/data

We publish most of our machine-readable open data in CSV format. What are best practices and/or standards to publish data dictionaries (e.g. definitions of columns in CSV files including human-...
25
votes
8answers
2k views

Tools for merging similar datasets continuously

How do I merge similar datasets, not just once but on an ongoing basis? This seems like a reasonably common problem so I'd be interested if there is a tool out there aimed at this problem, as a guided ...
25
votes
7answers
3k views

Extracting tables from multiple PDFs

What's the best practice of extracting tables from a large number of PDF, which may be formatted differently? For example, I have a series of PDFs like this one, and I would like to extract the ...
17
votes
2answers
23k views

Is there an open database of elementary, middle, and high schools in the United States?

Is there an up-to-date and regularly maintained open database of elementary, middle, and high schools in the United States? I'm looking for both public and private schools. Names alone would be a ...
15
votes
7answers
15k views

Are there free APIs for searching news articles that I can use to collect trend data in news coverage?

I am working on a data-visualization web application that looks at trends in American news media coverage over time. It takes a keyword (or keywords), a date range, and a time increment as parameters ...
11
votes
4answers
3k views

Has any MOOC (Coursera, edX, Udacity or others) publicly released some of their student data?

I'm looking for educational datasets from MOOCs. PSLC DataShop contains some learning interaction data, but not from MOOCs. I'm especially interested in logs tracking students' activities such as ...
15
votes
8answers
6k views

Is there an open movie and/or music database available for commercial use?

I would like to know if there is an open database for movies that could have the same amount and quality of data as IMDB. I would like it for commercial use, and free if possible. Same for music, I ...
10
votes
2answers
2k views

Catalog.data.gov using CKAN API with python requests package

I'm not sure if this is a requests issue, a CKAN API issue, or a catalog.data.gov issue. I can do this GET query: import requests import json r = requests.get('http://catalog.data.gov/api/search/...
19
votes
8answers
7k views

Database with monthly climate/weather data by country

I am searching for a online database for climate data (especially temperature) for non-european countries on a monthly basis. 1990-2014 would be nice. Thank you!
17
votes
2answers
3k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...
14
votes
6answers
338 views

What is the best way to request machine readable data from a FOIA request?

Maybe there is no way to request a specific file type but what is the best way to request a file (paper or digital) that can be converted easiestly?
11
votes
1answer
2k views

How to construct a database with the underlying real estate data displayed by Redfin, Zillow, or Trulia?

Regardless of whether the home is for sale, if you type any street address into Zillow, Redfin, or Trulia, they will often tell you the square footage, the last-sold-date, the taxable value, and often ...
24
votes
5answers
4k views

How to normalize the data when mapping crime reports?

Most maps using count of reports of crime end up being maps of the population density of cities. An attractive response would be to turn these counts into a rate, but a rate per what? Most commonly, ...
11
votes
1answer
3k views

Database of English words difficulty

Data request I am looking for a database that describes the "difficulty" of each English word. Difficulty of a word is not easy to define, but it is probably a mix of: Level of study needed to ...
9
votes
2answers
2k views

publicly available spam dataset of social networks

I am trying to create a naive bayes spam filter for social networks and i need a spam dataset (containing posts/tweets etc.) of popular social networks like twitter/facebook. Is there any publicly ...
7
votes
2answers
535 views

Examples of (near) real-time energy dashboards or portals

What are some examples of real-time or live data dashboards related to consumption, production or transmission of energy?
20
votes
8answers
675 views

How can I trust the authenticity of an open data source?

If some site claims to offer a definitive data source, how can I trust that it is not purposely biased? Even excluding elaborate conspiracies, how could I know that it isn't just a big hoax? It ...
17
votes
4answers
916 views

What are the practical limits of releasing open data via bit torrent?

I know that there are political issues (my place of work bans all peer-to-peer software without an explicit waiver), but how well does bit torrent scale for distributing large data collections where ...
13
votes
6answers
2k views

Raw data from US Census and BLS

Is the raw data of US Census or BLS available? By raw I mean the datapoints that later comprise the summary tables. For instance, the average employment by firm size. Apart from means that you can ...
12
votes
7answers
2k views

List of English words

I'm writing a program that requires a list of English words, such as that used by a spell checker. I have been unable to find any such word lists whatsoever, even after trying 2 search engines.
12
votes
2answers
5k views

Is there a tool to match zip codes to cities?

I have a data set with zipcodes and would like to do a bulk upload to a tool that will give me the cities each zip is in (US only.)
9
votes
2answers
973 views

List of abbreviations and acronyms

I am searching an list of abbreviations,acronyms which should be downloadable as a sql table or json or sth. like that so no api cause it might be not fast enough or has a limit like this one: http://...
9
votes
3answers
3k views

Query medicine descriptions API

I am looking for publicly available API for querying medicine's descriptions. For example, if I supply Carbidopa/Levodopa or Sinemet the expected return data (in json or xml format) is a simple ...
8
votes
3answers
787 views

Data sets for teaching

I'll be giving a (short) introductory course for Data Science within a couple of months. One of my ideas was, instead of giving lectures on theoretic aspects of it (which of course are important), ...
7
votes
1answer
203 views

Word list with learning age

I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned. WordNet linkage is a big bonus.
7
votes
3answers
7k views

A dataset of resumes

This is a question I found on /r/datasets. Does OpenData have any answers to add? I'm looking for a large collection or resumes and preferably knowing whether they are employed or not. Does such a ...
7
votes
4answers
4k views

Database world cities with their names in all languages of the world

I'm looking for a database of cities in the world with their names in all languages of the world. Where it is possible to download?
3
votes
1answer
2k views

Structured movie/TV dataset

I am looking for a downloadable, always up to date and structured comprehensive dataset of movies and TV shows. I found this question and it does have some answers - DBPedia and Freebase, but they do ...
2
votes
1answer
1k views

Tagged (non-anonymized) GPS driver trip database

The AXA Kaggle challenge Driver Telematics Analysis provides a dataset of over 50,000 anonymized driver trips. Are there open databases of tagged, non-anonymized trips, with several trips for each ...
17
votes
5answers
14k views

Age, Weight and Height dataset

I am trying to get a dataset (preferable worldwide) that has the attributes (height, weight and age). The only decent dataset that I have been able to find was from here: https://stats.stackexchange....
16
votes
6answers
9k views

U.S. City and County Web Data (API)

Are there any websites that have basic City and County information for the U.S.?
16
votes
7answers
2k views

Is there a list, database or API that contains the URLs for United States city and town websites?

I'm looking for a database of URLs for every official city and town website. Ideally this list would be up to date and maintained. Freebase has some of the results and we have every city and town in ...
13
votes
4answers
336 views

How do I share Open Data with others on this SE site?

I have some data which is Open(free from copyright, patents or other control mechanisms) and I want to share it with the users here. How do I do it without having to host it on some other server and ...
13
votes
2answers
835 views

Rocket attacks dataset in Israel and State of Palestine

I'm looking for a dataset listing the rocket attacks in Israel and the State of Palestine with as many following fields as possible: timestamp GPS number of casualties reason for attack (e.g. a ...
13
votes
1answer
2k views

Speech audio databases with phonemes labelled

Can anyone point me to opensource databases of speech audio with phonemes labelled, .wav or the like + label files, e.g. # time, phoneme 0.31200 ao 0.41200 th 0.54200 er ... I'd prefer English, ...
10
votes
3answers
690 views

List of all restaurants in a city (EU)?

Is there an open database where I can get the list of all restaurants (or bakeries, etc) for a given city ? Since I'd need theses places so as to be able to put them on a map, like Google maps, i ...
10
votes
4answers
4k views

Corpus of tagged text (English newspapers or any tagged text)

I'm developing a system to extract tags from text (English) and currently I have no dataset to test the system and evaluate, could someone point me to a source (preferably a free one) thanks. NOTE: By ...
9
votes
2answers
283 views

How to make a successful FOIA request?

There are several questions regarding making a US "Freedom of Information Act" reqest (FOIA) for data: What is the best way to request machine readable data from a FOIA request? - (this question and ...
8
votes
3answers
954 views

Where can I get the images data set of skin diseases?

I want to search on images of skin diseases corpus. I need this dataset to index images in my search engine. Please suggest me how and from where i can get those images.
4
votes
1answer
654 views

Green Button energy data

The Green Button Data program in the US allows energy consumers to easily download their consumption data in a standard XML format. With that exported file, they can upload to a 3rd party site or app, ...
11
votes
7answers
5k views

Large French dataset for NLP (not formal, rather discussions/reviews)

What am I looking for ? I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias). Why this ...
11
votes
5answers
487 views

Standards for self-documenting text files?

One of the advantages of most scientific file formats is that you have a block of attached metadata that tells a reader how to read / interpret the file (what the fields are, for the most part -- how ...

15 30 50 per page