All Questions

Filter by
Sorted by
Tagged with
7
votes
2answers
724 views

MIMIC-III severity score

Is there any severity score in the MIMIC-III beyond SOFA? I've found many itemdid with APACHE IV label but I did not retrieve any information in the chartevents. Best
6
votes
0answers
263 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
4
votes
2answers
1k views

List of common foodstuffs/meals?

I'm looking for a open-source list of common foodstuffs/meals that I can use to populate a database for some R&D. Ideally I'd just like a long list of food/meal names (as if you were browsing ...
3
votes
1answer
340 views

Customer Support Interactions data?

I need to answer some of the following questions: What is the average amount of time taken to close a customer issue? What is the average length of chat for a particular segment of the complaint? (...
2
votes
1answer
50 views

Business Location Test Data

I'm working through a book that deals with MEAN applications... and in the book it deals with geo-spatial data and creates a Review for Businesses (Think: Yelp. Look for businesses close to a location ...
92
votes
21answers
12k views

Is there a Git for data?

I know you can put CSV or XML in Git already, but there are issues for those wishing to collaborate on a dataset for creation, cleaning it up, pull requests, etc. Are there alternative version control ...
85
votes
20answers
144k views

How can I work with a 4GB csv file?

What's the best way to access a 4GB csv file? I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here http://nppes.viva-it.com/NPI_Files.html Specifically, ...
35
votes
11answers
28k views

Good tools to parse repetitive unstructured data

I'm looking to parse a large number of lines of repetitive but unstructured data. This is a task that happens at least once every project, in my experience, so I'm looking for a tool to transform ...
24
votes
7answers
7k views

How can I download the complete Wikidata database?

Wikidata is a new Wikimedia project: It centralizes access to and management of structured data, such as interwiki references and statistical information. This data would be of enormous interest ...
25
votes
8answers
2k views

Tools for merging similar datasets continuously

How do I merge similar datasets, not just once but on an ongoing basis? This seems like a reasonably common problem so I'd be interested if there is a tool out there aimed at this problem, as a guided ...
25
votes
12answers
3k views

Metadata standards and best practices for data dictionaries for CSV files/data

We publish most of our machine-readable open data in CSV format. What are best practices and/or standards to publish data dictionaries (e.g. definitions of columns in CSV files including human-...
25
votes
7answers
2k views

Extracting tables from multiple PDFs

What's the best practice of extracting tables from a large number of PDF, which may be formatted differently? For example, I have a series of PDFs like this one, and I would like to extract the ...
17
votes
2answers
22k views

Is there an open database of elementary, middle, and high schools in the United States?

Is there an up-to-date and regularly maintained open database of elementary, middle, and high schools in the United States? I'm looking for both public and private schools. Names alone would be a ...
11
votes
4answers
3k views

Has any MOOC (Coursera, edX, Udacity or others) publicly released some of their student data?

I'm looking for educational datasets from MOOCs. PSLC DataShop contains some learning interaction data, but not from MOOCs. I'm especially interested in logs tracking students' activities such as ...
15
votes
8answers
6k views

Is there an open movie and/or music database available for commercial use?

I would like to know if there is an open database for movies that could have the same amount and quality of data as IMDB. I would like it for commercial use, and free if possible. Same for music, I ...
10
votes
2answers
2k views

Catalog.data.gov using CKAN API with python requests package

I'm not sure if this is a requests issue, a CKAN API issue, or a catalog.data.gov issue. I can do this GET query: import requests import json r = requests.get('http://catalog.data.gov/api/search/...
19
votes
8answers
7k views

Database with monthly climate/weather data by country

I am searching for a online database for climate data (especially temperature) for non-european countries on a monthly basis. 1990-2014 would be nice. Thank you!
14
votes
6answers
334 views

What is the best way to request machine readable data from a FOIA request?

Maybe there is no way to request a specific file type but what is the best way to request a file (paper or digital) that can be converted easiestly?
24
votes
5answers
4k views

How to normalize the data when mapping crime reports?

Most maps using count of reports of crime end up being maps of the population density of cities. An attractive response would be to turn these counts into a rate, but a rate per what? Most commonly, ...
16
votes
2answers
3k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...
11
votes
1answer
2k views

How to construct a database with the underlying real estate data displayed by Redfin, Zillow, or Trulia?

Regardless of whether the home is for sale, if you type any street address into Zillow, Redfin, or Trulia, they will often tell you the square footage, the last-sold-date, the taxable value, and often ...
9
votes
2answers
2k views

publicly available spam dataset of social networks

I am trying to create a naive bayes spam filter for social networks and i need a spam dataset (containing posts/tweets etc.) of popular social networks like twitter/facebook. Is there any publicly ...
7
votes
2answers
500 views

Examples of (near) real-time energy dashboards or portals

What are some examples of real-time or live data dashboards related to consumption, production or transmission of energy?
20
votes
8answers
657 views

How can I trust the authenticity of an open data source?

If some site claims to offer a definitive data source, how can I trust that it is not purposely biased? Even excluding elaborate conspiracies, how could I know that it isn't just a big hoax? It ...
17
votes
4answers
906 views

What are the practical limits of releasing open data via bit torrent?

I know that there are political issues (my place of work bans all peer-to-peer software without an explicit waiver), but how well does bit torrent scale for distributing large data collections where ...
13
votes
6answers
2k views

Raw data from US Census and BLS

Is the raw data of US Census or BLS available? By raw I mean the datapoints that later comprise the summary tables. For instance, the average employment by firm size. Apart from means that you can ...
12
votes
2answers
5k views

Is there a tool to match zip codes to cities?

I have a data set with zipcodes and would like to do a bulk upload to a tool that will give me the cities each zip is in (US only.)
11
votes
1answer
3k views

Database of English words difficulty

Data request I am looking for a database that describes the "difficulty" of each English word. Difficulty of a word is not easy to define, but it is probably a mix of: Level of study needed to ...
9
votes
3answers
741 views

Data sets for teaching

I'll be giving a (short) introductory course for Data Science within a couple of months. One of my ideas was, instead of giving lectures on theoretic aspects of it (which of course are important), ...
9
votes
3answers
3k views

Query medicine descriptions API

I am looking for publicly available API for querying medicine's descriptions. For example, if I supply Carbidopa/Levodopa or Sinemet the expected return data (in json or xml format) is a simple ...
8
votes
1answer
189 views

Word list with learning age

I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned. WordNet linkage is a big bonus.
3
votes
1answer
2k views

Structured movie/TV dataset

I am looking for a downloadable, always up to date and structured comprehensive dataset of movies and TV shows. I found this question and it does have some answers - DBPedia and Freebase, but they do ...
2
votes
1answer
1k views

Tagged (non-anonymized) GPS driver trip database

The AXA Kaggle challenge Driver Telematics Analysis provides a dataset of over 50,000 anonymized driver trips. Are there open databases of tagged, non-anonymized trips, with several trips for each ...
17
votes
5answers
12k views

Age, Weight and Height dataset

I am trying to get a dataset (preferable worldwide) that has the attributes (height, weight and age). The only decent dataset that I have been able to find was from here: https://stats.stackexchange....
16
votes
6answers
9k views

U.S. City and County Web Data (API)

Are there any websites that have basic City and County information for the U.S.?
16
votes
7answers
2k views

Is there a list, database or API that contains the URLs for United States city and town websites?

I'm looking for a database of URLs for every official city and town website. Ideally this list would be up to date and maintained. Freebase has some of the results and we have every city and town in ...
13
votes
2answers
824 views

Rocket attacks dataset in Israel and State of Palestine

I'm looking for a dataset listing the rocket attacks in Israel and the State of Palestine with as many following fields as possible: timestamp GPS number of casualties reason for attack (e.g. a ...
13
votes
4answers
328 views

How do I share Open Data with others on this SE site?

I have some data which is Open(free from copyright, patents or other control mechanisms) and I want to share it with the users here. How do I do it without having to host it on some other server and ...
12
votes
7answers
1k views

List of English words

I'm writing a program that requires a list of English words, such as that used by a spell checker. I have been unable to find any such word lists whatsoever, even after trying 2 search engines.
10
votes
3answers
629 views

List of all restaurants in a city (EU)?

Is there an open database where I can get the list of all restaurants (or bakeries, etc) for a given city ? Since I'd need theses places so as to be able to put them on a map, like Google maps, i ...
10
votes
4answers
4k views

Corpus of tagged text (English newspapers or any tagged text)

I'm developing a system to extract tags from text (English) and currently I have no dataset to test the system and evaluate, could someone point me to a source (preferably a free one) thanks. NOTE: By ...
9
votes
2answers
279 views

How to make a successful FOIA request?

There are several questions regarding making a US "Freedom of Information Act" reqest (FOIA) for data: What is the best way to request machine readable data from a FOIA request? - (this question and ...
8
votes
3answers
800 views

Where can I get the images data set of skin diseases?

I want to search on images of skin diseases corpus. I need this dataset to index images in my search engine. Please suggest me how and from where i can get those images.
7
votes
3answers
6k views

A dataset of resumes

This is a question I found on /r/datasets. Does OpenData have any answers to add? I'm looking for a large collection or resumes and preferably knowing whether they are employed or not. Does such a ...
11
votes
5answers
472 views

Standards for self-documenting text files?

One of the advantages of most scientific file formats is that you have a block of attached metadata that tells a reader how to read / interpret the file (what the fields are, for the most part -- how ...
10
votes
4answers
6k views

Cost of living dataset

I'm trying to compare what the equivalent salary would be between two cities based upon the cost of living in each city. I want to be able to build something like CNN's cost of living calculator. ...
10
votes
2answers
174 views

Government shutdown causing linked open data to go away

With the government shutdown now upon us, and many groups going to be performing an 'orderly shutdown' of their systems in a few hours... How can systems that rely on linked open data make sure that ...
9
votes
6answers
356 views

Are there any international non-governmental data aggregators?

We are probably all familiar with Manyeyes and google public data explorer but those are always based on governmental Statistics bureau or OECD data. Are there any projects to aggregate data that is ...
8
votes
1answer
3k views

FIFA 2014 tweets dataset for academic project

I am looking to run a Map Reduce framework and do some analysis on a Twitter dataset for the FIFA 2014 World Cup event. I couldn't find a place to get these datasets for free. Can someone suggest a ...
8
votes
2answers
3k views

What is the status of OKFN's Open Product Data project?

Open Product Data (also known as Product Open Data) is a project run by OKFN. Its main goal is to build a public database of product data. There are already several questions and answers related to ...

15 30 50 per page