All Questions

Filter by
Sorted by
Tagged with
15
votes
2answers
108 views

Is there a list of all municipal government forms in a machine readable format?

I've found a list of government forms at the US federal level by looking at the OIRA PRA Information Collections XML file. Is there a list of similar forms at the state/local level for the US?
15
votes
3answers
698 views

What are the available tools for managing crowdsourced data-cleaning tasks?

The Zooniverse team has had amazing success with the OldWeather project to crowdsource coding of old ships logs to extract climate data. And I believe Sunlight did some crowdsourcing (with Mechanical ...
14
votes
7answers
7k views

What is the most comprehensive resource for querying french and english books having an ISBN code?

I would like to know if a repository of all known ISBN exists; either a worldwide database, or per country. If there is no such downloadable database, among all the available API's for querying ...
14
votes
7answers
954 views

Should data APIs require registration and API keys?

When publishing a data API, there seems to be a conflict between requiring a user to sign-up for an API key and the principal of open access. What is best practice in publishing an open data API ...
14
votes
12answers
485 views

Where can I find a repository of open data stories?

Stories that highlight the impact of open data and connect data to the individual. They can be small and regional.
14
votes
5answers
310 views

How can I get a list of all non-geodata datasets on Data.gov?

Data.gov has a lot of datasets, and a super-majority of them are mapping. Is there a way to generate a list of all datasets other than geodata?
14
votes
7answers
12k views

Dataset of major newspapers content

I'm looking for the materials of major newspapers, such as The New York Times, Washington Post, and The Economist. A random sample of their articles or headlines would suffice, but each newspaper has ...
14
votes
3answers
2k views

Where can I get bulk access to IRS 990 filings for US non-profits

There's another question about a list of all nonprofits, and this answer is kind of buried in the answers to that one. Also, this question came up today on the NICAR-L mailing list. It's a common ...
14
votes
4answers
8k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
14
votes
2answers
4k views

What are some OpenData torrents to seed?

BitTorrent can be an efficient way to "host" a large data set that are static. Also, BitTorrent is a good mechanism distribute a large data set as part of a open data project without funding or ...
14
votes
3answers
5k views

Database of English words pronunciation

Is there any downloadable open database of English words pronunciation in audio format?
14
votes
4answers
3k views

USA 2016 election demographic data

I am looking for demographic data (age, income, race, location) for individuals who voted in the 2016 US presidential election. The resolution that I am looking for can be at the state, county, or ...
14
votes
4answers
376 views

How do I share Open Data with others on this SE site?

I have some data which is Open(free from copyright, patents or other control mechanisms) and I want to share it with the users here. How do I do it without having to host it on some other server and ...
14
votes
3answers
2k views

Where can I find a dataset of songs labeled with their genre, BPM and key?

I am mostly interested in electronic songs. I need both the songs' waveform and their labels (genre, BPM and key). If you know some similar data set that doesn't contain all 3 labels, please still ...
14
votes
4answers
692 views

Cost of ownership - CKAN for city/local government or small federal agency

What is average cost/effort to launch CKAN instance and what are operational expenses to maintain it going forward? (Assuming small size government with limited IT resources)
14
votes
2answers
275 views

Is the data used to calculate national CPI public?

What data is used to calculate the CPI (Consumer Price Index) and if it is open, where can I find it?
14
votes
4answers
501 views

Do you know any open/standard resume format?

I would like to know if there is any kind open/standard resume or Curriculum Viate format which allows interchanging of resumes between systems. Any hint?
14
votes
2answers
192 views

Can you use data if no data license is explicitly stated?

There are quite some datasets out there that simply doesn't contain an explicit license (e.g. CC-BY). At best a one-line statement is given that the data is "open data". Can I simply state that when ...
14
votes
4answers
6k views

How does one parse weather data?

Weather data is often cited as a "huge success" for the open data community. Where does this data sit, and how does one parse the data into something readable, like the 5 day forecast?
14
votes
2answers
6k views

Total screen time and first on-screen appearance by actors in films

I'm looking for a data set that contains total screen time and first on-screen appearance (mm:ss) by actors and actresses in Hollywood films. I'm most interested in these data points for actors and ...
14
votes
4answers
451 views

Releasing old historical/genealogical datasets as open data

I work with a a couple of small non-profit genealogical and historical groups and we are interested in releasing some of the datasets we've compiled over the years as open data. This information is ...
14
votes
3answers
250 views

Preservation of blog posts, articles and essays

I am curious if there is there any good way to guarantee that my articles (posted on personal sites and other blogs) will last? Is there a reliable repository for articles, post and essays? Or are ...
14
votes
1answer
2k views

Speech audio databases with phonemes labelled

Can anyone point me to opensource databases of speech audio with phonemes labelled, .wav or the like + label files, e.g. # time, phoneme 0.31200 ao 0.41200 th 0.54200 er ... I'd prefer English, ...
13
votes
4answers
7k views

Airport / airline data from all over the world

Where can I get a database with airports and possible with (available / closed) runways from all over the world? I am looking for airlines and contact info of managers in decision-making positions at ...
13
votes
7answers
2k views

Is there a free downloadable administrative division database of Germany?

Is there downloadable and freely available database with administrative units of Germany (lands, cities, and if available, streets with zip codes)? In many countries such databases are provided ...
13
votes
3answers
3k views

What does OpenRefine offer that other data-parsing tools don't?

I see OpenRefine mentioned a lot here, but I don't see it doing much that R and others can't. What capabilities does it offer that I'm not seeing in the promo page that R or other data packages ...
13
votes
5answers
364 views

How to publish open data on my website? (Or: from CSV to RDFa)

I already spent some time importing data in a tabular form from a PDF published by an official institution. I would like to publish this table on my website. The data is nicely formatted in CSV. Is ...
13
votes
6answers
2k views

Raw data from US Census and BLS

Is the raw data of US Census or BLS available? By raw I mean the datapoints that later comprise the summary tables. For instance, the average employment by firm size. Apart from means that you can ...
13
votes
3answers
3k views

Dataset of personal names

I'm looking for a dataset of personal names containing for each name as many following labels as possible: first name(s) middle name if any last name(s) nationality country of residence country of ...
13
votes
5answers
4k views

What is the difference between US Census definitions of “Urbanized Areas” and “Urban Clusters”?

I am trying to classify US Census tracts as urban, suburban, or rural. The Census Bureau provides a table with counts of people, and classifies them as either urban: urbanized area, urban: urban ...
13
votes
4answers
238 views

COVID-19 Clinical Data or Statistics

Is there anywhere a database that includes case-level information on COVID-19 cases? Such data would typically include patient demographics and/or health information, location, time of onset/testing, ...
13
votes
3answers
1k views

How might I go about visualising historical temperature CSV data?

I've downloaded the Central England Temperature Data available from Met Office Hadley Centre. On their summary page, it is described thus (emphasis mine): These daily and monthly temperatures are ...
13
votes
2answers
3k views

Dump of WikiLeaks

Does a dump or scrape of WikiLeaks exist? I'm thinking of an equivalent to Wikipedia's database download: http://en.wikipedia.org/wiki/Wikipedia:Database_download So far, I haven't found direct ...
13
votes
2answers
15k views

Clickstream sample dataset

I am looking for some web traffic or clickstream dataset, ideally from an ecommerce website. I like to do some analysis on purchasing pattern if possible. For example: visit duration, conversion, ...
13
votes
2answers
3k views

How many software developers are there in the world, per country?

This question has been asked (and closed) in various forms across this network, ie: Stack Overflow: How many software developers are there in the world? Programmers: Where can I find ...
13
votes
2answers
850 views

Rocket attacks dataset in Israel and State of Palestine

I'm looking for a dataset listing the rocket attacks in Israel and the State of Palestine with as many following fields as possible: timestamp GPS number of casualties reason for attack (e.g. a ...
13
votes
1answer
2k views

How to construct a database with the underlying real estate data displayed by Redfin, Zillow, or Trulia?

Regardless of whether the home is for sale, if you type any street address into Zillow, Redfin, or Trulia, they will often tell you the square footage, the last-sold-date, the taxable value, and often ...
13
votes
1answer
94 views

What methods are used to prepare sensitive data for public access?

I am a policy researcher looking for the best technical methods to sanitize data so it can be uploaded to data portals. I am not working with a specific dataset but looking to gain an understanding of ...
13
votes
1answer
297 views

Resources to create CC0/ CC BY cartography?

Cartography and map-based mashups are often based on Google Maps/ Google Earth (all rights reserved) or Open StreetMap (ODbL/CC BY-SA), neither of which are compatible with publishing the results ...
13
votes
2answers
256 views

5-star Open Data rating scheme, are there URIs for the ratings?

I'm in the process of constructing a DCAT catalogue and we want to show how each dataset conforms to the 5-star open data rating scheme. I assumed that someone would have coined URIs for each rating ...
13
votes
3answers
2k views

Historical weather forecast compared to actual weather?

I am searching for a resource showing historical weather forecasts compared to actual weather data. I'm mainly interested in seeing how accurate various forecast services have been in the past, when ...
13
votes
1answer
215 views

Where can I find massive and high dimensional survival datasets

I am working on developing some high-dimensional survival analysis methods with R, but I do not know where to find such high-dimensional survival datasets. Could anyone tell me where to find such ...
12
votes
6answers
3k views

Dataset of domain names

There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
12
votes
4answers
2k views

What is the major difference between Open data and Linked data?

Although this is not an apple to apple comparison and there is significant overlap i would like to know examples or specific cases where a data set falls into either category but not both. Can data be ...
12
votes
3answers
3k views

Where could I find open data about ATM locations (in Paris)?

I'm thinking of building an application that shows you the nearest ATM machine, but I don't know where I can find open data about ATM locations (or if there even is such data available). I'm asking ...
12
votes
4answers
2k views

How and where can I get data on US census block data by city and state?

I am overwhelmed looking through dead ends on the US census website. Could someone that has solved this puzzle tell me where I can get the demographic and shapefile data? Race and income are my ...
12
votes
4answers
208 views

How should governments build community around their datasets?

The likes of data.gov.uk and data.gov are keen to build a community around their data. How should that best be done? The main aim is to create a feedback loop, encouraging use of the data and release ...
12
votes
4answers
4k views

Has any MOOC (Coursera, edX, Udacity or others) publicly released some of their student data?

I'm looking for educational datasets from MOOCs. PSLC DataShop contains some learning interaction data, but not from MOOCs. I'm especially interested in logs tracking students' activities such as ...
12
votes
2answers
6k views

Is there a tool to match zip codes to cities?

I have a data set with zipcodes and would like to do a bulk upload to a tool that will give me the cities each zip is in (US only.)
12
votes
4answers
8k views

Cost of living dataset

I'm trying to compare what the equivalent salary would be between two cities based upon the cost of living in each city. I want to be able to build something like CNN's cost of living calculator. ...

15 30 50 per page