Rufus Pollock
  • Member for 8 years, 8 months
  • Last seen more than 5 years ago
Is there a Git for data?
42 votes

Basic answer afaik is: "No". As a first point I'd say that "data" is very broad - much broader than if you said "code". There are all kinds of data in all kinds of different structures. Focusing ...

View answer
Metadata standards and best practices for data dictionaries for CSV files/data
Accepted answer
23 votes

I'd suggest using JSON Table Schema: https://specs.frictionlessdata.io/table-schema It's: JSON-based Super simple Extendable Here's a rough outline: # fields is an ordered list of field ...

View answer
Does there exist an authorative definition of an open dataset?
Accepted answer
14 votes

Yes, there is: the Open Definition defines openness for data (and content). The Definition was produced in 2005, heavily based on the Open Source Definition, and revised minimally since. The key part ...

View answer
Wikipedia table to JSON (or other machine-readable format)
12 votes

You can use Google Spreadsheets ImportHTML formula as detailed in this Liberating HTML Tables (using Google Spreadsheet) tutorial on School of Data by Tony Hirst - it includes a specific walk-through ...

View answer
Extracting tables from multiple PDFs
10 votes

There's discussion of exactly this in this question on School of Data Q&A site. Among other items mentioned there are (all free/open source): http://coolwanglu.github.io/pdf2htmlEX/ - open-...

View answer
Database of ships?
Accepted answer
9 votes

From this answer on Get the Data: http://getthedata.org/questions/262/list-of-ocean-going-oil-tankers-and-owner/ (provided by Kit Wallace). Note none of this detail seems to be open data (as per Open ...

View answer
Are there any good libraries available for doing normalization of company names?
6 votes

If you have (or want to create) a specific list you want to normalize against you may want to look at "Nomenklatura": http://nomenklatura.okfnlabs.org/ This allows you to upload your own ...

View answer
Releasing old historical/genealogical datasets as open data
5 votes

Publishing the Data If you don't want to go down the full CKAN-style route a really simple option if you've got a bunch of CSV files is just to put them online and turn them into "simple data format" ...

View answer
Are there any international non-governmental data aggregators?
5 votes

There's the IATI Registry which aggregates data related to Aid projects published as part of the IATI initiative. This is obviously rather narrow. There's also http://africaopendata.org/ which ...

View answer
Restrict search to open datasets on CKAN's Data Hub?
Accepted answer
5 votes

There is a simple answer thanks to the isopen parameter. Here's the query: http://datahub.io/api/3/action/package_search?q=isopen:true Note that q is basically the classic solr query paramemter so ...

View answer
Is there an open movie and/or music database available for commercial use?
4 votes

For movies, in addition to DBPedia or Freebase (which are both heavily wikipedia derived) there is also http://www.omdb.org/ (though it may be shutting down). See also http://datahub.io/dataset?q=...

View answer
Optimal Data Format(s) for Open GIS Data Repositories?
3 votes

I'd vote for geojson or geocsv in first instance followed by shapefiles and perhaps topojson if that optimization of geojson was important.

View answer