15 votes

A database of open databases?

As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan. The ...
Rémi Mercier's user avatar
8 votes

Is there a specification for versioning a dataset?

Dataverse uses the following dataset versioning strategy:
Franck Dernoncourt's user avatar
5 votes
Accepted

Will open data foster a common set of "metadata" standards?

Our hope with the Frictionless Data project is to create a set of standards that apply equally to open and non-open datasets. These standards did, in fact, grow out of experience with distributing ...
Dan Fowler's user avatar
4 votes

ISO 3166-1 and ISO 3166-2 data plus borders (e.g. as kml)

I just created a GitHub repo with a world shapefile of ISO 3166-1 entities, based on Natural Earth 1:10m Cultural Vectors. https://github.com/sdesabbata/world_shapefile_ISO3166-1 The repo includes ...
Stefano's user avatar
  • 41
4 votes

Countries with a Census

Most countries of the world have a Department of Statistics where they compile Census data. The various world census datasets, like CIA WFB, UN statistics, and Worldbank get their information from ...
Andrew - OpenGeoCode's user avatar
4 votes

How do I get my data indexed by Google Dataset Search?

You may want to stop and ask why you should want to be indexed there. Dataset Search seems like a poorly planned effort to try and corner dataset search. Why the push isn't for open linked datasets/...
3 votes
Accepted

Understanding Precipitation data

This seems to be the same data mentioned at http://shallowsky.com/blog/programming/NOAA-weather.html . In their write up, they also link to NOAA's documentation for the document. Note that this is ...
Joe's user avatar
  • 4,445
3 votes

Is there a site that has comprehensive list of data, along with descriptions, meta data etc?

No. Though there's various parties trying to build or assemble such a collection, I've found the external links from this wikipedia page to be quite a good start: https://en.wikipedia.org/wiki/...
Swier's user avatar
  • 1,453
3 votes
Accepted

NEISS injury dataset - machine readable coding for characterizations

Based on the PDF manual, there is an R package on Github called Neiss that has an excel file with mapping between codes and text descriptions. Direct link: https://github.com/hadley/neiss/blob/master/...
philshem's user avatar
  • 17.6k
3 votes

How to extract data from web files?

There is a good piece here: https://blog.datazar.com/mastering-the-art-of-data-preparation-fea2074232fa#.iblmav7eq that goes over all components of data preperation. There is a specific portion of it ...
Brian Back's user avatar
3 votes

A database of open databases?

I didn't see these mentioned. Rockstar Data Sources on Github. List of free and open journals. Mostly scientific journals.
Bulrush's user avatar
  • 667
3 votes

Publishing Weather Data under Creative Commons / Peer Production License

try contacting the open science data cloud; at the bottom of this link is a contact email regarding submissions: https://www.opensciencedatacloud.org/publicdata/ you also can get free hosting for ...
albert's user avatar
  • 11.8k
3 votes

ISO 3166-2 codes to Olson Time Zone Codes

You can create an ISO 3166-2 and time zone list using the Geonames API. If you use the general search API, you can pass a wildcard in for the name and specify the feature code and feature class ...
fdonnelly's user avatar
  • 1,120
3 votes

Metadata standards and best practices for data dictionaries for CSV files/data

It looks like Jeni Tennison took her Linked CSV spec to the W3C, and with some help from Gregg Kellogg and Ivan Herman it evolved into the Model for Tabular Data and Metadata on the Web and the ...
Christian Pietsch's user avatar
3 votes

Metadata standards and best practices for data dictionaries for CSV files/data

The Data Documentation Initiative provides the DDI metadata standard for describing data dictionaries. http://www.ddialliance.org/ https://en.wikipedia.org/wiki/Data_Documentation_Initiative The DDI ...
Dan's user avatar
  • 131
3 votes

A database of open databases?

Google Dataset Search https://toolbox.google.com/datasetsearch A recent tool in beta. Blogpost FAQ Guidelines for developers (get your data indexed)
Andrey Portnoy's user avatar
3 votes
Accepted

is there a dataset of financial blogs?

Answers to this question are easily found with a search engine. For example, A list of 789 financial blogs: Top Personal Finance Blogs There is no export, but the 7 pages of HTML-tables are pretty ...
philshem's user avatar
  • 17.6k
3 votes

is there a dataset of financial blogs?

Here's another list that's updated more frequently and has slightly different metrics, should also be easy to parse (minus the pagination): http://www.investmentzen.com/top-personal-finance-blogs
Han's user avatar
  • 131
3 votes

The list of restricted second-level domains such as .co.uk and .ac.jp

This "restricted domain" is known an effective top-level domain (eTLD)", or a suffix. By Mozilla: "A "public suffix" is one under which Internet users can (or historically could) directly register ...
Anton Tarasenko's user avatar
3 votes

Data for all lakes on Earth?

Wikidata knows of about 240,000 lake. Here's a query that will give you the first 1000. #List of all the lakes SELECT ?itemLabel ?coord WHERE { ?item (wdt:P31/wdt:P279*) wd:Q23397. OPTIONAL { ?...
fgregg's user avatar
  • 5,098
2 votes

Where can I find an ontology for “project”?

A list of ontologies used in Linked Open Data using project can be found here https://lov.linkeddata.es/dataset/lov/terms?q=project
Ghislain AT's user avatar
2 votes

How can I track updates on the release of new open data sources across the world?

Check out http://databullet.in. It's operated by Knoema/The World Bank but aggregates data releases as they occur from about two dozen different sources. Also, I would recommend Quartz's Atlas for ...
Carl V. Lewis's user avatar
2 votes

ISO 3166-2 codes to Olson Time Zone Codes

As to shapefiles, have a look at: http://efele.net/maps/tz/world/ https://github.com/evansiroky/timezone-boundary-builder But probably you need just this: $ awk '!/#/ {print $1,$3}' /usr/share/...
Stanislav Kralin's user avatar
2 votes
Accepted

Crosswalk for State Crime Statutes

The reference librarians at a local law library were very helpful: Alaska criminal statute cross-reference guide California Law Enforcement Code Tables: see Offense Codes by Code Section Illinois ...
fgregg's user avatar
  • 5,098
2 votes

Does anyone know a dataset that has both time-series data and descriptive (non-temporal) features?

What you are looking for is a time series with descriptive metadata. Metadata, in this sense, would be the non-time series values that are never or seldom changing. For example, the metadata for a ...
philshem's user avatar
  • 17.6k
2 votes
Accepted

Is there a way to ask a CKAN repository only for changed datasets after a certain time?

Do not use the REST API, it's old and deprecated. Use the Action API. You can get the results you need using the package_search action, eg for datasets modified since 1st August 2026: http://demo....
amercader's user avatar
  • 568
2 votes
Accepted

Graph representation of NUTS-3 regions to determine adjacency

Based on the NUTS-3 Boundaries in Eurostat and some GeoTools code I generated this list for you. Where the first column is the NUTS_ID of the zone and the list in [] is the list of neighbours, which ...
Ian Turton's user avatar
2 votes
Accepted

Get metadata from all datasets on Socrata

Approach #1 is doable, but not necessary. We'll go with approach #2 here: Download metadata provided by Socrata. The Open Data Network has an official API that you can use to query the various ...
DGinzberg's user avatar
  • 326
2 votes

What is the value of standardized metadata (e.g. OAI-PMH, LOM, Dublin Core) in the days of search engines?

Meta-data is more important than ever. Google and other search engines created their own meta-data and vocabularies over at http://Schema.org. Google would for example not be able to show you runs ...
Grimaldi's user avatar
  • 488

Only top scored, non community-wiki answers of a minimum length are eligible