15
votes
A database of open databases?
As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan.
The ...
- 151
8
votes
Is there a specification for versioning a dataset?
Dataverse uses the following dataset versioning strategy:
- 7,740
5
votes
Accepted
Will open data foster a common set of "metadata" standards?
Our hope with the Frictionless Data project is to create a set of standards that apply equally to open and non-open datasets. These standards did, in fact, grow out of experience with distributing ...
- 699
4
votes
ISO 3166-1 and ISO 3166-2 data plus borders (e.g. as kml)
I just created a GitHub repo with a world shapefile of ISO 3166-1 entities, based on Natural Earth 1:10m Cultural Vectors.
https://github.com/sdesabbata/world_shapefile_ISO3166-1
The repo includes ...
- 41
4
votes
Countries with a Census
Most countries of the world have a Department of Statistics where they compile Census data. The various world census datasets, like CIA WFB, UN statistics, and Worldbank get their information from ...
- 8,647
4
votes
How do I get my data indexed by Google Dataset Search?
You may want to stop and ask why you should want to be indexed there.
Dataset Search seems like a poorly planned effort to try and corner dataset search. Why the push isn't for open linked datasets/...
3
votes
Accepted
Understanding Precipitation data
This seems to be the same data mentioned at http://shallowsky.com/blog/programming/NOAA-weather.html .
In their write up, they also link to NOAA's documentation for the document.
Note that this is ...
- 4,445
3
votes
Is there a site that has comprehensive list of data, along with descriptions, meta data etc?
No. Though there's various parties trying to build or assemble such a collection, I've found the external links from this wikipedia page to be quite a good start:
https://en.wikipedia.org/wiki/...
- 1,453
3
votes
Accepted
NEISS injury dataset - machine readable coding for characterizations
Based on the PDF manual, there is an R package on Github called Neiss that has an excel file with mapping between codes and text descriptions.
Direct link: https://github.com/hadley/neiss/blob/master/...
- 17.6k
3
votes
How to extract data from web files?
There is a good piece here: https://blog.datazar.com/mastering-the-art-of-data-preparation-fea2074232fa#.iblmav7eq that goes over all components of data preperation. There is a specific portion of it ...
- 291
3
votes
A database of open databases?
I didn't see these mentioned.
Rockstar Data Sources on Github.
List of free and open journals. Mostly scientific journals.
- 667
3
votes
Publishing Weather Data under Creative Commons / Peer Production License
try contacting the open science data cloud; at the bottom of this link is a contact email regarding submissions:
https://www.opensciencedatacloud.org/publicdata/
you also can get free hosting for ...
- 11.8k
3
votes
ISO 3166-2 codes to Olson Time Zone Codes
You can create an ISO 3166-2 and time zone list using the Geonames API. If you use the general search API, you can pass a wildcard in for the name and specify the feature code and feature class ...
- 1,120
3
votes
Metadata standards and best practices for data dictionaries for CSV files/data
It looks like Jeni Tennison took her Linked CSV spec to the W3C, and with some help from Gregg Kellogg and Ivan Herman it evolved into the Model for Tabular Data and Metadata on the Web and the ...
3
votes
Metadata standards and best practices for data dictionaries for CSV files/data
The Data Documentation Initiative provides the DDI metadata standard for describing data dictionaries.
http://www.ddialliance.org/
https://en.wikipedia.org/wiki/Data_Documentation_Initiative
The DDI ...
- 131
3
votes
A database of open databases?
Google Dataset Search
https://toolbox.google.com/datasetsearch
A recent tool in beta.
Blogpost
FAQ
Guidelines for developers (get your data indexed)
- 131
3
votes
Accepted
is there a dataset of financial blogs?
Answers to this question are easily found with a search engine. For example,
A list of 789 financial blogs:
Top Personal Finance Blogs
There is no export, but the 7 pages of HTML-tables are pretty ...
- 17.6k
3
votes
is there a dataset of financial blogs?
Here's another list that's updated more frequently and has slightly different metrics, should also be easy to parse (minus the pagination):
http://www.investmentzen.com/top-personal-finance-blogs
- 131
3
votes
The list of restricted second-level domains such as .co.uk and .ac.jp
This "restricted domain" is known an effective top-level domain (eTLD)", or a suffix. By Mozilla:
"A "public suffix" is one under which Internet users can (or historically could) directly register ...
- 3,641
3
votes
Data for all lakes on Earth?
Wikidata knows of about 240,000 lake. Here's a query that will give you the first 1000.
#List of all the lakes
SELECT ?itemLabel ?coord WHERE {
?item (wdt:P31/wdt:P279*) wd:Q23397.
OPTIONAL { ?...
- 5,098
2
votes
Where can I find an ontology for “project”?
A list of ontologies used in Linked Open Data using project can be found here https://lov.linkeddata.es/dataset/lov/terms?q=project
- 21
2
votes
How can I track updates on the release of new open data sources across the world?
Check out http://databullet.in. It's operated by Knoema/The World Bank but aggregates data releases as they occur from about two dozen different sources.
Also, I would recommend Quartz's Atlas for ...
- 579
2
votes
ISO 3166-2 codes to Olson Time Zone Codes
As to shapefiles, have a look at:
http://efele.net/maps/tz/world/
https://github.com/evansiroky/timezone-boundary-builder
But probably you need just this:
$ awk '!/#/ {print $1,$3}' /usr/share/...
- 2,955
2
votes
Accepted
Crosswalk for State Crime Statutes
The reference librarians at a local law library were very helpful:
Alaska criminal statute cross-reference guide
California Law Enforcement Code Tables: see Offense Codes by Code Section
Illinois ...
- 5,098
2
votes
Does anyone know a dataset that has both time-series data and descriptive (non-temporal) features?
What you are looking for is a time series with descriptive metadata. Metadata, in this sense, would be the non-time series values that are never or seldom changing.
For example, the metadata for a ...
- 17.6k
2
votes
Accepted
Is there a way to ask a CKAN repository only for changed datasets after a certain time?
Do not use the REST API, it's old and deprecated. Use the Action API.
You can get the results you need using the package_search action, eg for datasets modified since 1st August 2026:
http://demo....
- 568
2
votes
Accepted
Graph representation of NUTS-3 regions to determine adjacency
Based on the NUTS-3 Boundaries in Eurostat and some GeoTools code I generated this list for you. Where the first column is the NUTS_ID of the zone and the list in [] is the list of neighbours, which ...
- 771
2
votes
Accepted
Get metadata from all datasets on Socrata
Approach #1 is doable, but not necessary. We'll go with approach #2 here: Download metadata provided by Socrata.
The Open Data Network has an official API that you can use to query the various ...
- 326
2
votes
What is the value of standardized metadata (e.g. OAI-PMH, LOM, Dublin Core) in the days of search engines?
Meta-data is more important than ever.
Google and other search engines created their own meta-data and vocabularies over at http://Schema.org.
Google would for example not be able to show you runs ...
- 488
Only top scored, non community-wiki answers of a minimum length are eligible