5 votes
Accepted

Will open data foster a common set of "metadata" standards?

Our hope with the Frictionless Data project is to create a set of standards that apply equally to open and non-open datasets. These standards did, in fact, grow out of experience with distributing ...
Dan Fowler's user avatar
4 votes

ISO 3166-2 codes to Olson Time Zone Codes

You can create an ISO 3166-2 and time zone list using the Geonames API. If you use the general search API, you can pass a wildcard in for the name and specify the feature code and feature class ...
fdonnelly's user avatar
  • 1,130
4 votes

How do I get my data indexed by Google Dataset Search?

You may want to stop and ask why you should want to be indexed there. Dataset Search seems like a poorly planned effort to try and corner dataset search. Why the push isn't for open linked datasets/...
3 votes

A database of open databases?

I didn't see these mentioned. Rockstar Data Sources on Github. List of free and open journals. Mostly scientific journals.
Bulrush's user avatar
  • 667
3 votes

Data for all lakes on Earth?

Wikidata knows of about 240,000 lake. Here's a query that will give you the first 1000. #List of all the lakes SELECT ?itemLabel ?coord WHERE { ?item (wdt:P31/wdt:P279*) wd:Q23397. OPTIONAL { ?...
fgregg's user avatar
  • 5,108
3 votes

The list of restricted second-level domains such as .co.uk and .ac.jp

This "restricted domain" is known an effective top-level domain (eTLD)", or a suffix. By Mozilla: "A "public suffix" is one under which Internet users can (or historically could) directly register ...
Anton Tarasenko's user avatar
3 votes

is there a dataset of financial blogs?

Here's another list that's updated more frequently and has slightly different metrics, should also be easy to parse (minus the pagination): http://www.investmentzen.com/top-personal-finance-blogs
Han's user avatar
  • 131
3 votes
Accepted

is there a dataset of financial blogs?

Answers to this question are easily found with a search engine. For example, A list of 789 financial blogs: Top Personal Finance Blogs There is no export, but the 7 pages of HTML-tables are pretty ...
philshem's user avatar
  • 17.6k
3 votes

Is there a site that has comprehensive list of data, along with descriptions, meta data etc?

No. Though there's various parties trying to build or assemble such a collection, I've found the external links from this wikipedia page to be quite a good start: https://en.wikipedia.org/wiki/...
Swier's user avatar
  • 1,453
3 votes
Accepted

NEISS injury dataset - machine readable coding for characterizations

Based on the PDF manual, there is an R package on Github called Neiss that has an excel file with mapping between codes and text descriptions. Direct link: https://github.com/hadley/neiss/blob/master/...
philshem's user avatar
  • 17.6k
3 votes

How to extract data from web files?

There is a good piece here: https://blog.datazar.com/mastering-the-art-of-data-preparation-fea2074232fa#.iblmav7eq that goes over all components of data preperation. There is a specific portion of it ...
Brian Back's user avatar
3 votes

ISO 3166-2 codes to Olson Time Zone Codes

As to shapefiles, have a look at: http://efele.net/maps/tz/world/ https://github.com/evansiroky/timezone-boundary-builder But probably you need just this: $ awk '!/#/ {print $1,$3}' /usr/share/...
Stanislav Kralin's user avatar
3 votes

A database of open databases?

Google Dataset Search https://toolbox.google.com/datasetsearch A recent tool in beta. Blogpost FAQ Guidelines for developers (get your data indexed)
Andrey Portnoy's user avatar
2 votes

Where can I find an ontology for “project”?

A list of ontologies used in Linked Open Data using project can be found here https://lov.linkeddata.es/dataset/lov/terms?q=project
Ghislain AT's user avatar
2 votes

How can I track updates on the release of new open data sources across the world?

Check out http://databullet.in. It's operated by Knoema/The World Bank but aggregates data releases as they occur from about two dozen different sources. Also, I would recommend Quartz's Atlas for ...
Carl V. Lewis's user avatar
2 votes
Accepted

Crosswalk for State Crime Statutes

The reference librarians at a local law library were very helpful: Alaska criminal statute cross-reference guide California Law Enforcement Code Tables: see Offense Codes by Code Section Illinois ...
fgregg's user avatar
  • 5,108
2 votes
Accepted

Is there a way to ask a CKAN repository only for changed datasets after a certain time?

Do not use the REST API, it's old and deprecated. Use the Action API. You can get the results you need using the package_search action, eg for datasets modified since 1st August 2026: http://demo....
amercader's user avatar
  • 568
2 votes

What is the value of standardized metadata (e.g. OAI-PMH, LOM, Dublin Core) in the days of search engines?

Meta-data is more important than ever. Google and other search engines created their own meta-data and vocabularies over at http://Schema.org. Google would for example not be able to show you runs ...
Grimaldi's user avatar
  • 488
2 votes
Accepted

Get metadata from all datasets on Socrata

Approach #1 is doable, but not necessary. We'll go with approach #2 here: Download metadata provided by Socrata. The Open Data Network has an official API that you can use to query the various ...
DGinzberg's user avatar
  • 326
2 votes
Accepted

Graph representation of NUTS-3 regions to determine adjacency

Based on the NUTS-3 Boundaries in Eurostat and some GeoTools code I generated this list for you. Where the first column is the NUTS_ID of the zone and the list in [] is the list of neighbours, which ...
Ian Turton's user avatar
2 votes

Looking for taxonomy for skills databases?

Open Skills offers an API, though I'm not sure if the data matches your requirements: Open Skills Project
albert's user avatar
  • 11.9k
2 votes

Open data for software requirements

Libraries.io catalogs dependency relationships between open source projects and other project metadata for a set of supported package managers. There is an API here.
sboysel's user avatar
  • 1,214
2 votes

Where can I find a large unprocessed dataset?

Japanese Trade Stats This seems to satisfy your request. There are other data sets on that site if your find this particular one doesn’t.
James Risner's user avatar
1 vote

Where can I download non-malicious .EXE files for my machine learning model

You can search google by filetype, so if any of these filetypes are appropriate https://support.google.com/webmasters/answer/35287?hl=en You can use the filetype: operator in Google Search to ...
philshem's user avatar
  • 17.6k
1 vote

Which currencies are used in IMF's / Worldbank's PA.NUS.FCRF forex data?

On the page you have linked to, click "Details", then click "All metadata". Then create a report of this kind: http://databank.worldbank.org/data/LCU-in-2017/id/f7f1ba3.
Stanislav Kralin's user avatar
1 vote

Cannot access to the OSM Boundaries website

Please have a look at this thread. As well as I understand, the maintainer will shutdown this domain. One shoud use https://wambachers-osm.website/boundaries/ instead.
Stanislav Kralin's user avatar
1 vote

How to extract data from web files?

Can you be just a tad more specific - what files are you extracting data from? What format are they? Are they data file already or are they text/pdf documents? If you simply want to programmatically ...
P. M.'s user avatar
  • 41

Only top scored, non community-wiki answers of a minimum length are eligible