15
As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan.
The story behind it:
Working for a SaaS company in need of loads of structured data, our team started to compile a list of all open data portals around the world as ...
9
Our open-date site has links to about 600 useful datasets from US and Canadian government and a handful from the UN. The US federal government datasets are sorted by department.
http://www.opengeocode.org/cude1.1/index.php
We [opengeocode.org] maintain a catalog of open data portals across the world. We've categorized them under the categories:
Data ...
8
There are some great resources here. I would like to add http://knoema.com to this list.
They are possibly the most comprehensive and constantly updating resource. All their data is free to use and links back to source. Plus the data exploration tools and search engine is pretty useful.
Their dataset explorer is here: http://knoema.com/data
I found that ...
8
databib.org
re3data.org
recently merged: Registry of Research Data Repositories i.e. RE3
"The consolidated registry contains information for more than 1,130 data repositories that are accessed by over 5,000 unique visitors each month. On average, 10 new repositories are added every week."
"A new REST-API is currently being beta tested that provides the ...
8
Dataverse uses the following dataset versioning strategy:
7
Another system of interest for your list would be the OKFN Global Open Data Index:
https://index.okfn.org/place/
It provides national and sub-national catalog listings and categorization for a variety of data types, and an assessment of how open each country is. Similar to DataPortals.org, and run by the same people.
7
First Caveat, I am a co-founder of opengeocode.org
We have a few resources that might help you:
Catalog of Open Data sites around the world
Specification for open data vocabulary
Detailed specification on representing open data
Papers related to Open Data
6
The New General Service List (updated just a few weeks ago) is a list of "the most important words for second language learners of English".
It ranks the top three thousand headwords (plus more words within each headword, such as plurals and tenses).
So it won't cover all the words in your list, and it's really indicating "usefullness" rather than ...
5
Open Data Barometer recently published this:
http://www.opendatabarometer.org/report/analysis/impact.html
also, the open data working group under the Open Government Partnership will be looking at impact:
http://www.opengovpartnership.org/groups/opendata/
5
The UCI Machine Learning Repository provides databases mostly aimed at machine learning researchers.
Amazon Public Data Sets lists all public data sets that can be seamlessly integrated into AWS cloud-based application (currently 55 data sets are available).
French government data: http://www.data.gouv.fr/
Also, this Quora thread lists quite a few others.
5
The National Information Exchange Model (NIEM) is an XML-based system for defining "data in motion" (i.e., an on-the-wire format.) What distinguishes NIEM is 2 things: it is for standardizing the semantics of the exchange, not just the syntax; and it as much a process model as it is a technical model. That is, it (the NIEM organization) has developed a ...
5
Please refer the link https://www.udacity.com/wiki/ml/resources
In the above given link there is a link which points to many sites where you can pull the data from open database.
5
datahub.io looks like a good way to find sources for open data.
It is based on CKAN:
CKAN is a powerful data management system that makes data accessible –
by providing tools to streamline publishing, sharing, finding and
using data. CKAN is aimed at data publishers (national and regional
governments, companies and organizations) wanting to make ...
5
Our hope with the Frictionless Data project is to create a set of standards that apply equally to open and non-open datasets. These standards did, in fact, grow out of experience with distributing open data.
Check out the Data Package spec here: http://specs.frictionlessdata.io/data-packages/
4
I've compiled an index/catalog of government open data portals around the world. So far, there are over 700 sites in the catalog. I've setup the catalog for crowdsourcing, so feel free to send us your suggested portals to add to the catalog.
http://www.opengeocode.org/opendata/
You can download the index as a CSV file as well:
http://www.opengeocode.org/...
4
I have recently started using the Linked CSV proposed standard for generating CSV files from plural data sources. Below is a vocabulary definition for the columns/data types I am using. Perhaps others will find this useful/interesting approach:
http://www.opengeocode.org/cude1.1/LinkedCSV-Vocab.php
Update: the above link throws a 404, however it is ...
4
Here is a list of US portals that is slightly more up to date than datacatalogs.org, if one is missing, submit a pull request (but also notify datacatalogs.org!) https://github.com/sunlightpolicy/opendata/blob/master/USlocalopendataportals.csv
A list of portals, by vendor: https://github.com/tlevine/openprism/blob/gh-pages/src/index.js
Chicago's 'Hidden Open ...
4
Yes there is- I was part of a small review with Code for America folks of the McKinsey report looking at global value of open data- it's now published here: Open data: Unlocking innovation and performance with liquid information
4
You are looking for SIC codes (e.g., Used by Bureau of Labor) and NAICS codes (e.g., Used by US Census). The NAICS is gradually replacing the older SIC system. It is updated every 5 years and is developed/maintenance in conjunction with Canada and Mexico (hence the name North American Industry Classification Standard). One good place to start is at this US ...
4
ArcGIS Open Data would be another good way to find (mostly) spatial data sources. It exposes data from users who are using ArcGIS Server or ArcGIS Online to manage their data. You can see data about individual open data sites by looking at opendata.arcgis.com/explore.json
4
DOAP - Description of a Project. still alive, now on github
https://github.com/edumbill/doap/wiki
4
The best place to start looking is Linked Open Vocabularies. As of February 2015 they have indexed more than 450 vocabularies and ontologies and provide a convenient search feature.
4
I've started to collect a list of world (country, cities, etc.) datasets, guides, etc. in the Awesome World List @ Planet Open Data. For example, the GeoNames, Natural Earth, etc. datasets might be some candidates. Cheers.
Natural Earth Data
http://www.naturalearthdata.com/
you can download shapefiles here, not kml
4
I just created a GitHub repo with a world shapefile of ISO 3166-1 entities, based on Natural Earth 1:10m Cultural Vectors.
https://github.com/sdesabbata/world_shapefile_ISO3166-1
The repo includes ready to use shapefiles, original data and script. Please note that there are a few ISO 3166-1 entities that still need fixing (see issue 1).
4
R, the open source and cross-platform statistics software has something similar where sometimes packages/plugins for R include sample or test data:
See this SO question: https://stackoverflow.com/questions/12391195/include-data-examples-in-developing-r-packages
and this info page: http://r-pkgs.had.co.nz/data.html
OKFN (the same folks behind CKAN) has ...
4
Most countries of the world have a Department of Statistics where they compile Census data. The various world census datasets, like CIA WFB, UN statistics, and Worldbank get their information from these countries.
CIA WFB: https://www.cia.gov/library/publications/the-world-factbook/fields/2119.html
UNSTATS: http://unstats.un.org/unsd/demographic/products/...
4
You may want to stop and ask why you should want to be indexed there.
Dataset Search seems like a poorly planned effort to try and corner dataset search. Why the push isn't for open linked datasets/integration with search reveals many details. Performing a search doesn't even tell you how many results there are.
EDIT 2019-05-24:
Reddit AMA - Chris ...
3
The World Bank: Data
Open Government (US)
Open Data Communities (UK)
San Francisco Data
3
You already listed a bunch. There's also
Philadelphia's Open Data Pipeline
Whitehouse Scorecard
3
There's Data.gov for U.S. federal government open data, and Datahub for international open data, as a start.
Only top voted, non community-wiki answers of a minimum length are eligible