As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan.
The story behind it:
Working for a SaaS company in need of loads of structured data, our team started to compile a list of all open data portals around the world as ...
As you say, http://datahub.io is a particular instance powered by CKAN, so you can't really compare both. In terms of what is particular about datahub.io, it is a community centred and powered site where everybody should be able to host their data, rather than the more default scenario of one or more organizations publishing data on the portal.
It is in the ...
Our open-date site has links to about 600 useful datasets from US and Canadian government and a handful from the UN. The US federal government datasets are sorted by department.
We [opengeocode.org] maintain a catalog of open data portals across the world. We've categorized them under the categories:
There are some great resources here. I would like to add http://knoema.com to this list.
They are possibly the most comprehensive and constantly updating resource. All their data is free to use and links back to source. Plus the data exploration tools and search engine is pretty useful.
Their dataset explorer is here: http://knoema.com/data
I found that ...
recently merged: Registry of Research Data Repositories i.e. RE3
"The consolidated registry contains information for more than 1,130 data repositories that are accessed by over 5,000 unique visitors each month. On average, 10 new repositories are added every week."
"A new REST-API is currently being beta tested that provides the ...
Another system of interest for your list would be the OKFN Global Open Data Index:
It provides national and sub-national catalog listings and categorization for a variety of data types, and an assessment of how open each country is. Similar to DataPortals.org, and run by the same people.
In Scotland specifically, I would suggest that you have a look at:
Statistics.gov.scot - a very decent repository of publicly available data in Scotland, a lot of spatially aggregated.
NOMIS - spatially aggregated labour market data
UK Data Service - vast catalogue of research / survey data
Neigbhourhood Statistics - ONS product with neighbourhood ...
Try https://geovation.uk/data-sources/ for a pretty comprehensive list of links to sources with crime data, retail data, consumer data, transport data and government data.
You can also refer to this list to fill in the gaps on English Heritage data, environment data and Ordnance Survey data.
I hope this helps!
To add to amercader's answer, if you have some data to publish and are wondering whether to use datahub.io or your own CKAN instance, there are various considerations.
Using datahub.io is free and requires no setup, site hosting, etc.
With your own instance, you can have a data portal 'homed' at your own web address (e.g. data.myorganisation.org). You can ...
Open Data looks a bit like a jungle at first but you'll find tons of awesome data and tons of ideas to create stuff with it!
The first questions would be: are you searching some particuliar data or are you just curious? what do you want to do with those data?
Then I would say:
the first step is find some data near you. The OKFN runs a service called ...
The UCI Machine Learning Repository provides databases mostly aimed at machine learning researchers.
Amazon Public Data Sets lists all public data sets that can be seamlessly integrated into AWS cloud-based application (currently 55 data sets are available).
French government data: http://www.data.gouv.fr/
Also, this Quora thread lists quite a few others.
I've compiled an index/catalog of government open data portals around the world. So far, there are over 700 sites in the catalog. I've setup the catalog for crowdsourcing, so feel free to send us your suggested portals to add to the catalog.
You can download the index as a CSV file as well:
Here is a list of US portals that is slightly more up to date than datacatalogs.org, if one is missing, submit a pull request (but also notify datacatalogs.org!) https://github.com/sunlightpolicy/opendata/blob/master/USlocalopendataportals.csv
A list of portals, by vendor: https://github.com/tlevine/openprism/blob/gh-pages/src/index.js
Chicago's 'Hidden Open ...
A quick an easy way to provide open access to your scraped data would be pushing it to GitHub or another easily accessible online repo in a text format (CSV/TSV or JSON if it's less structured -- this would also allow you to add timestamps for when data was scraped) and update it automatically. Without an explicit license to publish the data it may not be ...
Well, here's one: http://www.theage.com.au/victoria/the-most-ignored-parking-sign-in-melbourne-20140512-zraek.html
Here's the background: http://www.theage.com.au/data-point/blogs/the-crunch--data-point/melbourne-parking--get-the-data-20140513-386wv.html
Summary: data journalists from The Age found data on the City of Melbourne's data portal, wrote a story ...
The UK has an open data portal: https://data.gov.uk/
London has one of the most comprehensive open data portals: http://data.london.gov.uk/
Additionally, you'll find regions and cities have their own open data portals: for example: http://open.manchester.gov.uk/
There is the uk tag on this site which brings up 25 questions. In particular, the Q&A ...
Enigma Public is a repository for data that host all the data in its raw form on its own servers which allows you to search within the data as well download it through a REST API. All data is available under creative commons licensing.
Google offers a couple more structured ways to search just on data sets beyond the main Google search function mentioned above:
1) A Googler on Twitter has suggested "try[ing] Google custom search (@googlecse) on pages that mention a http://schema.org/Dataset - http://datasets.schema-labs.appspot.com/" This search tool allows you to search for data sets ...
The Royal Economic Society has a list of data links:
The American Economic Association lists the Bank of England, HM Treasury, and National Statistics
In the ReplicationWiki (that I work on) you can see data sources used for publications in economic journals here
Some interesting UK sites with data not yet mentioned are:
The Health and Social Care Information Centre (soon to be renamed NHS Digital) which make a wide range of health-related data available on various terms. data can sometimes be hard to find but there is a lot there including vast quantities of data about England's NHS (e.g. everything prescribed by ...
Not sure of any specific Open Science initiative, but looking at the organizations on datahub.io, just in the first page of results, I see two or three academic organizations posting.
Also, search for science on datahub.io
The Open Knowledge Foundation has a registry of packaged datasets that are easier to use - Core Datasets as Data Packages.
The data is hosted on https://github.com/datasets and the registry can be found in core_list.txt.
Important, commonly-used datasets in high quality, easy-to-use & open form
High Quality & Reliable - Sourcing, normalizing ...
Here are a few examples of embedded data from open data portals in the USA:
http://news.yahoo.com/find-out-here-how-much-your-favorite-obama-aide-is-paid-211525283.html embeds data from open.whitehouse.gov
http://www.nationaljournal.com/tech/how-cispa-opponents-were-outspent-by-industry-lobbyists-38-to-1-20130422 embeds data from data.sunlightlabs.com, a ...
I can help. OpenSensors is a real-time service for publishing Open Data, partnered with the Open Data Institute, we are trying to make real-time Open Data access and publishing easy as possible enabling people to build cool stuff based upon it. All open data projects on OpenSensors.io are free to use, we only charge if you keep the data private.
Census has Metropolitan and Micropolitan Statistical Areas
as well as Combined Statistical Areas (CSA):
and CBSA (Core Based Statistical Areas):