15
votes
A database of open databases?
As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan.
The ...
- 151
7
votes
How can I reliably host and share large data sets?
I'm sorry to hear you had a frustrating time uploading to datahub.io and that the site wasn't clear enough about the size limit. Another datahub-like platform that we have worked with in the past is ...
- 699
7
votes
Accepted
How can I reliably host and share large data sets?
If you want quick, dirty, and free, you can always host downloadable datasets at the Internet Archive (archive.org). No pretty interface, but as much storage as you could ever want.
- 486
6
votes
Which format (CSV, JSON, Atom, RSS?) should events data be published in?
The format should fit the data structure not the need of the comsumer (or the one who uses the data).
If the data is semantically stored in a json structure you can easily export the data in ...
- 161
6
votes
What methods are used to prepare sensitive data for public access?
The first step as you said is to define which types of entities need to be removed in the public version of the data set. One example of such definition in the United States is given in the Health ...
- 7,740
5
votes
What are the most common ways that users find out about new data sets?
I've also found DataBullet.in and Enigma Public Data Explorer to be helpful.
Also, a recent social network called data.world has tons of interesting stuff.
- 579
5
votes
Which format (CSV, JSON, Atom, RSS?) should events data be published in?
There is no correct answer, but here's some pointers:
Its relatively painless to convert from JSON to CSV and vice-versa. what matters is the structure of your data. If its properly formatted, you ...
- 11.9k
5
votes
What are the most common issues with data cleaning (e.g. outliers, duplicates)? Who has data sets that need to be prepared for analysis?
There can be numerous instances where data needs to be cleansed and standardised.
To name a few -:
1) Mandatory fields having Null values - This is the greatest source of data loss
Remedy - Going ...
- 233
5
votes
How can I reliably host and share large data sets?
The quick, dirty, easy answer: compress the large data files into multiple .7z files, setting the maximum limit to 95mb per compressed file. I do this to get around GitHub's limitations, and want to ...
- 11.9k
4
votes
What are the data quality measures for open data?
Tim Berners-Lee suggested the following 5 star approach:
Under the star scheme, you get one (big!) star if the information has
been made public at all, even if it is a photo of a scan of a fax of a
...
- 7,740
4
votes
Can I take "open data" from a website like Quandl, modify it, and then resell it to clients?
The key question to ask whenever using data from an API or other source is "what licence is attached to the data?"
Quandl doesn't give any definitive answer, but it points to the original dataset's ...
- 141
4
votes
Publishing (structured?) data about products: information about products, barcodes, photos (incl. packaging)
As you can see in Wikimedia Commons, packages usually involve some copyrighted content and therefore its image can't be published under a free license. It can only be published with permission of ...
- 381
4
votes
How do I get my data indexed by Google Dataset Search?
You may want to stop and ask why you should want to be indexed there.
Dataset Search seems like a poorly planned effort to try and corner dataset search. Why the push isn't for open linked datasets/...
3
votes
Financial text data/corpora
For copyright issues; these datasets are no longer available.
Check out those datasets here:
8.5M titles from Reuters (2007-2016)
https://github.com/philipperemy/Reuters-full-data-set
450k + 100k ...
- 131
3
votes
Data about completed prison term by country
The Indian Government provides year-wise statistics on the number of people who are in prison and percentage of prison population by sentence length. So you could calculate the population which has ...
- 41
3
votes
Publishing Weather Data under Creative Commons / Peer Production License
try contacting the open science data cloud; at the bottom of this link is a contact email regarding submissions:
https://www.opensciencedatacloud.org/publicdata/
you also can get free hosting for ...
- 11.9k
3
votes
A database of open databases?
I didn't see these mentioned.
Rockstar Data Sources on Github.
List of free and open journals. Mostly scientific journals.
- 667
3
votes
A database of open databases?
Google Dataset Search
https://toolbox.google.com/datasetsearch
A recent tool in beta.
Blogpost
FAQ
Guidelines for developers (get your data indexed)
- 131
3
votes
Is there (or should there be) a standard way to categorize procurement data at the municipal level?
You hit on a particularly relevant pain-point when it comes to procurement data. The purchasing thresholds differ wildly across the map, and there isn't any universal standard for classification.
I ...
- 579
3
votes
What are the most useful formats in which to release geospatial data?
Geospatial Data Standardization
No more KML, KMZ, SHP files!
I will make the somewhat bold and possibly controversial statement that geospatial data should always be available in two single ...
- 579
3
votes
What are the most common ways that users find out about new data sets?
Jeremy Singer-Vine, BuzzFeed's data editor, runs a pretty good mailing list of "interesting" data sets: Data Is Plural. It's not an exhaustive collection, but it covers a variety of topics.
- 181
3
votes
What are the most common ways that users find out about new data sets?
As an addendum, even though it may not sound like the most obvious source, NICAR (National Institute for Computer-Assisted Reporting) maintains a very active listserv of data journalists corresponding ...
- 579
3
votes
What are the most common ways that users find out about new data sets?
Data.world has some interesting open datasets, and allows you to look at recent additions.
- 351
3
votes
Accepted
How to embed licenses within SVG?
This is not RDFa, but rather embedded RDF/XML, which is allowed by the SVG Tiny 1.2 Specification.
There are the following errors:
<cc:license>
instead of
<cc:License>
in lines 26, ...
- 2,965
3
votes
Government standards, guidelines, and practices for collecting data
Civic Common's Open Data Guidelines seem to be the default reference for most standards that I'm aware of. It's important to point out that Civic Commons is not a government entity/agency, however ...
- 11.9k
3
votes
Accepted
Implications of "For official use only"
The warning says nothing about using the data. Unauthorized activities are prohibited. Don't set up your own website or store your vacation images on their servers even if there is unfettered access ...
- 552
3
votes
Reliable point spatial data of cities of New Zealand
You could set up an account with Land Information New Zealand--LINZ Data Service
Once you log in, hit browse data.
The select Gazetteer option. That should show you three options. Select
NZ Place ...
- 223
3
votes
Data set for Mcdonalds
Don't know if this will be of interest to you, but some of the datasets related to McDonald's on Quandl include the following:
News Sentiment History for McDondald's corp: https://www.quandl.com/...
- 1,036
Only top scored, non community-wiki answers of a minimum length are eligible