15 votes

A database of open databases?

As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan. The ...
Rémi Mercier's user avatar
7 votes

How can I reliably host and share large data sets?

I'm sorry to hear you had a frustrating time uploading to datahub.io and that the site wasn't clear enough about the size limit. Another datahub-like platform that we have worked with in the past is ...
Dan Fowler's user avatar
7 votes
Accepted

How can I reliably host and share large data sets?

If you want quick, dirty, and free, you can always host downloadable datasets at the Internet Archive (archive.org). No pretty interface, but as much storage as you could ever want.
Asparagirl's user avatar
6 votes

Which format (CSV, JSON, Atom, RSS?) should events data be published in?

The format should fit the data structure not the need of the comsumer (or the one who uses the data). If the data is semantically stored in a json structure you can easily export the data in ...
Harald Ernst's user avatar
6 votes

What methods are used to prepare sensitive data for public access?

The first step as you said is to define which types of entities need to be removed in the public version of the data set. One example of such definition in the United States is given in the Health ...
Franck Dernoncourt's user avatar
5 votes

What are the most common ways that users find out about new data sets?

I've also found DataBullet.in and Enigma Public Data Explorer to be helpful. Also, a recent social network called data.world has tons of interesting stuff.
Carl V. Lewis's user avatar
5 votes

Which format (CSV, JSON, Atom, RSS?) should events data be published in?

There is no correct answer, but here's some pointers: Its relatively painless to convert from JSON to CSV and vice-versa. what matters is the structure of your data. If its properly formatted, you ...
albert's user avatar
  • 11.9k
5 votes

What are the most common issues with data cleaning (e.g. outliers, duplicates)? Who has data sets that need to be prepared for analysis?

There can be numerous instances where data needs to be cleansed and standardised. To name a few -: 1) Mandatory fields having Null values - This is the greatest source of data loss Remedy - Going ...
Pramit's user avatar
  • 233
5 votes

How can I reliably host and share large data sets?

The quick, dirty, easy answer: compress the large data files into multiple .7z files, setting the maximum limit to 95mb per compressed file. I do this to get around GitHub's limitations, and want to ...
albert's user avatar
  • 11.9k
4 votes

What are the data quality measures for open data?

Tim Berners-Lee suggested the following 5 star approach: Under the star scheme, you get one (big!) star if the information has been made public at all, even if it is a photo of a scan of a fax of a ...
Franck Dernoncourt's user avatar
4 votes

Can I take "open data" from a website like Quandl, modify it, and then resell it to clients?

The key question to ask whenever using data from an API or other source is "what licence is attached to the data?" Quandl doesn't give any definitive answer, but it points to the original dataset's ...
puntofisso's user avatar
4 votes

Publishing (structured?) data about products: information about products, barcodes, photos (incl. packaging)

As you can see in Wikimedia Commons, packages usually involve some copyrighted content and therefore its image can't be published under a free license. It can only be published with permission of ...
Pere's user avatar
  • 381
4 votes

How do I get my data indexed by Google Dataset Search?

You may want to stop and ask why you should want to be indexed there. Dataset Search seems like a poorly planned effort to try and corner dataset search. Why the push isn't for open linked datasets/...
3 votes

Financial text data/corpora

For copyright issues; these datasets are no longer available. Check out those datasets here: 8.5M titles from Reuters (2007-2016) https://github.com/philipperemy/Reuters-full-data-set 450k + 100k ...
Philippe Remy's user avatar
3 votes

Data about completed prison term by country

The Indian Government provides year-wise statistics on the number of people who are in prison and percentage of prison population by sentence length. So you could calculate the population which has ...
Harsh's user avatar
  • 41
3 votes

Publishing Weather Data under Creative Commons / Peer Production License

try contacting the open science data cloud; at the bottom of this link is a contact email regarding submissions: https://www.opensciencedatacloud.org/publicdata/ you also can get free hosting for ...
albert's user avatar
  • 11.9k
3 votes

A database of open databases?

I didn't see these mentioned. Rockstar Data Sources on Github. List of free and open journals. Mostly scientific journals.
Bulrush's user avatar
  • 667
3 votes

A database of open databases?

Google Dataset Search https://toolbox.google.com/datasetsearch A recent tool in beta. Blogpost FAQ Guidelines for developers (get your data indexed)
Andrey Portnoy's user avatar
3 votes

Is there (or should there be) a standard way to categorize procurement data at the municipal level?

You hit on a particularly relevant pain-point when it comes to procurement data. The purchasing thresholds differ wildly across the map, and there isn't any universal standard for classification. I ...
Carl V. Lewis's user avatar
3 votes

What are the most useful formats in which to release geospatial data?

Geospatial Data Standardization No more KML, KMZ, SHP files! I will make the somewhat bold and possibly controversial statement that geospatial data should always be available in two single ...
Carl V. Lewis's user avatar
3 votes

What are the most common ways that users find out about new data sets?

Jeremy Singer-Vine, BuzzFeed's data editor, runs a pretty good mailing list of "interesting" data sets: Data Is Plural. It's not an exhaustive collection, but it covers a variety of topics.
pml's user avatar
  • 181
3 votes

What are the most common ways that users find out about new data sets?

As an addendum, even though it may not sound like the most obvious source, NICAR (National Institute for Computer-Assisted Reporting) maintains a very active listserv of data journalists corresponding ...
Carl V. Lewis's user avatar
3 votes

What are the most common ways that users find out about new data sets?

Data.world has some interesting open datasets, and allows you to look at recent additions.
wirefire's user avatar
  • 351
3 votes
Accepted

How to embed licenses within SVG?

This is not RDFa, but rather embedded RDF/XML, which is allowed by the SVG Tiny 1.2 Specification. There are the following errors: <cc:license> instead of <cc:License> in lines 26, ...
Stanislav Kralin's user avatar
3 votes

Government standards, guidelines, and practices for collecting data

Civic Common's Open Data Guidelines seem to be the default reference for most standards that I'm aware of. It's important to point out that Civic Commons is not a government entity/agency, however ...
albert's user avatar
  • 11.9k
3 votes
Accepted

Implications of "For official use only"

The warning says nothing about using the data. Unauthorized activities are prohibited. Don't set up your own website or store your vacation images on their servers even if there is unfettered access ...
pndfam05's user avatar
  • 552
3 votes

Reliable point spatial data of cities of New Zealand

You could set up an account with Land Information New Zealand--LINZ Data Service Once you log in, hit browse data. The select Gazetteer option. That should show you three options. Select NZ Place ...
Aaron M's user avatar
  • 223
3 votes

Data set for Mcdonalds

Don't know if this will be of interest to you, but some of the datasets related to McDonald's on Quandl include the following: News Sentiment History for McDondald's corp: https://www.quandl.com/...
user37317's user avatar
  • 1,036

Only top scored, non community-wiki answers of a minimum length are eligible