17 votes
Accepted

What are some OpenData torrents to seed?

Community wiki to collect data sets available to download/seed on bit torrent DNS Census, the DNS registration dataset snapshot taken in 2013 (compressed ~15GB and uncompressed 157GB). The DNS ...
15 votes

A database of open databases?

As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan. The ...
user avatar
10 votes
Accepted

Suggested formats for open data documents

Ideally, like @Andrew - OpenGeoCode mentions, you would release it in multiple formats. I would really suggest you look into organizing it into a e-book written in Markdown and hosted on Github. ...
user avatar
9 votes
Accepted

Where to upload open data? (no online data editing needed)

Well my comment received a number of up votes which I take as a signal of quality and I am posting the links here so they are more visible to future visitors: opendata.socrata.com - you can upload a ...
user avatar
8 votes
Accepted

Alternative to GTFS (General Transit Feed Specification)?

Transmodel is a not very widely used format for schedule data (alternative to GTFS). For real time data (alternative to GTFS-realtime): SIRI is an XML protocol used most heavily in Europe. You'll ...
user avatar
  • 266
8 votes

A database of open databases?

databib.org re3data.org recently merged: Registry of Research Data Repositories i.e. RE3 "The consolidated registry contains information for more than 1,130 data repositories that are accessed by ...
user avatar
8 votes
Accepted

How to make a successful FOIA request?

The basics for FOIA are: be very clear in your request be respectful be tenacious Remember that while there are government officials who are hostile to records requests, not all of them are. There ...
user avatar
  • 5,488
7 votes

A database of open databases?

Another system of interest for your list would be the OKFN Global Open Data Index: https://index.okfn.org/place/ It provides national and sub-national catalog listings and categorization for a ...
user avatar
  • 166
7 votes

Should we open our data?

Quick answer with what comes to my mind. They might be several others. Advantages Since you lower the barrier to access the data (no more scraping), you will see more people using it and new usage ...
user avatar
  • 1,535
7 votes

How can I reliably host and share large data sets?

I'm sorry to hear you had a frustrating time uploading to datahub.io and that the site wasn't clear enough about the size limit. Another datahub-like platform that we have worked with in the past is ...
user avatar
6 votes

What are the most useful formats in which to release geospatial data?

My experience, making maps from quite a few government datasets: For point data, CSV is the best, with "lat" and "lon" columns. Very easy to work with in a wide range of tools, including text editors,...
user avatar
6 votes
Accepted

How do I share Open Data with others on this SE site?

We have recently created the OpenData StackExchange organization on datahub.io. Welcome to the Datahub, the free, powerful data management platform from the Open Knowledge Foundation, based on the ...
user avatar
  • 17.2k
6 votes

Suggested formats for open data documents

The other suggestions on here are great, and I would echo the recommendation to consider Github if you want people to be able to easily edit your product for creating their own versions. This will ...
user avatar
6 votes

Which format (CSV, JSON, Atom, RSS?) should events data be published in?

The format should fit the data structure not the need of the comsumer (or the one who uses the data). If the data is semantically stored in a json structure you can easily export the data in ...
user avatar
6 votes

What methods are used to prepare sensitive data for public access?

The first step as you said is to define which types of entities need to be removed in the public version of the data set. One example of such definition in the United States is given in the Health ...
user avatar
6 votes
Accepted

How can I reliably host and share large data sets?

If you want quick, dirty, and free, you can always host downloadable datasets at the Internet Archive (archive.org). No pretty interface, but as much storage as you could ever want.
user avatar
5 votes

What's the best way to host map tiles?

Apart from MapBox mentioned by Harry I'd also recommend having a look at CartoDB which let's you harness the power of PosGIS without the hassle of maintaining your own server (at a price). ...
user avatar
  • 151
5 votes

From an entrepreneur's perspective, are there reasons to open data?

One reason to open your data is that the people who may be using the data may not be your competitors; by putting it out there for other people to use, there may be people who are able to find ...
user avatar
  • 4,485
5 votes

A database of open databases?

Please refer the link https://www.udacity.com/wiki/ml/resources In the above given link there is a link which points to many sites where you can pull the data from open database.
user avatar
  • 151
5 votes

What are the most common ways that users find out about new data sets?

I've also found DataBullet.in and Enigma Public Data Explorer to be helpful. Also, a recent social network called data.world has tons of interesting stuff.
user avatar
5 votes

Should we open our data?

yes. the less barriers to accessibility, the easier it is to be consumed. the same principle applies to content. open.all.the.things.
user avatar
  • 11.8k
5 votes
Accepted

What's a good file format for sharing 3D models of cities?

In answer to the original question, you should look at CityGML – this is a standardised format that's being heavily used by cities, particularly in Europe. It handles model definition, textures, ...
user avatar
5 votes
Accepted

Can state, county or city sales tax records be retrieved in the U.S. under FOIA?

Sales tax records for an individual business are probably protected (or exempted) by FOIA authorizing legislation as competitive business records. With that information, a competitor could determine ...
user avatar
  • 552
5 votes

Which format (CSV, JSON, Atom, RSS?) should events data be published in?

There is no correct answer, but here's some pointers: Its relatively painless to convert from JSON to CSV and vice-versa. what matters is the structure of your data. If its properly formatted, you ...
user avatar
  • 11.8k
5 votes

What are the most common issues with data cleaning (e.g. outliers, duplicates)? Who has data sets that need to be prepared for analysis?

There can be numerous instances where data needs to be cleansed and standardised. To name a few -: 1) Mandatory fields having Null values - This is the greatest source of data loss Remedy - Going ...
user avatar
  • 237
5 votes

How can I reliably host and share large data sets?

The quick, dirty, easy answer: compress the large data files into multiple .7z files, setting the maximum limit to 95mb per compressed file. I do this to get around GitHub's limitations, and want to ...
user avatar
  • 11.8k
4 votes

What are the data quality measures for open data?

Tim Berners-Lee suggested the following 5 star approach: Under the star scheme, you get one (big!) star if the information has been made public at all, even if it is a photo of a scan of a fax of a ...
user avatar
4 votes
Accepted

Where should I host/contribute a mapping from Stack Overflow tags to Wikipedia articles?

The best is to host your mapping directly on Wikidata. The property is https://www.wikidata.org/wiki/Property:P1482 For instance, https://www.wikidata.org/wiki/Q859221 represents Java Swing, and has ...
user avatar
  • 395
4 votes

What happens to the data submitted to the DDL?

Great questions- and ones that we try to answer as clearly as possible. We've got a slew of links on the submission page including FAQs- but how would you want the information presented so that it's ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible