15
votes
A database of open databases?
As of February 2019, you'll find a list of 2600+ open data portals around the world on OpenDataSoft's website. It lists as of now 2600+ portals ranging from the US (obviously) to Afghanistan.
The ...
- 151
8
votes
Accepted
Alternative to GTFS (General Transit Feed Specification)?
Transmodel is a not very widely used format for schedule data (alternative to GTFS).
For real time data (alternative to GTFS-realtime): SIRI is an XML protocol used most heavily in Europe.
You'll ...
- 266
8
votes
A database of open databases?
databib.org
re3data.org
recently merged: Registry of Research Data Repositories i.e. RE3
"The consolidated registry contains information for more than 1,130 data repositories that are accessed by ...
- 91
7
votes
How can I reliably host and share large data sets?
I'm sorry to hear you had a frustrating time uploading to datahub.io and that the site wasn't clear enough about the size limit. Another datahub-like platform that we have worked with in the past is ...
- 699
7
votes
Accepted
How can I reliably host and share large data sets?
If you want quick, dirty, and free, you can always host downloadable datasets at the Internet Archive (archive.org). No pretty interface, but as much storage as you could ever want.
- 496
6
votes
What are the most useful formats in which to release geospatial data?
My experience, making maps from quite a few government datasets:
For point data, CSV is the best, with "lat" and "lon" columns. Very easy to work with in a wide range of tools, including text editors,...
- 850
6
votes
Accepted
How do I share Open Data with others on this SE site?
We have recently created the OpenData StackExchange organization on datahub.io.
Welcome to the Datahub, the free, powerful data management platform from the Open Knowledge Foundation, based on the ...
- 17.5k
6
votes
Which format (CSV, JSON, Atom, RSS?) should events data be published in?
The format should fit the data structure not the need of the comsumer (or the one who uses the data).
If the data is semantically stored in a json structure you can easily export the data in ...
- 161
6
votes
What methods are used to prepare sensitive data for public access?
The first step as you said is to define which types of entities need to be removed in the public version of the data set. One example of such definition in the United States is given in the Health ...
- 7,700
5
votes
What's the best way to host map tiles?
Apart from MapBox mentioned by Harry I'd also recommend having a look at CartoDB which let's you harness the power of PosGIS without the hassle of maintaining your own server (at a price).
...
- 151
5
votes
What are the most common ways that users find out about new data sets?
I've also found DataBullet.in and Enigma Public Data Explorer to be helpful.
Also, a recent social network called data.world has tons of interesting stuff.
- 579
5
votes
Accepted
What's a good file format for sharing 3D models of cities?
In answer to the original question, you should look at CityGML – this is a standardised format that's being heavily used by cities, particularly in Europe. It handles model definition, textures, ...
- 166
5
votes
Accepted
Can state, county or city sales tax records be retrieved in the U.S. under FOIA?
Sales tax records for an individual business are probably protected (or exempted) by FOIA authorizing legislation as competitive business records. With that information, a competitor could determine ...
- 552
5
votes
Which format (CSV, JSON, Atom, RSS?) should events data be published in?
There is no correct answer, but here's some pointers:
Its relatively painless to convert from JSON to CSV and vice-versa. what matters is the structure of your data. If its properly formatted, you ...
- 11.8k
5
votes
What are the most common issues with data cleaning (e.g. outliers, duplicates)? Who has data sets that need to be prepared for analysis?
There can be numerous instances where data needs to be cleansed and standardised.
To name a few -:
1) Mandatory fields having Null values - This is the greatest source of data loss
Remedy - Going ...
- 233
5
votes
How can I reliably host and share large data sets?
The quick, dirty, easy answer: compress the large data files into multiple .7z files, setting the maximum limit to 95mb per compressed file. I do this to get around GitHub's limitations, and want to ...
- 11.8k
4
votes
What are the data quality measures for open data?
Tim Berners-Lee suggested the following 5 star approach:
Under the star scheme, you get one (big!) star if the information has
been made public at all, even if it is a photo of a scan of a fax of a
...
- 7,700
4
votes
What happens to the data submitted to the DDL?
Great questions- and ones that we try to answer as clearly as possible. We've got a slew of links on the submission page including FAQs- but how would you want the information presented so that it's ...
- 61
4
votes
Accepted
Financial text data/corpora
Your school's library might have access to databases of newspaper and magazine archives, some going back decades. If you're in a large city, your public library might also have those. The New York ...
- 66
4
votes
Can I take "open data" from a website like Quandl, modify it, and then resell it to clients?
The key question to ask whenever using data from an API or other source is "what licence is attached to the data?"
Quandl doesn't give any definitive answer, but it points to the original dataset's ...
- 141
4
votes
Publishing (structured?) data about products: information about products, barcodes, photos (incl. packaging)
As you can see in Wikimedia Commons, packages usually involve some copyrighted content and therefore its image can't be published under a free license. It can only be published with permission of ...
- 381
4
votes
How do I get my data indexed by Google Dataset Search?
You may want to stop and ask why you should want to be indexed there.
Dataset Search seems like a poorly planned effort to try and corner dataset search. Why the push isn't for open linked datasets/...
3
votes
Accepted
How to embed licenses within SVG?
This is not RDFa, but rather embedded RDF/XML, which is allowed by the SVG Tiny 1.2 Specification.
There are the following errors:
<cc:license>
instead of
<cc:License>
in lines 26, ...
- 2,945
3
votes
Best place to publish my Android app's Google Play statistics?
I tried publishing the statistics of one Android app on DataHub:
http://datahub.io/dataset/google-play-statistics
Findings:
No automatic import from Google Play, which makes this no-go in the long ...
- 8,266
3
votes
What are the most common ways that users find out about new data sets?
Jeremy Singer-Vine, BuzzFeed's data editor, runs a pretty good mailing list of "interesting" data sets: Data Is Plural. It's not an exhaustive collection, but it covers a variety of topics.
- 181
3
votes
What are the most common ways that users find out about new data sets?
As an addendum, even though it may not sound like the most obvious source, NICAR (National Institute for Computer-Assisted Reporting) maintains a very active listserv of data journalists corresponding ...
- 579
3
votes
What are the most common ways that users find out about new data sets?
Data.world has some interesting open datasets, and allows you to look at recent additions.
- 351
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
releasing-data × 140data-request × 37
government × 16
uses-of-open-data × 13
best-practice × 11
geospatial × 10
api × 10
licensing × 9
data-format × 9
city × 7
standards × 7
data.gov × 6
usa × 5
historical × 5
metadata × 5
linked-data × 5
legal × 5
medical × 4
machine-learning × 4
weather × 4
uk × 4
rdf × 4
openfda × 3
tool-request × 3
csv × 3