13

I have some data which is Open(free from copyright, patents or other control mechanisms) and I want to share it with the users here. How do I do it without having to host it on some other server and share a link here?

As links are destined to change at some point, I would like this community to provide an option to upload Open Data and make it available for everyone.

Not sure if this is the right way of pushing a request, I am also going to ask this question on Meta -Stack Overflow.

Also I would like to add that if this request is implemented, SE - Open Data community is going to be very famous soon. (The same way a programmer searches for programming related questions, people with interest in Open Data and sharing Open resources would love to use this platform)

Edit: Link to my question on Meta-SO: https://meta.stackexchange.com/q/222407

  • What kind of data do you want to share/post? I think you will find numerous individuals whom host open datasets in personal repositories (such as on github). – Andrew - OpenGeoCode Feb 21 '14 at 15:42
  • 1
    Can't share huge sql dumps and files in csv formats and their zips on github, its just not made to share data this way. – Rao Feb 21 '14 at 16:00
  • @Andrew-OpenGeoCode I want to share data that I gathered from different open sources offline & online, while working on a recent web project, and I am very sure if I share my structured data, it will save some real time and energy for other developers. – Rao Feb 21 '14 at 16:05
  • Best to take this discussion offline. Put together a simple inventory of what data you want to share and where it was compiled from, and what form you have it in now. My email is in my profile. – Andrew - OpenGeoCode Feb 21 '14 at 16:54
  • 1
    @albert Here, meta.stackexchange.com/q/222407/241953 about 14 people viewed it, received one +1. Not sure how to get more users' attention. – Rao Feb 25 '14 at 15:43
5

We have recently created the OpenData StackExchange organization on datahub.io.

Welcome to the Datahub, the free, powerful data management platform from the Open Knowledge Foundation, based on the CKAN data management system.

The Datahub provides free access to many of CKAN's core features, letting you search for data, register published datasets, create and manage groups of datasets, and get updates from datasets and groups you're interested in. You can use the web interface or, if you are a programmer needing to connect the Datahub with another app, the CKAN API.

OpenData meta discussion


Update 2017: I've learned that there is a 100MB limit per file (see answer), and there is an open question about how to host larger files.

6

GitHub has all the things, seriously, it rules. OKFN hosts open data there. So do I. As do most Code for America brigades. But you can also get a free datahub.io account, at least for an organization and you can upload there.

You should also check out your area. Here in Virginia, there is an OpenVA data portal, and anyone can upload related data after signing up. Google your area and see if there are any municipal portals you can hit up.

EDIT: adding more options.

check out dat data, i have considered it on numerous occasions, and i may just use it personally so i get to play with it.
http://dat-data.com/

and http://datahub.io
which was built by okfn, and runs off ckan...

you could really get wild with free third party services: you could put them in dropbox, g drive, heroku, etc. you can also get a "free" account with amazon, not sure if its aws or as3; i do know that even though it's "free", it requires a credit card, and then i stopped filling out the application. :)
anything that gives you storage and url(s).

but then you are giving up ownership of that data. @ least to some extent. oh and now they have the data too. not like i pulled a copy of that repo, like, hey we can just walk in the front door and do whatever we want, whenever we want.

  • 1
    Albert, does GitHub have tools for (1) working with large datasets without downloading them, like what enigma.io is trying to do, (2) export to multiple formats, regardless of how the data was uploaded? – Anton Tarasenko Apr 19 '15 at 14:22
  • 1
    (1) not that i'm aware of. you can edit files live, but if a file is too big, github won't display it. (2) i am not aware of any file conversion processes built-in. that would be really cool – albert Apr 19 '15 at 14:32
  • what are your thoughts on enigma? i checked it out awhile ago, but was turned off by the pricing. or rather, i don't like to use tools that cost anything. i know things have to cost money, i just am immediately turned off and seek other solutions – albert Apr 19 '15 at 14:33
  • 1
    Enigma is getting friendlier. They increased their 50-file cap on export, left many features for free. I'm unaware, though, if they're going to let users upload their own files. – Anton Tarasenko Apr 19 '15 at 14:51
  • 1
    fwiw github did just start allowing for larger files to be uploaded. but that doesn't pertain to your questions – albert Apr 19 '15 at 15:00
4

Try finding a stable data repository that can be a permanent home for the data. Two of the best places to look for such a home are DataBib and re3data.

If you are affiliated with a college or university whose library maintains an institutional repository, that may also be a good place to stash the data for the long term.

This answer assumes that the data are stable (or at least snapshottable).

2

It's possible that the answer to this question might revolve around the nature of the data. Although the data itself may be intended to be ephemeral in the case of something like 'how do I clean this up?' questions, we need the bad data to persist as it's so tightly coupled to the question, and we want the question to persist. As such, I would not suggest services like PasteBin.

We're starting to get new services popping up that will take in datasets no matter the discipline:

  • FigShare is free for open data. If you want to post restricted data, then to pay depending on the size.

  • Zenodo allows up to 2GB files and different licenses for the data, but I don't know if they have all of their cost model stuff ironed out quite yet. (it's CERN funded, so I suspect it will persist)

It's likely that there are other groups out there popping up; some folks might use Drop Box and such, and it's possible that someone might end up with a sort of 'slideshare for tabular data' to allow someone to more easily skim through data that's been uploaded without the need to download the file ... but I don't think we're quite there yet.

(does the first paragraph show that I was just on a panel discussing data citation this morning?)

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.