Linked Questions

30
votes
3answers
15k views

Bulk download Sci-Hub papers

I wonder whether it is possible to bulk download all papers stored in Sci-Hub. I am aware of the questions: Is there a more user-friendly way to download multiple articles from arXiv? Bulk download ...
12
votes
6answers
4k views

Dataset of domain names

There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
19
votes
4answers
956 views

What are the practical limits of releasing open data via bit torrent?

I know that there are political issues (my place of work bans all peer-to-peer software without an explicit waiver), but how well does bit torrent scale for distributing large data collections where ...
13
votes
2answers
3k views

Dump of WikiLeaks

Does a dump or scrape of WikiLeaks exist? I'm thinking of an equivalent to Wikipedia's database download: http://en.wikipedia.org/wiki/Wikipedia:Database_download So far, I haven't found direct ...
7
votes
2answers
550 views

Data with trips

Any idea if there`s any source from where I can get publicly available data of trip details?
7
votes
2answers
356 views

Recommended BitTorrent tracker/index for dataset release?

I have a large dataset which I plan to release to the public (around 80GB compressed, 1TB uncompressed), and after considering my options it appears that using the BitTorrent protocol would be the ...
2
votes
2answers
390 views

Places to get large (volume wise) datasets reasonably well formatted and free to share?

I've been struggling with this problem for almost 2 hours now :( I need some datasets that are somewhere around 50 - 5000 GB large when uncompressed to showcase and test various data storage and ...
3
votes
1answer
170 views

Open Data about the internet

Does anyone know where one can find (if any is available) open data about the internet, and generally any data about tier1 infrastructure, i.e internet backbone nodes with capacity, coordinates Also ...
4
votes
1answer
65 views

Bittorrent usage for distributing open science-data?

Writing a grant proposal. - I am looking for information about the usage of the bittorrent protocol for open science data. Does anyone know of a recent paper, blog post or study? Specifically I am ...
1
vote
0answers
20 views

Find a home for (old) video datasets

While looking for some older sets like PETS2006, which seems to be no longer available, i wondered if there might be already a place for them to be shared forever. If there is none, i would encourage ...