Linked Questions

26
votes
3answers
11k views

Bulk download Sci-Hub papers

I wonder whether it is possible to bulk download all papers stored in Sci-Hub. I am aware of the questions: Is there a more user-friendly way to download multiple articles from arXiv? Bulk download ...
11
votes
5answers
3k views

Dataset of domain names

There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
17
votes
4answers
912 views

What are the practical limits of releasing open data via bit torrent?

I know that there are political issues (my place of work bans all peer-to-peer software without an explicit waiver), but how well does bit torrent scale for distributing large data collections where ...
13
votes
2answers
3k views

Dump of WikiLeaks

Does a dump or scrape of WikiLeaks exist? I'm thinking of an equivalent to Wikipedia's database download: http://en.wikipedia.org/wiki/Wikipedia:Database_download So far, I haven't found direct ...
7
votes
2answers
522 views

Data with trips

Any idea if there`s any source from where I can get publicly available data of trip details?
7
votes
2answers
268 views

Recommended BitTorrent tracker/index for dataset release?

I have a large dataset which I plan to release to the public (around 80GB compressed, 1TB uncompressed), and after considering my options it appears that using the BitTorrent protocol would be the ...
2
votes
2answers
193 views

Places to get large (volume wise) datasets reasonably well formatted and free to share?

I've been struggling with this problem for almost 2 hours now :( I need some datasets that are somewhere around 50 - 5000 GB large when uncompressed to showcase and test various data storage and ...
3
votes
1answer
165 views

Open Data about the internet

Does anyone know where one can find (if any is available) open data about the internet, and generally any data about tier1 infrastructure, i.e internet backbone nodes with capacity, coordinates Also ...
3
votes
1answer
54 views

Bittorrent usage for distributing open science-data?

Writing a grant proposal. - I am looking for information about the usage of the bittorrent protocol for open science data. Does anyone know of a recent paper, blog post or study? Specifically I am ...
0
votes
0answers
22 views

Torrent tracker for open data

Wikipedia says that a torrent tracker is ... a special type of server that assists in the communication between peers using the BitTorrent protocol. and The "tracker" server keeps track of ...
1
vote
0answers
18 views

Find a home for (old) video datasets

While looking for some older sets like PETS2006, which seems to be no longer available, i wondered if there might be already a place for them to be shared forever. If there is none, i would encourage ...