29 votes
Accepted

Bulk download Sci-Hub papers

Sci-Hub is a paywall-bypassing website that uses "shared" user credentials to provide PDF or HTML scientific papers. The website itself doesn't store any papers. (There are interesting comments on ...
user avatar
  • 17.1k
7 votes
Accepted

Scientometric/bibliometric data retrieval from a list of DOI

Maybe the rcrossref package for R is helpful. To find the number of citations, You can do things such as library(rcrossref) # returns list: # pap <- cr_works(dois = "10.1371/journal.pone....
user avatar
  • 1,164
7 votes
Accepted

Is there an open database with characteristics of tree species?

The National Phenology Network has data for flowering dates (and other phenological characteristics) for trees in the United States. Using their download tool, you can specify a season of interest (...
user avatar
6 votes

Where can I find the dataset that has all open research publications (just titles and abstracts)?

First to be able to better answer: what is your definition of open scientific publications? Second: there is for sure nothing comparable to Wikipedia or so in terms of cross-disciplinarity and ...
user avatar
6 votes

Where can I find the dataset that has all open research publications (just titles and abstracts)?

Restricting this question to "Computer Science" (as suggested in the comments) and reducing "all possible" to the ones which were actually published, one resource is The DBLP Computer Science ...
user avatar
  • 709
6 votes

Does data stored in Mendeley qualify as open data?

Data Mendeley does not seem to grant me any license to reuse the content (in particular the academic papers uploaded by other users), so by default the data must be considered closed: We are not ...
user avatar
6 votes
Accepted

How to collect hand-writting data

The first step is splitting the image into character arrays. To do that, check out the answers in this question: Separate image of text into component character images. In particular, the ImageMagick ...
user avatar
  • 17.1k
5 votes

How to crawl data from a library website

First, you should check for any license for using the site to see if you can use their data for any reason (commercial and non-commercial). Second, you should read the terms of use and find anything ...
user avatar
  • 4,716
5 votes

Evidence for the economic impact of open data?

Open Data Barometer recently published this: http://www.opendatabarometer.org/report/analysis/impact.html also, the open data working group under the Open Government Partnership will be looking at ...
user avatar
  • 137
5 votes

Open database APIs for journal article metadata

http://libguides.mit.edu/apis gives a very nice list of APIs for scholarly resources, here is snapshot of the page in case it disappears:
user avatar
5 votes

Bulk download Sci-Hub papers

The Reddit thread Can I download all libgen books? describes how to download the entire Library Genesis database (~10TB).
user avatar
4 votes

Large bibliographic database of research papers

EDIT 2017 PubMed Central changed all adressess and some methods. Only tips: To bulk access you can use complex FTP procedures similar to the described below in the "OLD" section... Or a simple perl ...
4 votes

Where can I find a dataset of academic conferences?

I would suggest that you scrape the data on SSRN by looking by field/location/date.
user avatar
4 votes

Is it legal to crawl research papers from ACM/IEEE?

From the ACM terms of usage page To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Send written requests for ...
user avatar
  • 4,716
4 votes

Is it legal to crawl research papers from ACM/IEEE?

If you are affiliated with an academic institution that subscribes to IEEE/ACM material, talk to your library. They may be able to negotiate access on your behalf. Chances are fair it isn't the first ...
user avatar
  • 526
4 votes
Accepted

Retrieve affiliations from research paper

Many of the bibliographic databases offer APIs, but they might not be 100% open. Typically, you can't get access to the ones that charge for access unless your institution has a subscription to the ...
user avatar
  • 4,485
4 votes
Accepted

Research paper on machine failure prediction or predictive maintenance

Take a look at my answer here. Basically, it goes over a primary manufacturing technology that allows collecting data from various machine tools. However, the same MTConnect "standard" can be applied ...
user avatar
  • 258
4 votes
Accepted

Dataset for emotion classification

Some nice data sets for practicing sentiment classification are: Sentiment 140 Tweets2011 Dataset by Sanders Another source This one on Github One from a Kaggle contest These are some open datasets ...
user avatar
  • 262
4 votes

Where can I find EEG database for autism-spectrum disorder patients?

You can request access to SFARI, which has some ASD patients with EEG data. SFARI Base You can also request access to ACE. ACE will analyze four key forms of data: • EEG Data • ...
user avatar
4 votes

Seeking Green space layer for California

Openstreetmap (OSM) is an excellent source of all kinds of vector data on human infrastructure, particularly in urban areas of the USA and Europe. You'll need to figure out which OSM tags for ...
user avatar
3 votes
Accepted

How can I Share my Data Sets Without Worrying About Copyright Issues?

Without being a trained copyright expert, the crux of your endevour lies in your process of aggregating your text corpus: Over the years, I collected texts from many different internet sources (...
user avatar
  • 2,784
3 votes

Dataset of researchers CV

I don't know if it would have all of what you're looking for, but there are a couple of efforts to try to give identifiers to researchers. Most of them link to publications, and some have CV building ...
user avatar
  • 4,485
3 votes

Where can I find the dataset that has all open research publications (just titles and abstracts)?

BASE (Bielefeld academic search engine) is one of the world's most voluminous search engines especially for academic open access web resources. It claims 80 million documents, and offers an API ...
user avatar
3 votes

Is it legal to crawl research papers from ACM/IEEE?

I looked up the IEEE case: Guests/Members are not permitted to do the following: create an archive of any portion of CSDL; use robots or intelligent agents to access, search and/or ...
user avatar
  • 17.1k
3 votes

Large bibliographic database of research papers

To update Cristian's answer, with regard to PubMed, you don't need to be from the USA. There are a couple of ways to get the data. 1) PubMed, go to http://www.ncbi.nlm.nih.gov/pubmed/?term=%22all%22%...
user avatar
  • 131
3 votes

Dataset for emotion classification into happy, sad, angry

In Computational Linguistics this task is called Sentiment Analysis. there is a plethora of data sets for sentiment analysis but it will always depend on the kind on text you will want to apply the ...
user avatar
  • 31
3 votes

Citation Network Dataset

While it is certainly not exhaustive, the Microsoft Academic Graph is probably worth checking out. They have a free public API and the complete dataset is also available for download. There appear ...
user avatar
  • 211
3 votes

Resume Dataset Request

try Kaggle datasets: https://www.kaggle.com/datasets Also try the Fed's St. Louis website.
user avatar
  • 41

Only top scored, non community-wiki answers of a minimum length are eligible