30
votes
Accepted
Bulk download Sci-Hub papers
Sci-Hub is a paywall-bypassing website that uses "shared" user credentials to provide PDF or HTML scientific papers. The website itself doesn't store any papers. (There are interesting comments on ...
- 17.5k
7
votes
Accepted
Scientometric/bibliometric data retrieval from a list of DOI
Maybe the rcrossref package for R is helpful. To find the number of citations, You can do things such as
library(rcrossref)
# returns list:
# pap <- cr_works(dois = "10.1371/journal.pone....
- 1,227
7
votes
Accepted
Is there an open database with characteristics of tree species?
The National Phenology Network has data for flowering dates (and other phenological characteristics) for trees in the United States.
Using their download tool, you can specify a season of interest (...
- 316
6
votes
Accepted
How to collect hand-writting data
The first step is splitting the image into character arrays. To do that, check out the answers in this question: Separate image of text into component character images. In particular, the ImageMagick ...
- 17.5k
5
votes
Bulk download Sci-Hub papers
The Reddit thread Can I download all libgen books? describes how to download the entire Library Genesis database (~10TB).
- 151
4
votes
Accepted
Dataset for emotion classification
Some nice data sets for practicing sentiment classification are:
Sentiment 140
Tweets2011
Dataset by Sanders
Another source
This one on Github
One from a Kaggle contest
These are some open datasets ...
- 262
4
votes
Large bibliographic database of research papers
EDIT 2017
PubMed Central changed all adressess and some methods.
Only tips:
To bulk access you can use complex FTP procedures similar to the described below in the "OLD" section... Or a simple perl ...
4
votes
Accepted
Research paper on machine failure prediction or predictive maintenance
Take a look at my answer here. Basically, it goes over a primary manufacturing technology that allows collecting data from various machine tools. However, the same MTConnect "standard" can be applied ...
- 258
4
votes
Where can I find EEG database for autism-spectrum disorder patients?
You can request access to SFARI, which has some ASD patients with EEG data.
SFARI Base
You can also request access to ACE.
ACE will analyze four key forms of data:
• EEG Data
• ...
4
votes
Seeking Green space layer for California
Openstreetmap (OSM) is an excellent source of all kinds of vector data on human infrastructure, particularly in urban areas of the USA and Europe.
You'll need to figure out which OSM tags for ...
- 141
3
votes
Dataset for emotion classification into happy, sad, angry
In Computational Linguistics this task is called Sentiment Analysis.
there is a plethora of data sets for sentiment analysis but it will always depend on the kind on text you will want to apply the ...
- 31
3
votes
Accepted
How can I Share my Data Sets Without Worrying About Copyright Issues?
Without being a trained copyright expert, the crux of your endevour lies in your process of aggregating your text corpus:
Over the years, I collected texts from many different internet sources (...
- 2,804
3
votes
Where can I find the dataset that has all open research publications (just titles and abstracts)?
BASE (Bielefeld academic search engine) is one of the world's most voluminous search engines especially for academic open access web resources. It claims 80 million documents, and offers an API ...
- 517
3
votes
Large bibliographic database of research papers
To update Cristian's answer, with regard to PubMed, you don't need to be from the USA. There are a couple of ways to get the data.
1) PubMed, go to http://www.ncbi.nlm.nih.gov/pubmed/?term=%22all%22%...
- 131
3
votes
Citation Network Dataset
While it is certainly not exhaustive, the Microsoft Academic Graph is probably worth checking out.
They have a free public API and the complete dataset is also available for download.
There appear ...
- 221
3
votes
Resume Dataset Request
try Kaggle datasets: https://www.kaggle.com/datasets
Also try the Fed's St. Louis website.
- 41
3
votes
Accepted
Where can i find Public Datasets related to Astronomy and other fields?
Have you seen in the news that Google released a brand new Google Dataset Search yesterday. It is a very convenient way to search for datasets, and overall it looks very promising.
- 146
3
votes
How to find the wikidata ID of a DBpedia concept?
Q1: Are all DBpedia concepts associated with its relevent wikidata ID?
Those kind of links are usually generated by the people on either side into the direction of the other side. Since it is ...
- 131
2
votes
Large bibliographic database of research papers
RePEc data:
http://ideas.repec.org/getdata.html
Only economics, but coverage, quality, and ease of access are outstanding.
- 3,641
2
votes
Research paper on machine failure prediction or predictive maintenance
There was a recent article in the news about predicting when elevators would need maintenance.
... but that's not released data.
If anyone had this sort of data as open data ... you might try NASA. ...
- 4,445
2
votes
Information retrieval problem
The documentation of the Twitter Search API for tweets mentions operators, such as ":)", where you can specify whether the tweet has a positive or a negative attitude. You can combine this with the ...
- 1,227
2
votes
How can I find state-level data on the unemployment rate of youth for 2014 and 2015?
state level, yearly:
https://www.minimumwage.com/in-your-state/
i know that is not the ideal set you wanted, baffled at how bls can't help, but not surprised. i would see if they are on github and ...
- 11.8k
2
votes
Dataset for emotion classification
This would be a good data source and the researcher also done a work on it. refer it too.
good luck
- 281
2
votes
Data for testing sequence tagging algorithm
You can use our training data for a CRF we trained to label address components: https://github.com/datamade/usaddress/blob/master/training/labeled.xml
- 5,098
2
votes
Is there an open database with characteristics of tree species?
For generalized attributes for a broad range of species you could also try the Encyclopedia of Life. For example, their data page for Pinus taeda has general attributes for height (base and mature), ...
- 151
2
votes
Patents in academic institutions
This is a somewhat difficult request because each of these parameters must be derived from government data. Even number of patents is difficult b/c the names of patent owners vary widely because of ...
- 21
2
votes
How to organize and retrieve list of publications/studies?
From Is there any established database schema to store references?:
For example, the Perl package Bib2ML (aka.
Bib2HTML)
contains a bib2sql tool that generates a SQL database from a BibTeX
...
- 7,740
2
votes
How to organize and retrieve list of publications/studies?
The answer to your question heavily depends on the types of studies that interest you.
If you check out PubMed (https://en.wikipedia.org/wiki/PubMed), you'll find the option to export search results ...
- 21
2
votes
Medical research articles annotated with quality of evidence
A few years ago I spent months trying to find a dataset like the one you're requesting. The closest thing I found was a literature search tool called The Trip Database (https://www.tripdatabase.com/). ...
Only top scored, non community-wiki answers of a minimum length are eligible