Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
3
votes
4answers
3k views

Where can I find a dataset containing legal documents?

I have a machine learning task I wish to pursue. For the task I will need several hundred sample legal documents of the following types: Employment contract, service contract, sale contract, rental ...
3
votes
0answers
56 views

User complaint/review description for running nlp-ner on telecom(preferably) data

I am looking for Consumer complaint/review description data which is not generated from automatic logs but manually entered by the end-user/customer-support. The objective is to run the Stanford NLP-...
1
vote
0answers
67 views

Neutral sentiments training set - Resources

I'm training a sentiment classifier based on DNN. Currently my training set is made out of 45% positive sentiments, 45% negative sentiments and only 10% of neutral sentiments. As you probably guess, ...
4
votes
0answers
58 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
3
votes
1answer
124 views

Dataset of documents and user libraries

I'm looking for a decently sized dataset (more than 100k docs) which consists of bag of words documents along with a list of users where associated to each user is a list of those documents the user ...
2
votes
1answer
119 views

Where can I find data set of tweets of users? [duplicate]

I am doing a project "Emotional prediction of user based on tweets", using data mining techniques. For this purpose, I need a data set of tweets of users. Please help.
4
votes
2answers
37 views

Non-ASCII Unicode symbols with their word equivalents

I am looking for a dataset containing Unicode symbols with some word equivalent. Examples: ©: copyright €: euro √: square root
1
vote
0answers
67 views

is there data sets for emojis?

I am looking for research data on emoji. I found a real-time data source that I could scrape myself but I am wondering if someone already scraped the twitter firehose http://emojitracker.com/
4
votes
2answers
421 views

Semantic dictionary of English language

I am looking for a dictionary of English words tagged with their semantics. Like: red t:color green t:color long t:size t:max huge t:size t:max tiny t:size t:min hot ...
3
votes
0answers
38 views

Where to find medical related data?

I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these: a.) A collection (I mean ...
1
vote
0answers
59 views

Customer Review Dataset with Label Classification

I am trying to check my model with the current state of the art models. I want a dataset with customer reviews and their corresponding class assigned. For example, a review like The car was very badly ...
1
vote
0answers
29 views

ThemeClassification Datasets - Clean Versions

I am looking for some small datasets to do theme classification on text for example like reuters, 20ng with benchmarking and also their clean versions. I found one very useful site - Dataset. I want ...
1
vote
1answer
47 views

Dataset of shell commands with corresponding sentences

I'm looking for datasets that contain a list of shell commands (any kind of shell: bash, sh, Windows shell, …) where each shell command is associated with at least one sentence written in English ...
1
vote
1answer
98 views

Factoid question-answer pairs based on tables

I am looking for a data set that contains factoid question-answer pairs based on tables. Example: Table: Question: what is the capital of Egypt? Answer: Cairo Tables could be HTML, PDF or latex. I ...
1
vote
1answer
30 views

feature importance analysis [closed]

I am having a very hard time in analysis of my features importance. What I am doing is I have 4 features and I incrementally add the features to see the effect of each feature on the final result. ...
3
votes
1answer
90 views

Natural language corpora dataset with time stamps

I'm looking for a dataset of documents (bag of words style is fine) which include time stamps. I also need it to be semi-coherent, for instance a years worth of news articles which all focus on the ...
5
votes
2answers
100 views

Are there translation probabilities for major language pairs?

Are there reasonable alignment probability files for major language pairs? Specifically, given a target language and a target word/phrase, what are the translation equivalents in other major ...
3
votes
1answer
439 views

Looking for text-to-phoneme or pronunciation data for English words

I am looking for data of text and their corresponding phonemes for the purpose of training a classification tree and a neural network. Example: cat = k-a-t or something similar I am looking for at ...
3
votes
1answer
2k views

word2vec Analogy Task Data Set

Word2Vec is famous for demonstrating local linear properties on analogy tasks. The task and dataset were introduced in Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig , Linguistic Regularities in ...
6
votes
1answer
217 views

British Newspaper Archive

Anyone know if there is a way to obtain the OCR txt files from the British Newspaper Archive via some bulk download API? Some more details: This is the British Newspaper Archive: http://www....
1
vote
1answer
181 views

Dataset listing datasets for natural language processing

I am looking for a dataset listing datasets for natural language processing with as many following fields as possible: name annotations (e.g., part of speech, dependency parses, or named entities) ...
1
vote
1answer
98 views

Where can i find domain specific data set of opinion tweets about a product/brand?

I am working on a project to find the opinion of a product/brand on twitter. Is there any sample dataset of opnion base tweets ? If possible labelled data - Positive/negative/neutral
1
vote
0answers
103 views

Customer review dataset

I would like to get customer review data set like amazon customer review data. I would like to have rather unique review data instead of amazon review data, because amazon data sets have been ...
1
vote
1answer
1k views

Dataset of common typos in English

I am looking for a dataset of common typos in English. Ideally, it should mention the frequency of typo.
3
votes
1answer
137 views

Sentence segmentation dataset

I am looking for datasets that contain texts as well as notations for sentence boundaries. I plan to use it to assess a sentence segmentation system. I am mostly interested in texts in English at the ...
17
votes
4answers
10k views

Downloading the Panama Papers

I wonder where the Panama Papers can be downloaded. I have looked around, I couldn't find them. Where can I find them? What is the legality, and sensibility of requesting and downloading leaked ...
7
votes
4answers
248 views

Most common words in English

I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
1
vote
1answer
135 views

Text annotation tool dataset

I am looking for a dataset containing text annotation tools, with as many following fields as possible: name of the tool date of first release date of last release programming language license price ...
1
vote
0answers
90 views

How many sample sentences are required to train a model in opennlp?

I need to create my own model in opennlp. I have to create my own dataset since I couldn't get calendar events dataset. Can anyone tell how many sample sentences are required to train a model? ...
1
vote
1answer
1k views

Where can I get annotated data set for training date and time NER in opennlp?

I need to build a model to extract the calendar event information from text format. The model should be able to detect the data and time in any format. Is there any annotated data set for data and ...
4
votes
1answer
514 views

Where can I get calendar events dataset in text format?

I need to create a model in opennlp for identifying event information in text. I need a calendar events dataset for training this model. Can someone suggest any available open source dataset for ...
2
votes
0answers
30 views

Data on press conferences from English-speaking press conferences

I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
4
votes
1answer
644 views

Datasets based on casual conversations for chatterbots

I am building a chatterbot that can answer questions related to tennis. I wish to know if there any any available datasets than can answer casual questions like "How are you", "How is the weather ...
3
votes
0answers
257 views

Medical text corpus

This should be a simple question to many in the area, but for the life of me I can't find a solution by myself. I need a corpus of medical text for the purposes of training a spell checker which will ...
4
votes
1answer
302 views

Recommendation letter dataset

I am looking for a dataset containing academic recommendation letters, written in English, with as many following fields as possible: content of the letter date of the letter purpose of the letter (...
1
vote
0answers
57 views

Dataset of regular expressions for named entity recognition

I am looking for a dataset containing: regular expressions useful for named entity recognition. The regular expressions can be used either as a feature or directly as a rule (in case it always ...
5
votes
1answer
3k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
1
vote
0answers
28 views

where can i download archives of eclipse,ibm jazz and mozilla

Where can i find and download bug reports, mailing list archives,execution logs,test cases,for the following projects? 1.Eclipse 2.Ibm jazz and 3.Mozilla
6
votes
2answers
1k views

German news/text data set

I am looking for (possible buy) a dataset of German news data (i.e., the largest daily newspapers), where the data span at least ten years back up until now/recent. Any tips?
7
votes
1answer
131 views

Corpus of human-scored machine translations?

Most of the parallel corpora (Opus, EuroParl, OpenSubtitles) have only human translations. src_txt | human_trans_of_src_txt_into_trg_lng (We assume all the translations are good.) Is there a corpus ...
2
votes
2answers
70 views

Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?

I am working on cleaning various natural language artifacts of open source software. I was able to download mailing list archives. Can anyone suggest where I can get other artifacts such as IRC chat ...
5
votes
2answers
100 views

Downloadable word embeddings

I am looking for downloadable word embeddings (a.k.a. word vectors, distributed word representations). I'm aware of: word2vec GloVe SENNA as well as the retrofitting tool. What else is available?
3
votes
1answer
656 views

Physician notes with annotated PHI

I am looking for a data set of physician notes with annotated PHI (protected health information) as defined in Health Insurance Portability and Accountability Act (HIPAA)'s de-identification guide (US ...
4
votes
0answers
263 views

Publicly available dataset of physician notes

I am looking for a publicly available data set of physician notes that describe medical reasoning, ideally freetext indexed by the level of training of the author. MIMIC-III has physiologic data, ...
8
votes
2answers
2k views

Medical Terminology in Patient Medical Records - Public Data Sets

I am interested in sample data of real patient medical records (anonymized or demographics removed completely) for the purpose of running through NLP system - specifically diagnoses, admissions and ...
6
votes
2answers
97 views

Huge Biomedical Corpus for Unsupervised Experiments

I am looking for a very large collection ( > 10 GB) of biomedical text documents to run some unsupervised experiments with (for recognizing drug names, etc). Do we have access to such a thing for free?...
4
votes
3answers
97 views

Looking for conversation transcripts

I am looking for conversation transcripts. These can be from real sources such as radio or TV interviews, or even phone and IM captures, or fictional conversations such as plays and movies. I don't ...
2
votes
0answers
31 views

Data set of objects with properties

I am looking for data sets containing a list of objects or concepts as well as some of the properties. Example 1: #Format: [identifier][concept][feature][annotator1][annotator2][annotator3] 1 ...
3
votes
1answer
90 views

“Fuzzy” search of Mediawiki Commons categories

I am developing an app that lets smartphone users upload a picture to Wikimedia Commons. The user must categorize the picture by typing Commons category names. Typing on a smartphone is slow/painful/...
3
votes
0answers
121 views

Health forum data sets

I am looking for data sets that contain health-related forum posts. Ideally, with as much structured information as possible (post, post timestamp, poster ID, history of edits, etc.). I know I can ...