The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
3
votes
1answer
124 views

Dataset of documents and user libraries

I'm looking for a decently sized dataset (more than 100k docs) which consists of bag of words documents along with a list of users where associated to each user is a list of those documents the user ...
2
votes
1answer
118 views

Where can I find data set of tweets of users? [duplicate]

I am doing a project "Emotional prediction of user based on tweets", using data mining techniques. For this purpose, I need a data set of tweets of users. Please help.
4
votes
2answers
37 views

Non-ASCII Unicode symbols with their word equivalents

I am looking for a dataset containing Unicode symbols with some word equivalent. Examples: ©: copyright €: euro √: square root
1
vote
0answers
67 views

is there data sets for emojis?

I am looking for research data on emoji. I found a real-time data source that I could scrape myself but I am wondering if someone already scraped the twitter firehose http://emojitracker.com/
4
votes
2answers
356 views

Semantic dictionary of English language

I am looking for a dictionary of English words tagged with their semantics. Like: red t:color green t:color long t:size t:max huge t:size t:max tiny t:size t:min hot ...
3
votes
0answers
38 views

Where to find medical related data?

I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these: a.) A collection (I mean ...
1
vote
0answers
59 views

Customer Review Dataset with Label Classification

I am trying to check my model with the current state of the art models. I want a dataset with customer reviews and their corresponding class assigned. For example, a review like The car was very badly ...
1
vote
0answers
29 views

ThemeClassification Datasets - Clean Versions

I am looking for some small datasets to do theme classification on text for example like reuters, 20ng with benchmarking and also their clean versions. I found one very useful site - Dataset. I want ...
1
vote
1answer
47 views

Dataset of shell commands with corresponding sentences

I'm looking for datasets that contain a list of shell commands (any kind of shell: bash, sh, Windows shell, …) where each shell command is associated with at least one sentence written in English ...
1
vote
1answer
98 views

Factoid question-answer pairs based on tables

I am looking for a data set that contains factoid question-answer pairs based on tables. Example: Table: Question: what is the capital of Egypt? Answer: Cairo Tables could be HTML, PDF or latex. I ...
1
vote
1answer
30 views

feature importance analysis [closed]

I am having a very hard time in analysis of my features importance. What I am doing is I have 4 features and I incrementally add the features to see the effect of each feature on the final result. ...
3
votes
1answer
89 views

Natural language corpora dataset with time stamps

I'm looking for a dataset of documents (bag of words style is fine) which include time stamps. I also need it to be semi-coherent, for instance a years worth of news articles which all focus on the ...
5
votes
2answers
100 views

Are there translation probabilities for major language pairs?

Are there reasonable alignment probability files for major language pairs? Specifically, given a target language and a target word/phrase, what are the translation equivalents in other major ...
3
votes
1answer
426 views

Looking for text-to-phoneme or pronunciation data for English words

I am looking for data of text and their corresponding phonemes for the purpose of training a classification tree and a neural network. Example: cat = k-a-t or something similar I am looking for at ...
3
votes
1answer
2k views

word2vec Analogy Task Data Set

Word2Vec is famous for demonstrating local linear properties on analogy tasks. The task and dataset were introduced in Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig , Linguistic Regularities in ...
6
votes
1answer
209 views

British Newspaper Archive

Anyone know if there is a way to obtain the OCR txt files from the British Newspaper Archive via some bulk download API? Some more details: This is the British Newspaper Archive: http://www....
1
vote
1answer
181 views

Dataset listing datasets for natural language processing

I am looking for a dataset listing datasets for natural language processing with as many following fields as possible: name annotations (e.g., part of speech, dependency parses, or named entities) ...
1
vote
1answer
97 views

Where can i find domain specific data set of opinion tweets about a product/brand?

I am working on a project to find the opinion of a product/brand on twitter. Is there any sample dataset of opnion base tweets ? If possible labelled data - Positive/negative/neutral
1
vote
0answers
103 views

Customer review dataset

I would like to get customer review data set like amazon customer review data. I would like to have rather unique review data instead of amazon review data, because amazon data sets have been ...
1
vote
1answer
1k views

Dataset of common typos in English

I am looking for a dataset of common typos in English. Ideally, it should mention the frequency of typo.
3
votes
1answer
134 views

Sentence segmentation dataset

I am looking for datasets that contain texts as well as notations for sentence boundaries. I plan to use it to assess a sentence segmentation system. I am mostly interested in texts in English at the ...
17
votes
4answers
10k views

Downloading the Panama Papers

I wonder where the Panama Papers can be downloaded. I have looked around, I couldn't find them. Where can I find them? What is the legality, and sensibility of requesting and downloading leaked ...
7
votes
4answers
243 views

Most common words in English

I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
1
vote
1answer
135 views

Text annotation tool dataset

I am looking for a dataset containing text annotation tools, with as many following fields as possible: name of the tool date of first release date of last release programming language license price ...
1
vote
0answers
90 views

How many sample sentences are required to train a model in opennlp?

I need to create my own model in opennlp. I have to create my own dataset since I couldn't get calendar events dataset. Can anyone tell how many sample sentences are required to train a model? ...
1
vote
1answer
1k views

Where can I get annotated data set for training date and time NER in opennlp?

I need to build a model to extract the calendar event information from text format. The model should be able to detect the data and time in any format. Is there any annotated data set for data and ...
4
votes
1answer
495 views

Where can I get calendar events dataset in text format?

I need to create a model in opennlp for identifying event information in text. I need a calendar events dataset for training this model. Can someone suggest any available open source dataset for ...
2
votes
0answers
30 views

Data on press conferences from English-speaking press conferences

I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
4
votes
1answer
638 views

Datasets based on casual conversations for chatterbots

I am building a chatterbot that can answer questions related to tennis. I wish to know if there any any available datasets than can answer casual questions like "How are you", "How is the weather ...
3
votes
0answers
251 views

Medical text corpus

This should be a simple question to many in the area, but for the life of me I can't find a solution by myself. I need a corpus of medical text for the purposes of training a spell checker which will ...
4
votes
1answer
296 views

Recommendation letter dataset

I am looking for a dataset containing academic recommendation letters, written in English, with as many following fields as possible: content of the letter date of the letter purpose of the letter (...
1
vote
0answers
57 views

Dataset of regular expressions for named entity recognition

I am looking for a dataset containing: regular expressions useful for named entity recognition. The regular expressions can be used either as a feature or directly as a rule (in case it always ...
4
votes
1answer
3k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
1
vote
0answers
28 views

where can i download archives of eclipse,ibm jazz and mozilla

Where can i find and download bug reports, mailing list archives,execution logs,test cases,for the following projects? 1.Eclipse 2.Ibm jazz and 3.Mozilla
6
votes
2answers
1k views

German news/text data set

I am looking for (possible buy) a dataset of German news data (i.e., the largest daily newspapers), where the data span at least ten years back up until now/recent. Any tips?
7
votes
1answer
131 views

Corpus of human-scored machine translations?

Most of the parallel corpora (Opus, EuroParl, OpenSubtitles) have only human translations. src_txt | human_trans_of_src_txt_into_trg_lng (We assume all the translations are good.) Is there a corpus ...
2
votes
2answers
70 views

Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?

I am working on cleaning various natural language artifacts of open source software. I was able to download mailing list archives. Can anyone suggest where I can get other artifacts such as IRC chat ...
5
votes
2answers
98 views

Downloadable word embeddings

I am looking for downloadable word embeddings (a.k.a. word vectors, distributed word representations). I'm aware of: word2vec GloVe SENNA as well as the retrofitting tool. What else is available?
3
votes
1answer
635 views

Physician notes with annotated PHI

I am looking for a data set of physician notes with annotated PHI (protected health information) as defined in Health Insurance Portability and Accountability Act (HIPAA)'s de-identification guide (US ...
4
votes
0answers
245 views

Publicly available dataset of physician notes

I am looking for a publicly available data set of physician notes that describe medical reasoning, ideally freetext indexed by the level of training of the author. MIMIC-III has physiologic data, ...
8
votes
2answers
2k views

Medical Terminology in Patient Medical Records - Public Data Sets

I am interested in sample data of real patient medical records (anonymized or demographics removed completely) for the purpose of running through NLP system - specifically diagnoses, admissions and ...
6
votes
2answers
97 views

Huge Biomedical Corpus for Unsupervised Experiments

I am looking for a very large collection ( > 10 GB) of biomedical text documents to run some unsupervised experiments with (for recognizing drug names, etc). Do we have access to such a thing for free?...
4
votes
3answers
96 views

Looking for conversation transcripts

I am looking for conversation transcripts. These can be from real sources such as radio or TV interviews, or even phone and IM captures, or fictional conversations such as plays and movies. I don't ...
2
votes
0answers
31 views

Data set of objects with properties

I am looking for data sets containing a list of objects or concepts as well as some of the properties. Example 1: #Format: [identifier][concept][feature][annotator1][annotator2][annotator3] 1 ...
3
votes
1answer
89 views

“Fuzzy” search of Mediawiki Commons categories

I am developing an app that lets smartphone users upload a picture to Wikimedia Commons. The user must categorize the picture by typing Commons category names. Typing on a smartphone is slow/painful/...
3
votes
0answers
119 views

Health forum data sets

I am looking for data sets that contain health-related forum posts. Ideally, with as much structured information as possible (post, post timestamp, poster ID, history of edits, etc.). I know I can ...
12
votes
4answers
6k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
3
votes
3answers
3k views

Data sets for short text classification

I am looking for short text classifications (multilabel is OK). By short text I mean ~50 words max. The data set used in Xin Li, Dan Roth. Learning Question Classifiers. COLING. 2002. is a good ...
2
votes
0answers
61 views

Factoid question answer data sets with text containing the answer

I am looking for factoid question answer data sets. Each sample should contain a question, an answer, and a text where the answer can be derived from.
6
votes
0answers
272 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...