The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
4
votes
0answers
64 views

Corpus for intention mining

I need a corpus with intention words, but I was not able to get one yet. please somebody help me. Note : I'm new to intention mining if you know some useful corpus or links on intention mining ...
2
votes
0answers
106 views

Creating NER Tagging Benchmark Corpus

I am trying to test one name entity tagger. I am using NLTK's nltk.HiddenMarkovModelTagger.train(trains) which requires data in Brown corpus's tagged_sents() format. I was looking for a free ...
4
votes
3answers
1k views

Datasets: Is there any public data-set for FAQ (Frequently asked questions) in different domains?

My thesis is about Analysis and Auto generation of FAQ in different domains. For conducting experiments, I need high volume of FAQs. That's the reason I am looking for a publicly available data-set ...
4
votes
2answers
87 views

Where can I find machine readable transcribed text of the 2016 Presidential speeches and debates?

I'm looking for a machine-readable repository of transcribed Presidential debates and speeches from the 2016 general election. Structured data with a common format is desirable, as well as updates for ...
4
votes
1answer
52 views

English queries to GIS systems

I'm building a system that tries to answer geospatial English questions such as "Where is the closest restaurant" or "How many historic sites are in the east of Nantes?". Underlying database is OSM. ...
11
votes
7answers
5k views

Large French dataset for NLP (not formal, rather discussions/reviews)

What am I looking for ? I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias). Why this ...
1
vote
0answers
166 views

Labeled dataset for sentiment analysis

I am doing my research on sentiment analysis for Standard Mandarin. I don't have any benchmark dataset. I need usable labeled dataset for my research.
5
votes
1answer
236 views

Actual text and corrected text? Or autocorrect data?

I seek essentially a parallel corpora, which has the dirty original user-generated input on the one side, and a cleaned up version on the other side - with corrected spelling, casing, punctuation and ...
6
votes
4answers
2k views

Tool to extract the main concepts/topics from web pages

I need to find the main themes or topics for each of 50,000 website urls. For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc. I'm ...
3
votes
0answers
56 views

User complaint/review description for running nlp-ner on telecom(preferably) data

I am looking for Consumer complaint/review description data which is not generated from automatic logs but manually entered by the end-user/customer-support. The objective is to run the Stanford NLP-...
1
vote
1answer
181 views

Dataset listing datasets for natural language processing

I am looking for a dataset listing datasets for natural language processing with as many following fields as possible: name annotations (e.g., part of speech, dependency parses, or named entities) ...
1
vote
0answers
67 views

Neutral sentiments training set - Resources

I'm training a sentiment classifier based on DNN. Currently my training set is made out of 45% positive sentiments, 45% negative sentiments and only 10% of neutral sentiments. As you probably guess, ...
4
votes
0answers
56 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
3
votes
1answer
124 views

Dataset of documents and user libraries

I'm looking for a decently sized dataset (more than 100k docs) which consists of bag of words documents along with a list of users where associated to each user is a list of those documents the user ...
3
votes
1answer
89 views

Natural language corpora dataset with time stamps

I'm looking for a dataset of documents (bag of words style is fine) which include time stamps. I also need it to be semi-coherent, for instance a years worth of news articles which all focus on the ...
4
votes
2answers
360 views

Semantic dictionary of English language

I am looking for a dictionary of English words tagged with their semantics. Like: red t:color green t:color long t:size t:max huge t:size t:max tiny t:size t:min hot ...
2
votes
1answer
118 views

Where can I find data set of tweets of users? [duplicate]

I am doing a project "Emotional prediction of user based on tweets", using data mining techniques. For this purpose, I need a data set of tweets of users. Please help.
4
votes
2answers
37 views

Non-ASCII Unicode symbols with their word equivalents

I am looking for a dataset containing Unicode symbols with some word equivalent. Examples: ©: copyright €: euro √: square root
1
vote
0answers
67 views

is there data sets for emojis?

I am looking for research data on emoji. I found a real-time data source that I could scrape myself but I am wondering if someone already scraped the twitter firehose http://emojitracker.com/
3
votes
0answers
38 views

Where to find medical related data?

I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these: a.) A collection (I mean ...
1
vote
0answers
59 views

Customer Review Dataset with Label Classification

I am trying to check my model with the current state of the art models. I want a dataset with customer reviews and their corresponding class assigned. For example, a review like The car was very badly ...
2
votes
1answer
178 views

Dialogs with labeled slot(s)-value(s)

I am looking for data sets containing dialogues labeled with slot-values. I am open as to the definition of a dialogue, e.g. message board posts are good too. Definition of slot-values: A dialog is ...
1
vote
1answer
47 views

Dataset of shell commands with corresponding sentences

I'm looking for datasets that contain a list of shell commands (any kind of shell: bash, sh, Windows shell, …) where each shell command is associated with at least one sentence written in English ...
1
vote
0answers
29 views

ThemeClassification Datasets - Clean Versions

I am looking for some small datasets to do theme classification on text for example like reuters, 20ng with benchmarking and also their clean versions. I found one very useful site - Dataset. I want ...
1
vote
1answer
98 views

Factoid question-answer pairs based on tables

I am looking for a data set that contains factoid question-answer pairs based on tables. Example: Table: Question: what is the capital of Egypt? Answer: Cairo Tables could be HTML, PDF or latex. I ...
6
votes
2answers
1k views

German news/text data set

I am looking for (possible buy) a dataset of German news data (i.e., the largest daily newspapers), where the data span at least ten years back up until now/recent. Any tips?
1
vote
1answer
30 views

feature importance analysis [closed]

I am having a very hard time in analysis of my features importance. What I am doing is I have 4 features and I incrementally add the features to see the effect of each feature on the final result. ...
5
votes
2answers
100 views

Are there translation probabilities for major language pairs?

Are there reasonable alignment probability files for major language pairs? Specifically, given a target language and a target word/phrase, what are the translation equivalents in other major ...
17
votes
4answers
10k views

Downloading the Panama Papers

I wonder where the Panama Papers can be downloaded. I have looked around, I couldn't find them. Where can I find them? What is the legality, and sensibility of requesting and downloading leaked ...
6
votes
1answer
209 views

British Newspaper Archive

Anyone know if there is a way to obtain the OCR txt files from the British Newspaper Archive via some bulk download API? Some more details: This is the British Newspaper Archive: http://www....
3
votes
1answer
428 views

Looking for text-to-phoneme or pronunciation data for English words

I am looking for data of text and their corresponding phonemes for the purpose of training a classification tree and a neural network. Example: cat = k-a-t or something similar I am looking for at ...
9
votes
5answers
334 views

Data set of news articles and scientific journals

I am working on a project in NLP area and in order to test the result I need to compare it against different data sources. I already have NYTimes data source. So, I am looking for another news source ...
7
votes
4answers
243 views

Most common words in English

I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
1
vote
1answer
97 views

Where can i find domain specific data set of opinion tweets about a product/brand?

I am working on a project to find the opinion of a product/brand on twitter. Is there any sample dataset of opnion base tweets ? If possible labelled data - Positive/negative/neutral
1
vote
1answer
1k views

Any data set available for Twitter tweets classification?

Is there any dataset available for different categories like music, politics, business etc which can be used to classify input tweets?
1
vote
1answer
1k views

Dataset of common typos in English

I am looking for a dataset of common typos in English. Ideally, it should mention the frequency of typo.
1
vote
0answers
103 views

Customer review dataset

I would like to get customer review data set like amazon customer review data. I would like to have rather unique review data instead of amazon review data, because amazon data sets have been ...
3
votes
1answer
134 views

Sentence segmentation dataset

I am looking for datasets that contain texts as well as notations for sentence boundaries. I plan to use it to assess a sentence segmentation system. I am mostly interested in texts in English at the ...
1
vote
1answer
1k views

Where can I get annotated data set for training date and time NER in opennlp?

I need to build a model to extract the calendar event information from text format. The model should be able to detect the data and time in any format. Is there any annotated data set for data and ...
1
vote
0answers
90 views

How many sample sentences are required to train a model in opennlp?

I need to create my own model in opennlp. I have to create my own dataset since I couldn't get calendar events dataset. Can anyone tell how many sample sentences are required to train a model? ...
4
votes
1answer
496 views

Where can I get calendar events dataset in text format?

I need to create a model in opennlp for identifying event information in text. I need a calendar events dataset for training this model. Can someone suggest any available open source dataset for ...
4
votes
1answer
639 views

Datasets based on casual conversations for chatterbots

I am building a chatterbot that can answer questions related to tennis. I wish to know if there any any available datasets than can answer casual questions like "How are you", "How is the weather ...
2
votes
0answers
30 views

Data on press conferences from English-speaking press conferences

I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
3
votes
0answers
251 views

Medical text corpus

This should be a simple question to many in the area, but for the life of me I can't find a solution by myself. I need a corpus of medical text for the purposes of training a spell checker which will ...
4
votes
1answer
296 views

Recommendation letter dataset

I am looking for a dataset containing academic recommendation letters, written in English, with as many following fields as possible: content of the letter date of the letter purpose of the letter (...
1
vote
0answers
57 views

Dataset of regular expressions for named entity recognition

I am looking for a dataset containing: regular expressions useful for named entity recognition. The regular expressions can be used either as a feature or directly as a rule (in case it always ...
5
votes
1answer
3k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
1
vote
0answers
28 views

where can i download archives of eclipse,ibm jazz and mozilla

Where can i find and download bug reports, mailing list archives,execution logs,test cases,for the following projects? 1.Eclipse 2.Ibm jazz and 3.Mozilla
3
votes
1answer
89 views

“Fuzzy” search of Mediawiki Commons categories

I am developing an app that lets smartphone users upload a picture to Wikimedia Commons. The user must categorize the picture by typing Commons category names. Typing on a smartphone is slow/painful/...
5
votes
2answers
98 views

Downloadable word embeddings

I am looking for downloadable word embeddings (a.k.a. word vectors, distributed word representations). I'm aware of: word2vec GloVe SENNA as well as the retrofitting tool. What else is available?