Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
3
votes
0answers
121 views

Health forum data sets

I am looking for data sets that contain health-related forum posts. Ideally, with as much structured information as possible (post, post timestamp, poster ID, history of edits, etc.). I know I can ...
12
votes
4answers
6k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
3
votes
3answers
3k views

Data sets for short text classification

I am looking for short text classifications (multilabel is OK). By short text I mean ~50 words max. The data set used in Xin Li, Dan Roth. Learning Question Classifiers. COLING. 2002. is a good ...
2
votes
0answers
61 views

Factoid question answer data sets with text containing the answer

I am looking for factoid question answer data sets. Each sample should contain a question, an answer, and a text where the answer can be derived from.
6
votes
1answer
277 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
2
votes
1answer
183 views

Dialogs with labeled slot(s)-value(s)

I am looking for data sets containing dialogues labeled with slot-values. I am open as to the definition of a dialogue, e.g. message board posts are good too. Definition of slot-values: A dialog is ...
5
votes
2answers
410 views

Open text document corpus for information retrieval evaluation

INTRODUCTION: document collections (corpora) for evaluation of information retrieval (search engine) systems are pretty often behind a paywall. A notorious example is the TREC conference (http://trec....
4
votes
3answers
3k views

Dataset for english words of dictionary for a NLP project

I am working on a NLP project, and for that I need a dataset of English words (words typically found in dictionary). Could somebody please guide me how to put together such dataset? Is there any ...
2
votes
0answers
97 views

Speech act prediction data sets

I am looking for data sets containing dialogues labeled with speech acts. I am open as to the definition of a dialogue, e.g. message board posts are good too (1). Example (FOL, QST, and RES are ...
7
votes
1answer
2k views

Spanish Sentiment Dataset

I'm looking for a Spanish language corpus tagged with sentiment (just positive & negative are needed, though neutral might be helpful.) I could use a Twitter dataset, but I'd prefer to use ...
3
votes
2answers
2k views

Offensive words - English and Spanish

Have a system generating four letter code and in testing just got up to AA-BJ ... and the BJ got me thinking. In a while the one after AR-SD could cause offence in the UK! Does anyone know of a list ...
4
votes
3answers
1k views

Datasets: Is there any public data-set for FAQ (Frequently asked questions) in different domains?

My thesis is about Analysis and Auto generation of FAQ in different domains. For conducting experiments, I need high volume of FAQs. That's the reason I am looking for a publicly available data-set ...
10
votes
1answer
803 views

Where can I find a part-of-speech corpus free for commercial use?

I'm looking to teach myself more about NLP. I started with NLTK and I see that it has potential to eventually become something I could get paid for. From there, my journey continued to reading this ...
4
votes
2answers
47 views

Are there opendatasets of English terms describing nationalities, ethnicities?

Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
2
votes
0answers
41 views

Temporal discrete data with ground truth labels for clustering purpose

I would like to know if there is any temporal discrete data-set available with the ground truth labels. The goal is to test the performance of the temporal/evolutionary clustering methods, such as the ...
1
vote
1answer
1k views

Any data set available for Twitter tweets classification?

Is there any dataset available for different categories like music, politics, business etc which can be used to classify input tweets?
3
votes
2answers
881 views

SQL queries dataset

I am looking for a dataset containing natural language sentences (English preferred) and their corresponding SQL queries. E.g. "What are the names of the employees who live in Los Angeles" could be ...
9
votes
5answers
335 views

Data set of news articles and scientific journals

I am working on a project in NLP area and in order to test the result I need to compare it against different data sources. I already have NYTimes data source. So, I am looking for another news source ...
4
votes
1answer
53 views

License for data product of music lyrics?

I am interested in doing some natural language processing on copyrighted song lyrics. I saw a related project here, http://rappers.mdaniels.com.s3-website-us-east-1.amazonaws.com/ who used rap.genius....
5
votes
4answers
110 views

Tagged addresses

Does anyone know of a corpus of US addresses where the parts of the addresses have been tagged. Something like <streetNumber>123</streetNumber> <streetDirection>E.</...
7
votes
2answers
312 views

French equivalent of the brown corpus

The brown corpus is a collection of text where each element is already gramatically tagged. It contains about one million words and is often used to train statistical PoS taggers. For the french ...
2
votes
0answers
68 views

Dataset of regexps with corresponding sentences

I'm looking for datasets that contain a list of regexps where each regexp is associated with at least one sentence written in English that explains what the regexp does. Examples: "All 3-letter words ...
11
votes
7answers
5k views

Large French dataset for NLP (not formal, rather discussions/reviews)

What am I looking for ? I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias). Why this ...
5
votes
2answers
293 views

Do you know a technique for text mining judicial decisions?

I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
24
votes
6answers
28k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
7
votes
4answers
2k views

Tool to extract the main concepts/topics from web pages

I need to find the main themes or topics for each of 50,000 website urls. For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc. I'm ...