The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
2
votes
1answer
178 views

Dialogs with labeled slot(s)-value(s)

I am looking for data sets containing dialogues labeled with slot-values. I am open as to the definition of a dialogue, e.g. message board posts are good too. Definition of slot-values: A dialog is ...
5
votes
2answers
399 views

Open text document corpus for information retrieval evaluation

INTRODUCTION: document collections (corpora) for evaluation of information retrieval (search engine) systems are pretty often behind a paywall. A notorious example is the TREC conference (http://trec....
4
votes
3answers
3k views

Dataset for english words of dictionary for a NLP project

I am working on a NLP project, and for that I need a dataset of English words (words typically found in dictionary). Could somebody please guide me how to put together such dataset? Is there any ...
2
votes
0answers
96 views

Speech act prediction data sets

I am looking for data sets containing dialogues labeled with speech acts. I am open as to the definition of a dialogue, e.g. message board posts are good too (1). Example (FOL, QST, and RES are ...
7
votes
1answer
2k views

Spanish Sentiment Dataset

I'm looking for a Spanish language corpus tagged with sentiment (just positive & negative are needed, though neutral might be helpful.) I could use a Twitter dataset, but I'd prefer to use ...
3
votes
2answers
2k views

Offensive words - English and Spanish

Have a system generating four letter code and in testing just got up to AA-BJ ... and the BJ got me thinking. In a while the one after AR-SD could cause offence in the UK! Does anyone know of a list ...
4
votes
3answers
1k views

Datasets: Is there any public data-set for FAQ (Frequently asked questions) in different domains?

My thesis is about Analysis and Auto generation of FAQ in different domains. For conducting experiments, I need high volume of FAQs. That's the reason I am looking for a publicly available data-set ...
10
votes
1answer
796 views

Where can I find a part-of-speech corpus free for commercial use?

I'm looking to teach myself more about NLP. I started with NLTK and I see that it has potential to eventually become something I could get paid for. From there, my journey continued to reading this ...
4
votes
2answers
45 views

Are there opendatasets of English terms describing nationalities, ethnicities?

Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
1
vote
1answer
1k views

Any data set available for Twitter tweets classification?

Is there any dataset available for different categories like music, politics, business etc which can be used to classify input tweets?
3
votes
2answers
872 views

SQL queries dataset

I am looking for a dataset containing natural language sentences (English preferred) and their corresponding SQL queries. E.g. "What are the names of the employees who live in Los Angeles" could be ...
9
votes
5answers
334 views

Data set of news articles and scientific journals

I am working on a project in NLP area and in order to test the result I need to compare it against different data sources. I already have NYTimes data source. So, I am looking for another news source ...
4
votes
1answer
53 views

License for data product of music lyrics?

I am interested in doing some natural language processing on copyrighted song lyrics. I saw a related project here, http://rappers.mdaniels.com.s3-website-us-east-1.amazonaws.com/ who used rap.genius....
5
votes
4answers
110 views

Tagged addresses

Does anyone know of a corpus of US addresses where the parts of the addresses have been tagged. Something like <streetNumber>123</streetNumber> <streetDirection>E.</...
7
votes
2answers
301 views

French equivalent of the brown corpus

The brown corpus is a collection of text where each element is already gramatically tagged. It contains about one million words and is often used to train statistical PoS taggers. For the french ...
2
votes
0answers
68 views

Dataset of regexps with corresponding sentences

I'm looking for datasets that contain a list of regexps where each regexp is associated with at least one sentence written in English that explains what the regexp does. Examples: "All 3-letter words ...
11
votes
7answers
5k views

Large French dataset for NLP (not formal, rather discussions/reviews)

What am I looking for ? I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias). Why this ...
5
votes
2answers
292 views

Do you know a technique for text mining judicial decisions?

I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
24
votes
6answers
27k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
6
votes
4answers
2k views

Tool to extract the main concepts/topics from web pages

I need to find the main themes or topics for each of 50,000 website urls. For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc. I'm ...