Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
2
votes
2answers
69 views

Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?

I am working on cleaning various natural language artifacts of open source software. I was able to download mailing list archives. Can anyone suggest where I can get other artifacts such as IRC chat ...
4
votes
0answers
226 views

Publicly available dataset of physician notes

I am looking for a publicly available data set of physician notes that describe medical reasoning, ideally freetext indexed by the level of training of the author. MIMIC-III has physiologic data, ...
4
votes
3answers
3k views

Dataset for english words of dictionary for a NLP project

I am working on a NLP project, and for that I need a dataset of English words (words typically found in dictionary). Could somebody please guide me how to put together such dataset? Is there any ...
6
votes
2answers
97 views

Huge Biomedical Corpus for Unsupervised Experiments

I am looking for a very large collection ( > 10 GB) of biomedical text documents to run some unsupervised experiments with (for recognizing drug names, etc). Do we have access to such a thing for free?...
4
votes
3answers
94 views

Looking for conversation transcripts

I am looking for conversation transcripts. These can be from real sources such as radio or TV interviews, or even phone and IM captures, or fictional conversations such as plays and movies. I don't ...
2
votes
0answers
31 views

Data set of objects with properties

I am looking for data sets containing a list of objects or concepts as well as some of the properties. Example 1: #Format: [identifier][concept][feature][annotator1][annotator2][annotator3] 1 ...
3
votes
0answers
118 views

Health forum data sets

I am looking for data sets that contain health-related forum posts. Ideally, with as much structured information as possible (post, post timestamp, poster ID, history of edits, etc.). I know I can ...
10
votes
1answer
786 views

Where can I find a part-of-speech corpus free for commercial use?

I'm looking to teach myself more about NLP. I started with NLTK and I see that it has potential to eventually become something I could get paid for. From there, my journey continued to reading this ...
5
votes
2answers
393 views

Open text document corpus for information retrieval evaluation

INTRODUCTION: document collections (corpora) for evaluation of information retrieval (search engine) systems are pretty often behind a paywall. A notorious example is the TREC conference (http://trec....
6
votes
0answers
271 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
2
votes
0answers
61 views

Factoid question answer data sets with text containing the answer

I am looking for factoid question answer data sets. Each sample should contain a question, an answer, and a text where the answer can be derived from.
7
votes
2answers
300 views

French equivalent of the brown corpus

The brown corpus is a collection of text where each element is already gramatically tagged. It contains about one million words and is often used to train statistical PoS taggers. For the french ...
3
votes
2answers
863 views

SQL queries dataset

I am looking for a dataset containing natural language sentences (English preferred) and their corresponding SQL queries. E.g. "What are the names of the employees who live in Los Angeles" could be ...
2
votes
0answers
94 views

Speech act prediction data sets

I am looking for data sets containing dialogues labeled with speech acts. I am open as to the definition of a dialogue, e.g. message board posts are good too (1). Example (FOL, QST, and RES are ...
3
votes
2answers
2k views

Offensive words - English and Spanish

Have a system generating four letter code and in testing just got up to AA-BJ ... and the BJ got me thinking. In a while the one after AR-SD could cause offence in the UK! Does anyone know of a list ...
4
votes
2answers
44 views

Are there opendatasets of English terms describing nationalities, ethnicities?

Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
5
votes
2answers
291 views

Do you know a technique for text mining judicial decisions?

I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
4
votes
1answer
53 views

License for data product of music lyrics?

I am interested in doing some natural language processing on copyrighted song lyrics. I saw a related project here, http://rappers.mdaniels.com.s3-website-us-east-1.amazonaws.com/ who used rap.genius....
5
votes
4answers
107 views

Tagged addresses

Does anyone know of a corpus of US addresses where the parts of the addresses have been tagged. Something like <streetNumber>123</streetNumber> <streetDirection>E.</...
2
votes
0answers
68 views

Dataset of regexps with corresponding sentences

I'm looking for datasets that contain a list of regexps where each regexp is associated with at least one sentence written in English that explains what the regexp does. Examples: "All 3-letter words ...