Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
3
votes
1answer
550 views

Where can I get calendar events dataset in text format?

I need to create a model in opennlp for identifying event information in text. I need a calendar events dataset for training this model. Can someone suggest any available open source dataset for ...
4
votes
1answer
656 views

Datasets based on casual conversations for chatterbots

I am building a chatterbot that can answer questions related to tennis. I wish to know if there any any available datasets than can answer casual questions like "How are you", "How is the weather ...
2
votes
0answers
30 views

Data on press conferences from English-speaking press conferences

I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
3
votes
0answers
268 views

Medical text corpus

This should be a simple question to many in the area, but for the life of me I can't find a solution by myself. I need a corpus of medical text for the purposes of training a spell checker which will ...
1
vote
0answers
57 views

Dataset of regular expressions for named entity recognition

I am looking for a dataset containing: regular expressions useful for named entity recognition. The regular expressions can be used either as a feature or directly as a rule (in case it always ...
6
votes
1answer
3k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
1
vote
0answers
28 views

where can i download archives of eclipse,ibm jazz and mozilla

Where can i find and download bug reports, mailing list archives,execution logs,test cases,for the following projects? 1.Eclipse 2.Ibm jazz and 3.Mozilla
3
votes
1answer
90 views

“Fuzzy” search of Mediawiki Commons categories

I am developing an app that lets smartphone users upload a picture to Wikimedia Commons. The user must categorize the picture by typing Commons category names. Typing on a smartphone is slow/painful/...
5
votes
2answers
103 views

Downloadable word embeddings

I am looking for downloadable word embeddings (a.k.a. word vectors, distributed word representations). I'm aware of: word2vec GloVe SENNA as well as the retrofitting tool. What else is available?
2
votes
2answers
70 views

Where can I find natural language artifacts (requirements document, design documents, change requests) of open source software?

I am working on cleaning various natural language artifacts of open source software. I was able to download mailing list archives. Can anyone suggest where I can get other artifacts such as IRC chat ...
5
votes
0answers
303 views

Publicly available dataset of physician notes

I am looking for a publicly available data set of physician notes that describe medical reasoning, ideally freetext indexed by the level of training of the author. MIMIC-III has physiologic data, ...
4
votes
3answers
3k views

Dataset for english words of dictionary for a NLP project

I am working on a NLP project, and for that I need a dataset of English words (words typically found in dictionary). Could somebody please guide me how to put together such dataset? Is there any ...
5
votes
2answers
97 views

Huge Biomedical Corpus for Unsupervised Experiments

I am looking for a very large collection ( > 10 GB) of biomedical text documents to run some unsupervised experiments with (for recognizing drug names, etc). Do we have access to such a thing for free?...
4
votes
3answers
97 views

Looking for conversation transcripts

I am looking for conversation transcripts. These can be from real sources such as radio or TV interviews, or even phone and IM captures, or fictional conversations such as plays and movies. I don't ...
2
votes
0answers
31 views

Data set of objects with properties

I am looking for data sets containing a list of objects or concepts as well as some of the properties. Example 1: #Format: [identifier][concept][feature][annotator1][annotator2][annotator3] 1 ...
3
votes
0answers
126 views

Health forum data sets

I am looking for data sets that contain health-related forum posts. Ideally, with as much structured information as possible (post, post timestamp, poster ID, history of edits, etc.). I know I can ...
10
votes
1answer
817 views

Where can I find a part-of-speech corpus free for commercial use?

I'm looking to teach myself more about NLP. I started with NLTK and I see that it has potential to eventually become something I could get paid for. From there, my journey continued to reading this ...
5
votes
2answers
417 views

Open text document corpus for information retrieval evaluation

INTRODUCTION: document collections (corpora) for evaluation of information retrieval (search engine) systems are pretty often behind a paywall. A notorious example is the TREC conference (http://trec....
2
votes
0answers
61 views

Factoid question answer data sets with text containing the answer

I am looking for factoid question answer data sets. Each sample should contain a question, an answer, and a text where the answer can be derived from.
7
votes
2answers
319 views

French equivalent of the brown corpus

The brown corpus is a collection of text where each element is already gramatically tagged. It contains about one million words and is often used to train statistical PoS taggers. For the french ...
3
votes
2answers
894 views

SQL queries dataset

I am looking for a dataset containing natural language sentences (English preferred) and their corresponding SQL queries. E.g. "What are the names of the employees who live in Los Angeles" could be ...
2
votes
0answers
98 views

Speech act prediction data sets

I am looking for data sets containing dialogues labeled with speech acts. I am open as to the definition of a dialogue, e.g. message board posts are good too (1). Example (FOL, QST, and RES are ...
3
votes
2answers
2k views

Offensive words - English and Spanish

Have a system generating four letter code and in testing just got up to AA-BJ ... and the BJ got me thinking. In a while the one after AR-SD could cause offence in the UK! Does anyone know of a list ...
4
votes
2answers
47 views

Are there opendatasets of English terms describing nationalities, ethnicities?

Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
5
votes
2answers
295 views

Do you know a technique for text mining judicial decisions?

I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
4
votes
1answer
54 views

License for data product of music lyrics?

I am interested in doing some natural language processing on copyrighted song lyrics. I saw a related project here, http://rappers.mdaniels.com.s3-website-us-east-1.amazonaws.com/ who used rap.genius....
5
votes
4answers
110 views

Tagged addresses

Does anyone know of a corpus of US addresses where the parts of the addresses have been tagged. Something like <streetNumber>123</streetNumber> <streetDirection>E.</...
2
votes
0answers
68 views

Dataset of regexps with corresponding sentences

I'm looking for datasets that contain a list of regexps where each regexp is associated with at least one sentence written in English that explains what the regexp does. Examples: "All 3-letter words ...

1 2 3