Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
1
vote
0answers
40 views

News to Category/Section mapping DataSet

Is there a public dataset which has news articles to various sections/categories mapping? For example: Article 1 (title, text, etc, CATEGORY) Article 2 (title, text, etc, CATEGORY) Article 3 (title, ...
3
votes
3answers
110 views

Need Tagged Data sets for training ML algorithms to classify sentences/reviews into single/multi classes

Need tagged text data of any domain. Preferably generalized and ubiquitous domains such as "Food & Hospitality" (Reviews about the quality of the food, comments about the ambience and service etc. ...
0
votes
1answer
198 views

Torrent for the fastText pre-trained models?

I would like to download the pre-trained models for ~100 languages, which are ~3GB each. (See https://github.com/facebookresearch/fastText/blob/master/pretrained-vectors.md) Is there a utility or ....
2
votes
1answer
51 views

Download OpenOffice/Hunspell dictionaries (.oxt / .dic+.aff) for many languages at once?

I would like dictionaries for the top ~100 languages or so. Manually searching and evaluating the results at https://extensions.openoffice.org manually is quite cumbersome at that scale. Is there a ...
2
votes
1answer
44 views

Aspect Based Sentiment Classification

Are there any services which provide aspect-sentiment of the sentence? If the sentence/review is talking about multiple aspects, all the aspects with their sentiments (Positive, Negative, Neutral ...
1
vote
0answers
29 views

Looking for lots of real texts written by humans with user-metadata

I am an NLP researcher and for the purpose of my ongoing work I need lots of textual data produced by real human beings. It's probably not so hard to obtain, but it's important that it's also contains ...
1
vote
1answer
70 views

Accessible source of social network chat data

Are there any accessible source(s) of actual chatting text between users of any social network? There exist other conversational corpora (for instance, the Berkeley Restaurant Project corpus is one). ...
4
votes
1answer
622 views

Dataset of Sentences Classified by Type?

Where can I find a labeled dataset of sentences classified by type (interrogative and declarative)? I'm particularly lookings for Russian sentences, but other open and labeled datasets of other ...
2
votes
1answer
45 views

Where I can get the datasets containing article with its summarization?

I am trying to create a summarizer as my project and using ANN and AI for trying to get a dataset for the training purpose. Kindly, suggest me where I can get a large dataset for training such a ...
2
votes
0answers
34 views

Collection of datasets for sentence relatedness or stance classification

I have been developing a classifier with machine learning to know if two texts are related or not. By that means, if they are talking about the same topic or not. I have tried to gather data but, so ...
0
votes
1answer
131 views

Is any Dataset for chitchat regional languages in english in watsapp, facebook messenger etc available in tensorflow

I started a project in chatbots for the normal regional languages chatting in english like below , I need a dataset to train my model in tensorflow ,Is any dataset default present in tensorflow or any ...
4
votes
3answers
3k views

Data sets for short text classification

I am looking for short text classifications (multilabel is OK). By short text I mean ~50 words max. The data set used in Xin Li, Dan Roth. Learning Question Classifiers. COLING. 2002. is a good ...
4
votes
1answer
726 views

Physician notes with annotated PHI

I am looking for a data set of physician notes with annotated PHI (protected health information) as defined in Health Insurance Portability and Accountability Act (HIPAA)'s de-identification guide (US ...
2
votes
1answer
71 views

clinical report dataset

I am doing a research on detecting negation cases on medical reports (NLP medical). I need clinical report that contains sentences, patient conditions, patient history, clinical terms, etc Is anyone ...
2
votes
0answers
51 views

Getting cold calls data set

I am looking for cold calls data set for my research . the data should be a audio files of recorded calls .( sales calls ..) Any idea where can I get such data? Thank you in advance
2
votes
0answers
53 views

Does a tagged data set of online news articles and associated comments exist?

First of all I would like to apologise for the length of this question and also for my explanation as it might not use the ideal terms. I am looking for a possible data set that has articles from ...
3
votes
2answers
253 views

Is there any open data-set for sentence segmentation?

I am working on textual analysis of reports in English language. The documents are official records. I requires the sentence level segmentation of text. One way is through regular expression. Other ...
4
votes
0answers
64 views

Corpus for intention mining

I need a corpus with intention words, but I was not able to get one yet. please somebody help me. Note : I'm new to intention mining if you know some useful corpus or links on intention mining ...
2
votes
0answers
112 views

Creating NER Tagging Benchmark Corpus

I am trying to test one name entity tagger. I am using NLTK's nltk.HiddenMarkovModelTagger.train(trains) which requires data in Brown corpus's tagged_sents() format. I was looking for a free ...
3
votes
3answers
1k views

Datasets: Is there any public data-set for FAQ (Frequently asked questions) in different domains?

My thesis is about Analysis and Auto generation of FAQ in different domains. For conducting experiments, I need high volume of FAQs. That's the reason I am looking for a publicly available data-set ...
4
votes
2answers
88 views

Where can I find machine readable transcribed text of the 2016 Presidential speeches and debates?

I'm looking for a machine-readable repository of transcribed Presidential debates and speeches from the 2016 general election. Structured data with a common format is desirable, as well as updates for ...
4
votes
1answer
52 views

English queries to GIS systems

I'm building a system that tries to answer geospatial English questions such as "Where is the closest restaurant" or "How many historic sites are in the east of Nantes?". Underlying database is OSM. ...
11
votes
7answers
5k views

Large French dataset for NLP (not formal, rather discussions/reviews)

What am I looking for ? I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias). Why this ...
1
vote
0answers
166 views

Labeled dataset for sentiment analysis

I am doing my research on sentiment analysis for Standard Mandarin. I don't have any benchmark dataset. I need usable labeled dataset for my research.
5
votes
1answer
248 views

Actual text and corrected text? Or autocorrect data?

I seek essentially a parallel corpora, which has the dirty original user-generated input on the one side, and a cleaned up version on the other side - with corrected spelling, casing, punctuation and ...
7
votes
4answers
2k views

Tool to extract the main concepts/topics from web pages

I need to find the main themes or topics for each of 50,000 website urls. For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc. I'm ...
3
votes
0answers
57 views

User complaint/review description for running nlp-ner on telecom(preferably) data

I am looking for Consumer complaint/review description data which is not generated from automatic logs but manually entered by the end-user/customer-support. The objective is to run the Stanford NLP-...
1
vote
1answer
181 views

Dataset listing datasets for natural language processing

I am looking for a dataset listing datasets for natural language processing with as many following fields as possible: name annotations (e.g., part of speech, dependency parses, or named entities) ...
1
vote
0answers
68 views

Neutral sentiments training set - Resources

I'm training a sentiment classifier based on DNN. Currently my training set is made out of 45% positive sentiments, 45% negative sentiments and only 10% of neutral sentiments. As you probably guess, ...
3
votes
1answer
126 views

Dataset of documents and user libraries

I'm looking for a decently sized dataset (more than 100k docs) which consists of bag of words documents along with a list of users where associated to each user is a list of those documents the user ...
3
votes
1answer
91 views

Natural language corpora dataset with time stamps

I'm looking for a dataset of documents (bag of words style is fine) which include time stamps. I also need it to be semi-coherent, for instance a years worth of news articles which all focus on the ...
4
votes
2answers
619 views

Semantic dictionary of English language

I am looking for a dictionary of English words tagged with their semantics. Like: red t:color green t:color long t:size t:max huge t:size t:max tiny t:size t:min hot ...
2
votes
1answer
119 views

Where can I find data set of tweets of users? [duplicate]

I am doing a project "Emotional prediction of user based on tweets", using data mining techniques. For this purpose, I need a data set of tweets of users. Please help.
4
votes
2answers
37 views

Non-ASCII Unicode symbols with their word equivalents

I am looking for a dataset containing Unicode symbols with some word equivalent. Examples: ©: copyright €: euro √: square root
1
vote
0answers
68 views

is there data sets for emojis?

I am looking for research data on emoji. I found a real-time data source that I could scrape myself but I am wondering if someone already scraped the twitter firehose http://emojitracker.com/
1
vote
0answers
61 views

Customer Review Dataset with Label Classification

I am trying to check my model with the current state of the art models. I want a dataset with customer reviews and their corresponding class assigned. For example, a review like The car was very badly ...
2
votes
1answer
194 views

Dialogs with labeled slot(s)-value(s)

I am looking for data sets containing dialogues labeled with slot-values. I am open as to the definition of a dialogue, e.g. message board posts are good too. Definition of slot-values: A dialog is ...
1
vote
1answer
53 views

Dataset of shell commands with corresponding sentences

I'm looking for datasets that contain a list of shell commands (any kind of shell: bash, sh, Windows shell, …) where each shell command is associated with at least one sentence written in English ...
1
vote
0answers
29 views

ThemeClassification Datasets - Clean Versions

I am looking for some small datasets to do theme classification on text for example like reuters, 20ng with benchmarking and also their clean versions. I found one very useful site - Dataset. I want ...
1
vote
1answer
98 views

Factoid question-answer pairs based on tables

I am looking for a data set that contains factoid question-answer pairs based on tables. Example: Table: Question: what is the capital of Egypt? Answer: Cairo Tables could be HTML, PDF or latex. I ...
6
votes
2answers
1k views

German news/text data set

I am looking for (possible buy) a dataset of German news data (i.e., the largest daily newspapers), where the data span at least ten years back up until now/recent. Any tips?
1
vote
1answer
32 views

feature importance analysis [closed]

I am having a very hard time in analysis of my features importance. What I am doing is I have 4 features and I incrementally add the features to see the effect of each feature on the final result. ...
4
votes
2answers
102 views

Are there translation probabilities for major language pairs?

Are there reasonable alignment probability files for major language pairs? Specifically, given a target language and a target word/phrase, what are the translation equivalents in other major ...
17
votes
4answers
10k views

Downloading the Panama Papers

I wonder where the Panama Papers can be downloaded. I have looked around, I couldn't find them. Where can I find them? What is the legality, and sensibility of requesting and downloading leaked ...
6
votes
1answer
252 views

British Newspaper Archive

Anyone know if there is a way to obtain the OCR txt files from the British Newspaper Archive via some bulk download API? Some more details: This is the British Newspaper Archive: http://www....
2
votes
1answer
450 views

Looking for text-to-phoneme or pronunciation data for English words

I am looking for data of text and their corresponding phonemes for the purpose of training a classification tree and a neural network. Example: cat = k-a-t or something similar I am looking for at ...
9
votes
5answers
349 views

Data set of news articles and scientific journals

I am working on a project in NLP area and in order to test the result I need to compare it against different data sources. I already have NYTimes data source. So, I am looking for another news source ...
7
votes
4answers
262 views

Most common words in English

I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
1
vote
1answer
100 views

Where can i find domain specific data set of opinion tweets about a product/brand?

I am working on a project to find the opinion of a product/brand on twitter. Is there any sample dataset of opnion base tweets ? If possible labelled data - Positive/negative/neutral
1
vote
1answer
1k views

Any data set available for Twitter tweets classification?

Is there any dataset available for different categories like music, politics, business etc which can be used to classify input tweets?