Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
2
votes
0answers
41 views

Temporal discrete data with ground truth labels for clustering purpose

I would like to know if there is any temporal discrete data-set available with the ground truth labels. The goal is to test the performance of the temporal/evolutionary clustering methods, such as the ...
2
votes
0answers
24 views

Where can I find labeled sentences?

I am looking for sentences csv labeled like this, or something similar: I am going to run a marathon., achievement I miss my high school friend., friendship I would like to lose 10 pounds, ...
1
vote
1answer
18 views

Datasets for Topic Modeling

I'm looking to try and use deep learning methods for topic modeling as opposed to the more traditional methods of lda and word embedding methods. However, I'm having trouble finding good labeled ...
2
votes
2answers
44 views

Common text data sets in form of panel data

I want to test machine learning tasks on time-divided textual data set. For this purpose, I want to use a common text data set which is already validated and "good" for use. I already found a Web of ...
6
votes
1answer
277 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
3
votes
0answers
19 views

Knowledge-base of typical/notable values of attribute

For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns). We are curious about ...
2
votes
1answer
30 views

psychological / patient dialogue data for nlp analisys

I search data for chatbot for psychological task. I found some source about it: https://berkeleysciencereview.com/nlp-for-psychotherapy/ Where can I find data with dialogue of psychologist and ...
0
votes
1answer
326 views

mimic iii: could a pretrained word2vec be made available?

Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
8
votes
2answers
2k views

Medical Terminology in Patient Medical Records - Public Data Sets

I am interested in sample data of real patient medical records (anonymized or demographics removed completely) for the purpose of running through NLP system - specifically diagnoses, admissions and ...
0
votes
0answers
99 views

Dataset for job listing outcomes

Looking for a dataset of job listings with the demographic information about their applicants. Working on a project to determine which types of job descriptions attract more applicants. Also what type ...
0
votes
0answers
17 views

Is there any publicly available Radiology dataset for NLP (Natural Language Processing) purposes?

I'm looking for publicly available Radiology reports data collection which I can use to proceed with my research. Do you happen to know some? Thanks!
0
votes
0answers
8 views

reliable spanish word empeddings (word2vec output format)

I'm looking for spanish word vectors (preferably word2vec output format) to use in a scala nlp application. I've tried the ones on https://github.com/uchile-nlp/spanish-word-embeddings, but they are ...
24
votes
6answers
28k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
0
votes
0answers
17 views

Home automation dialogues

Is there an available dataset from home automation conversational agent vendors such as Amazon-Alexa or Google Home. I want a dataset where there are dialogues and knowledge bases of IoT devices ...
12
votes
4answers
6k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
2
votes
1answer
23 views

Source of multilingual chat/online/contemporary corpus data?

I need to develop autocorrection and prediction for mobile keyboard app that will work for some 8-10 most common Latin languages + Russian (English, German, Spanish, Portugues, French, ...). For start,...
1
vote
1answer
135 views

Text annotation tool dataset

I am looking for a dataset containing text annotation tools, with as many following fields as possible: name of the tool date of first release date of last release programming language license price ...
1
vote
0answers
24 views

Conversation logs open data

Is there any open data on conversation logs? I am looking for open data on conversation logs, yes between individual people. Ideally private chat logs. I am considering using a bot to scrape a ...
1
vote
0answers
35 views

non functional requirements dataset

I am developing a machine learning project which analyzes requirement specification and categorizes the non-functional requirements into categories like database, web socket, backend technology, etc. ...
1
vote
0answers
18 views

Estonian named entity recognition data

I'm looking for estonian named entity recognition data. Till now I am unable to find one. Although Estonia has 90% of it's Govt services online, I can't find their NER data anywhere. I tried estnltk, ...
7
votes
1answer
131 views

Corpus of human-scored machine translations?

Most of the parallel corpora (Opus, EuroParl, OpenSubtitles) have only human translations. src_txt | human_trans_of_src_txt_into_trg_lng (We assume all the translations are good.) Is there a corpus ...
2
votes
1answer
90 views

Public dataset for spanish news articles with title and content

I am wondering if there are any public datasets of news in SPANISH similar to this dataset. Which consists mostly of ENGLISH news. There is a similar question already answered here. However, I require ...
0
votes
0answers
75 views

Dataset for intent classification (conversational agents)?

Basically, I am learning about chatbots and conversational agents, and I am curious are there any publicly available datasets for the task of intent classification (simply multi-class classification ...
2
votes
1answer
141 views

Is there any public dataset on Bangla Language handwriting available?

I am willing to work on a natural language processing project that encompasses learning from Bangla handwritten texts. Hence, I am looking for publicly available Bangla handwritten texts' dataset.
0
votes
0answers
101 views

Recent dump of names from facebook.com/directory?

For years all names of all Facebook users were listed at https://www.facebook.com/directory. Even without the links to the profiles themselves, it was a very useful dataset of diverse names and ...
4
votes
1answer
78 views

Speech recognition english corpuses

Could someone provide a list (or link to) of english speech recognition corpuses with their availability and size (preferably in hours).
7
votes
1answer
2k views

Spanish Sentiment Dataset

I'm looking for a Spanish language corpus tagged with sentiment (just positive & negative are needed, though neutral might be helpful.) I could use a Twitter dataset, but I'd prefer to use ...
0
votes
2answers
65 views

Looking for Databases with gender of names and Ethnicity information

I want to build a classifier which can classify gender and ethnicity based on the names. I am looking for datasets to download where I take samples for supervised learning. If there are no open ...
3
votes
4answers
3k views

Where can I find a dataset containing legal documents?

I have a machine learning task I wish to pursue. For the task I will need several hundred sample legal documents of the following types: Employment contract, service contract, sale contract, rental ...
2
votes
0answers
102 views

How to use DBpedia to identify the topics

In the paper "Discovering Relevant Topics using DBPedia providing non-obvious recommendations" they have used skos:broader property and dcterms:subject property. In my task given the word I want to ...
3
votes
1answer
535 views

Reddit comments labeled data-set for sentiment analysis?

I was searching for a Reddit comments data-set which is labeled into three classes: positive, negative and neutral to train a ML model. I can get labeled data for tweets, movie reviews but what about ...
2
votes
0answers
35 views

Enron data set: Get labels whether an email has been replied or forwarded

I am currently browsing through the Enron data set in order to come up with a way to extract labels (true/false) on whether an email has been forwarded or replied to. The task would be to predict ...
4
votes
1answer
386 views

Is there any open dataset for named entity linking?

Entity linking is the task of detecting mentions of entities from a knowledge base in a document. Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
1
vote
0answers
24 views

Good sources for Data-sets for word problems of Calculus

I am currently working on a project involving solving word problems of Calculus through Natural Language Processing, AI algorithm. I tried to find a data-set for word problems of Calculus but could ...
3
votes
1answer
2k views

word2vec Analogy Task Data Set

Word2Vec is famous for demonstrating local linear properties on analogy tasks. The task and dataset were introduced in Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig , Linguistic Regularities in ...
3
votes
1answer
132 views

Corpus of English text with tagged locations

I'm looking for corpora of English texts with locations tagged. I am aware of CONLL2002. This is the type of corpus I'm looking for, but want more.
1
vote
0answers
27 views

Hierarchical semantic distances dataset

I need a data (preferably human judgment) for the structural/hierarchical semantic distance between many couples (at least hundreds) of word. For example, d(computer, television) < d(radio, ...
2
votes
0answers
80 views

Spanish POS (part of speech) tagged dataset

Where can I get a spanish POS tagged dataset with universal tags free to download?
1
vote
1answer
113 views

Dataset from online forum

Recently I started to do some researchs on QA data aiming to rank quality answers from determined questions, for this I used the avaliables Yahoo! and StackExchange datasets. Now, I would like to ...
1
vote
0answers
36 views

News to Category/Section mapping DataSet

Is there a public dataset which has news articles to various sections/categories mapping? For example: Article 1 (title, text, etc, CATEGORY) Article 2 (title, text, etc, CATEGORY) Article 3 (title, ...
3
votes
3answers
106 views

Need Tagged Data sets for training ML algorithms to classify sentences/reviews into single/multi classes

Need tagged text data of any domain. Preferably generalized and ubiquitous domains such as "Food & Hospitality" (Reviews about the quality of the food, comments about the ambience and service etc. ...
0
votes
1answer
193 views

Torrent for the fastText pre-trained models?

I would like to download the pre-trained models for ~100 languages, which are ~3GB each. (See https://github.com/facebookresearch/fastText/blob/master/pretrained-vectors.md) Is there a utility or ....
2
votes
1answer
43 views

Download OpenOffice/Hunspell dictionaries (.oxt / .dic+.aff) for many languages at once?

I would like dictionaries for the top ~100 languages or so. Manually searching and evaluating the results at https://extensions.openoffice.org manually is quite cumbersome at that scale. Is there a ...
2
votes
1answer
43 views

Aspect Based Sentiment Classification

Are there any services which provide aspect-sentiment of the sentence? If the sentence/review is talking about multiple aspects, all the aspects with their sentiments (Positive, Negative, Neutral ...
1
vote
0answers
29 views

Looking for lots of real texts written by humans with user-metadata

I am an NLP researcher and for the purpose of my ongoing work I need lots of textual data produced by real human beings. It's probably not so hard to obtain, but it's important that it's also contains ...
1
vote
1answer
66 views

Accessible source of social network chat data

Are there any accessible source(s) of actual chatting text between users of any social network? There exist other conversational corpora (for instance, the Berkeley Restaurant Project corpus is one). ...
5
votes
1answer
550 views

Dataset of Sentences Classified by Type?

Where can I find a labeled dataset of sentences classified by type (interrogative and declarative)? I'm particularly lookings for Russian sentences, but other open and labeled datasets of other ...
1
vote
1answer
42 views

Where I can get the datasets containing article with its summarization?

I am trying to create a summarizer as my project and using ANN and AI for trying to get a dataset for the training purpose. Kindly, suggest me where I can get a large dataset for training such a ...
2
votes
0answers
33 views

Collection of datasets for sentence relatedness or stance classification

I have been developing a classifier with machine learning to know if two texts are related or not. By that means, if they are talking about the same topic or not. I have tried to gather data but, so ...
0
votes
1answer
124 views

Is any Dataset for chitchat regional languages in english in watsapp, facebook messenger etc available in tensorflow

I started a project in chatbots for the normal regional languages chatting in english like below , I need a dataset to train my model in tensorflow ,Is any dataset default present in tensorflow or any ...