Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
4
votes
1answer
66 views

User complaint/review description for running nlp-ner on telecom(preferably) data

I am looking for Consumer complaint/review description data which is not generated from automatic logs but manually entered by the end-user/customer-support. The objective is to run the Stanford NLP-...
2
votes
2answers
60 views

Common text data sets in form of panel data

I want to test machine learning tasks on time-divided textual data set. For this purpose, I want to use a common text data set which is already validated and "good" for use. I already found a Web of ...
1
vote
1answer
28 views

Known datasets for long document analysis

Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
3
votes
1answer
24 views

computer science corpus for language model training

I am looking for a domain specific computer science corpus of at least 20M words (preferable >50M words), for the purpose of training a language model in it. Is there anything out-of-the box that I ...
0
votes
0answers
15 views

Looking for public news articles dataset with their associated categories

I'm looking for datasets that contain labeled news articles. I'm trying to build information retrieval application using latent semantic analysis. I've already used: http://qwone.com/~jason/...
1
vote
1answer
108 views

Datasets for Topic Modeling

I'm looking to try and use deep learning methods for topic modeling as opposed to the more traditional methods of lda and word embedding methods. However, I'm having trouble finding good labeled ...
0
votes
0answers
8 views

User reviews for consumer tech products, but in French

So I am working on a sentiment analysis project where I need to gather french reviews about some giving product (iphone XR, PS5 or anything as long as there is enough data), I tried Reddit (praw api) ...
0
votes
1answer
18 views

Twitter dataset to train word embeddings

I'm working on a project related to manipulating word embeddings. In order to do this, I need to train them myself on twitter data. Given Twitter's policy, I am unable to find a suitable dataset. Does ...
0
votes
0answers
11 views

Elder patient dialogue corpus

I am looking for a corpus with dialogue between elderly patients (in a nursing home, hospital, their houses) and caregivers (nurses, doctors, family members). Do you know of anything like this?
0
votes
2answers
429 views

mimic iii: could a pretrained word2vec be made available?

Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
2
votes
1answer
40 views

Is there a Simplified Chinese thesaurus file, like Moby for English?

I'm looking for a manually curated thesaurus/synonyms file for Simplified Chinese. Like the English Moby thesaurus, but in simplified Chinese. Does such a thing exist? I'm aware that WordNet can be ...
1
vote
1answer
42 views

(Serious) Dataset of paedophilic Youtube comments (or similar)?

I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image. It'...
4
votes
6answers
5k views

Where can I find a dataset containing legal documents?

I have a machine learning task I wish to pursue. For the task I will need several hundred sample legal documents of the following types: Employment contract, service contract, sale contract, rental ...
1
vote
1answer
21 views

What are the best sources to find labelled review data sets for text classification?

I have been searching for labelled review data sets for training for label classification. However it has been a bit surprising for me that I could find only sentiment classification data sets and ...
5
votes
1answer
77 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
1
vote
1answer
30 views

Dataset for NLP Text Summarization

Looking for a dataset for NLP Text Summarization consisting of articles and their headlines long news articles summaries of articles sentences extracted from user reviews on a given topic interviews ...
1
vote
2answers
27 views

I need a dialogue dataset

Where can I find a dataset of 2 people chit-chat dialogues? I need the data to be of full conversations, from "Hi" to "bye" so to speak.
7
votes
1answer
305 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
2
votes
1answer
29 views

repository of pretrained neural translation models

I'm looking for pretrained neural translation models, preferably for pytorch or tensorflow. Pretrained models should be well documented. Ideally, the training should be reproducable with both data ...
1
vote
1answer
10 views

What measure can I use for rank order comparison of most-common n-grams in two sets of data?

I have a real dataset of sequences of events and a "fake" dataset generated using an lstm model. The two datasets are made up of the same vocabulary but are of a different length. I'm putting together ...
5
votes
1answer
62 views

Where to find medical related data?

I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these: A collection (I mean thousands ...
0
votes
1answer
40 views

Where can I find a dataset with labelled articles by topic?

I am looking for a dataset containing articles (with article-text, or alternatively I am fine with only URLs too) and the corresponding topic label (i.e. politics, art, gardening etc.) Any idea?
4
votes
1answer
360 views

Recommendation letter dataset

I am looking for a dataset containing academic recommendation letters, written in English, with as many following fields as possible: content of the letter date of the letter purpose of the letter (...
1
vote
0answers
21 views

Where can I find Investopedia data set for download? [closed]

I want to train a NLP model based on investopedia data set but I am not able to find it.
0
votes
1answer
36 views

Corpus suggestion for financial domain

I am looking for a financial corpus or any form of publicly available financial texts which is replete with technical terms and acronyms. Any suggestion is appreciated
24
votes
7answers
29k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
2
votes
0answers
42 views

Temporal discrete data with ground truth labels for clustering purpose

I would like to know if there is any temporal discrete data-set available with the ground truth labels. The goal is to test the performance of the temporal/evolutionary clustering methods, such as the ...
2
votes
0answers
29 views

Where can I find labeled sentences?

I am looking for sentences csv labeled like this, or something similar: I am going to run a marathon., achievement I miss my high school friend., friendship I would like to lose 10 pounds, ...
3
votes
0answers
21 views

Knowledge-base of typical/notable values of attribute

For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns). We are curious about ...
2
votes
1answer
47 views

psychological / patient dialogue data for nlp analisys

I search data for chatbot for psychological task. I found some source about it: https://berkeleysciencereview.com/nlp-for-psychotherapy/ Where can I find data with dialogue of psychologist and ...
8
votes
2answers
2k views

Medical Terminology in Patient Medical Records - Public Data Sets

I am interested in sample data of real patient medical records (anonymized or demographics removed completely) for the purpose of running through NLP system - specifically diagnoses, admissions and ...
0
votes
0answers
17 views

Is there any publicly available Radiology dataset for NLP (Natural Language Processing) purposes?

I'm looking for publicly available Radiology reports data collection which I can use to proceed with my research. Do you happen to know some? Thanks!
0
votes
0answers
10 views

reliable spanish word empeddings (word2vec output format)

I'm looking for spanish word vectors (preferably word2vec output format) to use in a scala nlp application. I've tried the ones on https://github.com/uchile-nlp/spanish-word-embeddings, but they are ...
14
votes
4answers
8k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
2
votes
1answer
29 views

Source of multilingual chat/online/contemporary corpus data?

I need to develop autocorrection and prediction for mobile keyboard app that will work for some 8-10 most common Latin languages + Russian (English, German, Spanish, Portugues, French, ...). For start,...
1
vote
1answer
137 views

Text annotation tool dataset

I am looking for a dataset containing text annotation tools, with as many following fields as possible: name of the tool date of first release date of last release programming language license price ...
1
vote
0answers
27 views

Conversation logs open data

Is there any open data on conversation logs? I am looking for open data on conversation logs, yes between individual people. Ideally private chat logs. I am considering using a bot to scrape a ...
1
vote
0answers
72 views

non functional requirements dataset

I am developing a machine learning project which analyzes requirement specification and categorizes the non-functional requirements into categories like database, web socket, backend technology, etc. ...
1
vote
0answers
21 views

Estonian named entity recognition data

I'm looking for estonian named entity recognition data. Till now I am unable to find one. Although Estonia has 90% of it's Govt services online, I can't find their NER data anywhere. I tried estnltk, ...
7
votes
1answer
134 views

Corpus of human-scored machine translations?

Most of the parallel corpora (Opus, EuroParl, OpenSubtitles) have only human translations. src_txt | human_trans_of_src_txt_into_trg_lng (We assume all the translations are good.) Is there a corpus ...
2
votes
1answer
159 views

Public dataset for spanish news articles with title and content

I am wondering if there are any public datasets of news in SPANISH similar to this dataset. Which consists mostly of ENGLISH news. There is a similar question already answered here. However, I require ...
2
votes
1answer
153 views

Is there any public dataset on Bangla Language handwriting available?

I am willing to work on a natural language processing project that encompasses learning from Bangla handwritten texts. Hence, I am looking for publicly available Bangla handwritten texts' dataset.
1
vote
0answers
126 views

Recent dump of names from facebook.com/directory?

For years all names of all Facebook users were listed at https://www.facebook.com/directory. Even without the links to the profiles themselves, it was a very useful dataset of diverse names and ...
4
votes
1answer
85 views

Speech recognition english corpuses

Could someone provide a list (or link to) of english speech recognition corpuses with their availability and size (preferably in hours).
7
votes
1answer
2k views

Spanish Sentiment Dataset

I'm looking for a Spanish language corpus tagged with sentiment (just positive & negative are needed, though neutral might be helpful.) I could use a Twitter dataset, but I'd prefer to use ...
0
votes
2answers
106 views

Looking for Databases with gender of names and Ethnicity information

I want to build a classifier which can classify gender and ethnicity based on the names. I am looking for datasets to download where I take samples for supervised learning. If there are no open ...
2
votes
0answers
111 views

How to use DBpedia to identify the topics

In the paper "Discovering Relevant Topics using DBPedia providing non-obvious recommendations" they have used skos:broader property and dcterms:subject property. In my task given the word I want to ...
3
votes
1answer
592 views

Reddit comments labeled data-set for sentiment analysis?

I was searching for a Reddit comments data-set which is labeled into three classes: positive, negative and neutral to train a ML model. I can get labeled data for tweets, movie reviews but what about ...
3
votes
0answers
43 views

Enron data set: Get labels whether an email has been replied or forwarded

I am currently browsing through the Enron data set in order to come up with a way to extract labels (true/false) on whether an email has been forwarded or replied to. The task would be to predict ...
4
votes
1answer
548 views

Is there any open dataset for named entity linking?

Entity linking is the task of detecting mentions of entities from a knowledge base in a document. Are there any openly available datasets to train and evaluate such systems? The datasets I came ...