Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
1
vote
1answer
35 views

(Serious) Dataset of paedophilic Youtube comments (or similar)?

I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image. It'...
4
votes
6answers
4k views

Where can I find a dataset containing legal documents?

I have a machine learning task I wish to pursue. For the task I will need several hundred sample legal documents of the following types: Employment contract, service contract, sale contract, rental ...
0
votes
1answer
12 views

Twitter dataset to train word embeddings

I'm working on a project related to manipulating word embeddings. In order to do this, I need to train them myself on twitter data. Given Twitter's policy, I am unable to find a suitable dataset. Does ...
0
votes
2answers
380 views

mimic iii: could a pretrained word2vec be made available?

Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
1
vote
1answer
18 views

What are the best sources to find labelled review data sets for text classification?

I have been searching for labelled review data sets for training for label classification. However it has been a bit surprising for me that I could find only sentiment classification data sets and ...
5
votes
1answer
70 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
1
vote
1answer
24 views

Dataset for NLP Text Summarization

Looking for a dataset for NLP Text Summarization consisting of articles and their headlines long news articles summaries of articles sentences extracted from user reviews on a given topic interviews ...
1
vote
2answers
24 views

I need a dialogue dataset

Where can I find a dataset of 2 people chit-chat dialogues? I need the data to be of full conversations, from "Hi" to "bye" so to speak.
1
vote
1answer
23 views

Known datasets for long document analysis

Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
1
vote
1answer
72 views

Datasets for Topic Modeling

I'm looking to try and use deep learning methods for topic modeling as opposed to the more traditional methods of lda and word embedding methods. However, I'm having trouble finding good labeled ...
7
votes
1answer
302 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
2
votes
1answer
25 views

repository of pretrained neural translation models

I'm looking for pretrained neural translation models, preferably for pytorch or tensorflow. Pretrained models should be well documented. Ideally, the training should be reproducable with both data ...
1
vote
1answer
9 views

What measure can I use for rank order comparison of most-common n-grams in two sets of data?

I have a real dataset of sequences of events and a "fake" dataset generated using an lstm model. The two datasets are made up of the same vocabulary but are of a different length. I'm putting together ...
5
votes
1answer
60 views

Where to find medical related data?

I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these: A collection (I mean thousands ...
1
vote
0answers
15 views

computer science corpus for language model training

I am looking for a domain specific computer science corpus of at least 20M words (preferable >50M words), for the purpose of training a language model in it. Is there anything out-of-the box that I ...
0
votes
1answer
34 views

Where can I find a dataset with labelled articles by topic?

I am looking for a dataset containing articles (with article-text, or alternatively I am fine with only URLs too) and the corresponding topic label (i.e. politics, art, gardening etc.) Any idea?
4
votes
1answer
329 views

Recommendation letter dataset

I am looking for a dataset containing academic recommendation letters, written in English, with as many following fields as possible: content of the letter date of the letter purpose of the letter (...
1
vote
0answers
19 views

Where can I find Investopedia data set for download? [closed]

I want to train a NLP model based on investopedia data set but I am not able to find it.
0
votes
1answer
35 views

Corpus suggestion for financial domain

I am looking for a financial corpus or any form of publicly available financial texts which is replete with technical terms and acronyms. Any suggestion is appreciated
24
votes
7answers
29k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
2
votes
0answers
42 views

Temporal discrete data with ground truth labels for clustering purpose

I would like to know if there is any temporal discrete data-set available with the ground truth labels. The goal is to test the performance of the temporal/evolutionary clustering methods, such as the ...
2
votes
0answers
29 views

Where can I find labeled sentences?

I am looking for sentences csv labeled like this, or something similar: I am going to run a marathon., achievement I miss my high school friend., friendship I would like to lose 10 pounds, ...
2
votes
2answers
52 views

Common text data sets in form of panel data

I want to test machine learning tasks on time-divided textual data set. For this purpose, I want to use a common text data set which is already validated and "good" for use. I already found a Web of ...
3
votes
0answers
21 views

Knowledge-base of typical/notable values of attribute

For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns). We are curious about ...
2
votes
1answer
37 views

psychological / patient dialogue data for nlp analisys

I search data for chatbot for psychological task. I found some source about it: https://berkeleysciencereview.com/nlp-for-psychotherapy/ Where can I find data with dialogue of psychologist and ...
7
votes
2answers
2k views

Medical Terminology in Patient Medical Records - Public Data Sets

I am interested in sample data of real patient medical records (anonymized or demographics removed completely) for the purpose of running through NLP system - specifically diagnoses, admissions and ...
0
votes
0answers
17 views

Is there any publicly available Radiology dataset for NLP (Natural Language Processing) purposes?

I'm looking for publicly available Radiology reports data collection which I can use to proceed with my research. Do you happen to know some? Thanks!
0
votes
0answers
10 views

reliable spanish word empeddings (word2vec output format)

I'm looking for spanish word vectors (preferably word2vec output format) to use in a scala nlp application. I've tried the ones on https://github.com/uchile-nlp/spanish-word-embeddings, but they are ...
13
votes
4answers
7k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
2
votes
1answer
27 views

Source of multilingual chat/online/contemporary corpus data?

I need to develop autocorrection and prediction for mobile keyboard app that will work for some 8-10 most common Latin languages + Russian (English, German, Spanish, Portugues, French, ...). For start,...
1
vote
1answer
137 views

Text annotation tool dataset

I am looking for a dataset containing text annotation tools, with as many following fields as possible: name of the tool date of first release date of last release programming language license price ...
1
vote
0answers
27 views

Conversation logs open data

Is there any open data on conversation logs? I am looking for open data on conversation logs, yes between individual people. Ideally private chat logs. I am considering using a bot to scrape a ...
1
vote
0answers
57 views

non functional requirements dataset

I am developing a machine learning project which analyzes requirement specification and categorizes the non-functional requirements into categories like database, web socket, backend technology, etc. ...
1
vote
0answers
21 views

Estonian named entity recognition data

I'm looking for estonian named entity recognition data. Till now I am unable to find one. Although Estonia has 90% of it's Govt services online, I can't find their NER data anywhere. I tried estnltk, ...
7
votes
1answer
134 views

Corpus of human-scored machine translations?

Most of the parallel corpora (Opus, EuroParl, OpenSubtitles) have only human translations. src_txt | human_trans_of_src_txt_into_trg_lng (We assume all the translations are good.) Is there a corpus ...
2
votes
1answer
130 views

Public dataset for spanish news articles with title and content

I am wondering if there are any public datasets of news in SPANISH similar to this dataset. Which consists mostly of ENGLISH news. There is a similar question already answered here. However, I require ...
2
votes
1answer
153 views

Is there any public dataset on Bangla Language handwriting available?

I am willing to work on a natural language processing project that encompasses learning from Bangla handwritten texts. Hence, I am looking for publicly available Bangla handwritten texts' dataset.
0
votes
0answers
104 views

Recent dump of names from facebook.com/directory?

For years all names of all Facebook users were listed at https://www.facebook.com/directory. Even without the links to the profiles themselves, it was a very useful dataset of diverse names and ...
3
votes
1answer
81 views

Speech recognition english corpuses

Could someone provide a list (or link to) of english speech recognition corpuses with their availability and size (preferably in hours).
7
votes
1answer
2k views

Spanish Sentiment Dataset

I'm looking for a Spanish language corpus tagged with sentiment (just positive & negative are needed, though neutral might be helpful.) I could use a Twitter dataset, but I'd prefer to use ...
0
votes
2answers
80 views

Looking for Databases with gender of names and Ethnicity information

I want to build a classifier which can classify gender and ethnicity based on the names. I am looking for datasets to download where I take samples for supervised learning. If there are no open ...
2
votes
0answers
110 views

How to use DBpedia to identify the topics

In the paper "Discovering Relevant Topics using DBPedia providing non-obvious recommendations" they have used skos:broader property and dcterms:subject property. In my task given the word I want to ...
3
votes
1answer
566 views

Reddit comments labeled data-set for sentiment analysis?

I was searching for a Reddit comments data-set which is labeled into three classes: positive, negative and neutral to train a ML model. I can get labeled data for tweets, movie reviews but what about ...
2
votes
0answers
39 views

Enron data set: Get labels whether an email has been replied or forwarded

I am currently browsing through the Enron data set in order to come up with a way to extract labels (true/false) on whether an email has been forwarded or replied to. The task would be to predict ...
4
votes
1answer
511 views

Is there any open dataset for named entity linking?

Entity linking is the task of detecting mentions of entities from a knowledge base in a document. Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
1
vote
0answers
24 views

Good sources for Data-sets for word problems of Calculus

I am currently working on a project involving solving word problems of Calculus through Natural Language Processing, AI algorithm. I tried to find a data-set for word problems of Calculus but could ...
3
votes
1answer
2k views

word2vec Analogy Task Data Set

Word2Vec is famous for demonstrating local linear properties on analogy tasks. The task and dataset were introduced in Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig , Linguistic Regularities in ...
3
votes
1answer
136 views

Corpus of English text with tagged locations

I'm looking for corpora of English texts with locations tagged. I am aware of CONLL2002. This is the type of corpus I'm looking for, but want more.
1
vote
0answers
27 views

Hierarchical semantic distances dataset

I need a data (preferably human judgment) for the structural/hierarchical semantic distance between many couples (at least hundreds) of word. For example, d(computer, television) < d(radio, ...
2
votes
0answers
85 views

Spanish POS (part of speech) tagged dataset

Where can I get a spanish POS tagged dataset with universal tags free to download?