Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
4
votes
1answer
79 views

User complaint/review description for running nlp-ner on telecom(preferably) data

I am looking for Consumer complaint/review description data which is not generated from automatic logs but manually entered by the end-user/customer-support. The objective is to run the Stanford NLP-...
2
votes
1answer
179 views

Labeled dataset for sentiment analysis in Mandarin

I am doing my research on sentiment analysis for Standard Mandarin. I don't have any benchmark dataset. I need usable labeled dataset for my research.
1
vote
1answer
38 views

Known datasets for long document analysis

Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
14
votes
5answers
10k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
1
vote
2answers
539 views

mimic iii: could a pretrained word2vec be made available?

Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
1
vote
1answer
63 views

Is there any publically available job recommendation (person to job fit) dataset?

I want a dataset that contains resumes and job descriptions, and information about successful job applications for my research work. Is there any dataset available publically?
4
votes
7answers
6k views

Where can I find a dataset containing legal documents?

I have a machine learning task I wish to pursue. For the task I will need several hundred sample legal documents of the following types: Employment contract, service contract, sale contract, rental ...
3
votes
0answers
65 views

Corpus for intention mining

I need a corpus with intention words, but I was not able to get one yet. please, somebody, help me. Note: I'm new to intention mining if you know some useful corpus or links on intention mining please ...
9
votes
4answers
2k views

Tool to extract the main concepts/topics from web pages

I need to find the main themes or topics for each of 50,000 website urls. For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc. I'm ...
2
votes
1answer
194 views

Datasets for Topic Modeling

I'm looking to try and use deep learning methods for topic modeling as opposed to the more traditional methods of lda and word embedding methods. However, I'm having trouble finding good labeled ...
0
votes
0answers
10 views

Sentiment analysis applied to reviews of pharmaceutical drugs

I'm looking for a dataset for sentiment analysis applied to reviews of pharmaceutical drugs. I.e. a set of sentences from reviews of pharmaceutical drugs labels with a score indicating their sentiment....
0
votes
0answers
9 views

Dataset of short sentences for specific emotion detection algorithm?

I need to create (or adapt/reuse) a library/API to detect specific emotions in any language, if possible French: Négatif : Déception ; colère ; irritation ; anxiété ; stress ; frustration meaning ...
1
vote
0answers
12 views

Dataset that contains human-written transcripts of videos or audio files

I'm looking for a dataset that contains human-written transcripts of videos or audio files (e.g., podcast). I'm aware of the IWSLT2011 (TED) dataset and OpenSubtitles. What else exists?
6
votes
2answers
5k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
0
votes
0answers
22 views

Is there a speeches dataset for summarization?

I'm currently learning about text summarization and I'd like to fine-tune a model for summarizing speeches (i.e. texts of speeches by political leaders or parliament debates, NOT voice recordings). ...
1
vote
1answer
103 views

Index of YouTube video titles

I'm looking for a way to identify (as many as possible) YouTube videos on a certain topics based on a keywords occurring in their titles. YouTube Data API provides a way to search for videos based on ...
0
votes
0answers
10 views

Looking for English word database that includes syllabication and accentuation annotations (for poetry generation)

I am looking for primary data for generating accentual verse in English. I imagine that this would be, basically, a corpus of English words where the annotations associated with each entry include ...
2
votes
0answers
58 views

Getting cold calls data set

I am looking for cold calls data set for my research. the data should be an audio file of recorded calls. ( sales calls ..) Any idea where can I get such data?
2
votes
0answers
31 views

Data on press conferences from English-speaking press conferences

I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
1
vote
0answers
92 views

How many sample sentences are required to train a model in opennlp?

I need to create my own model in opennlp. I have to create my own dataset since I couldn't get the calendar events dataset. Can anyone tell how many sample sentences are required to train a model?
1
vote
0answers
13 views

User reviews for consumer tech products, but in French

So I am working on a sentiment analysis project where I need to gather french reviews about some giving product (iPhone XR, PS5, or anything as long as there is enough data), I tried Reddit (praw API) ...
1
vote
0answers
18 views

Is there any publicly available Radiology dataset for NLP (Natural Language Processing) purposes?

I'm looking for publicly available Radiology reports data collection which I can use to proceed with my research. Do you happen to know some?
2
votes
2answers
62 views

Common text data sets in form of panel data

I want to test machine learning tasks on time-divided textual data set. For this purpose, I want to use a common text data set which is already validated and "good" for use. I already found a Web of ...
2
votes
1answer
86 views

computer science corpus for language model training

I am looking for a domain specific computer science corpus of at least 20M words (preferable >50M words), for the purpose of training a language model in it. Is there anything out-of-the box that I ...
2
votes
0answers
27 views

Looking for public news articles dataset with their associated categories

I'm looking for datasets that contain labeled news articles. I'm trying to build information retrieval application using latent semantic analysis. I've already used: http://qwone.com/~jason/...
0
votes
1answer
36 views

Twitter dataset to train word embeddings

I'm working on a project related to manipulating word embeddings. In order to do this, I need to train them myself on twitter data. Given Twitter's policy, I am unable to find a suitable dataset. Does ...
1
vote
0answers
15 views

Elder patient dialogue corpus

I am looking for a corpus with dialogue between elderly patients (in a nursing home, hospital, their houses) and caregivers (nurses, doctors, family members). Do you know of anything like this?
2
votes
1answer
40 views

Is there a Simplified Chinese thesaurus file, like Moby for English?

I'm looking for a manually curated thesaurus/synonyms file for Simplified Chinese. Like the English Moby thesaurus, but in simplified Chinese. Does such a thing exist? I'm aware that WordNet can be ...
1
vote
1answer
51 views

(Serious) Dataset of paedophilic Youtube comments (or similar)?

I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image. It'...
1
vote
1answer
27 views

What are the best sources to find labelled review data sets for text classification?

I have been searching for labelled review data sets for training for label classification. However it has been a bit surprising for me that I could find only sentiment classification data sets and ...
5
votes
1answer
93 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
1
vote
1answer
39 views

Dataset for NLP Text Summarization

Looking for a dataset for NLP Text Summarization consisting of articles and their headlines long news articles summaries of articles sentences extracted from user reviews on a given topic interviews ...
1
vote
2answers
36 views

I need a dialogue dataset

Where can I find a dataset of 2 people chit-chat dialogues? I need the data to be of full conversations, from "Hi" to "bye" so to speak.
7
votes
1answer
323 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
2
votes
1answer
44 views

repository of pretrained neural translation models

I'm looking for pretrained neural translation models, preferably for pytorch or tensorflow. Pretrained models should be well documented. Ideally, the training should be reproducable with both data ...
1
vote
1answer
15 views

What measure can I use for rank order comparison of most-common n-grams in two sets of data?

I have a real dataset of sequences of events and a "fake" dataset generated using an lstm model. The two datasets are made up of the same vocabulary but are of a different length. I'm putting together ...
5
votes
1answer
70 views

Where to find medical related data?

I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these: A collection (I mean thousands ...
0
votes
1answer
87 views

Where can I find a dataset with labelled articles by topic?

I am looking for a dataset containing articles (with article-text, or alternatively I am fine with only URLs too) and the corresponding topic label (i.e. politics, art, gardening etc.) Any idea?
4
votes
1answer
396 views

Recommendation letter dataset

I am looking for a dataset containing academic recommendation letters, written in English, with as many following fields as possible: content of the letter date of the letter purpose of the letter (...
1
vote
0answers
30 views

Where can I find Investopedia data set for download? [closed]

I want to train a NLP model based on investopedia data set but I am not able to find it.
0
votes
1answer
48 views

Corpus suggestion for financial domain

I am looking for a financial corpus or any form of publicly available financial texts which is replete with technical terms and acronyms. Any suggestion is appreciated
26
votes
7answers
30k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
2
votes
0answers
44 views

Temporal discrete data with ground truth labels for clustering purpose

I would like to know if there is any temporal discrete data-set available with the ground truth labels. The goal is to test the performance of the temporal/evolutionary clustering methods, such as the ...
2
votes
0answers
29 views

Where can I find labeled sentences?

I am looking for sentences csv labeled like this, or something similar: I am going to run a marathon., achievement I miss my high school friend., friendship I would like to lose 10 pounds, ...
3
votes
0answers
21 views

Knowledge-base of typical/notable values of attribute

For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns). We are curious about ...
2
votes
1answer
53 views

psychological / patient dialogue data for nlp analisys

I search data for chatbot for psychological task. I found some source about it: https://berkeleysciencereview.com/nlp-for-psychotherapy/ Where can I find data with dialogue of psychologist and ...
7
votes
2answers
2k views

Medical Terminology in Patient Medical Records - Public Data Sets

I am interested in sample data of real patient medical records (anonymized or demographics removed completely) for the purpose of running through NLP system - specifically diagnoses, admissions and ...
0
votes
0answers
11 views

reliable spanish word empeddings (word2vec output format)

I'm looking for spanish word vectors (preferably word2vec output format) to use in a scala nlp application. I've tried the ones on https://github.com/uchile-nlp/spanish-word-embeddings, but they are ...
2
votes
1answer
39 views

Source of multilingual chat/online/contemporary corpus data?

I need to develop autocorrection and prediction for mobile keyboard app that will work for some 8-10 most common Latin languages + Russian (English, German, Spanish, Portugues, French, ...). For start,...
1
vote
1answer
140 views

Text annotation tool dataset

I am looking for a dataset containing text annotation tools, with as many following fields as possible: name of the tool date of first release date of last release programming language license price ...