Questions tagged [nlp]
Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.
151
questions
1
vote
1
answer
4k
views
Dataset that contains customer support interaction
I am looking for datasets containing customer support interaction. Not any aggregated statistics (resolution time, survey results), but the actually written emails/chat messages between customers and ...
1
vote
1
answer
23
views
Datasets of legal correspondences
I am searching for datasets of legal correspondences between for example lawyers.
For example, a response to a complaint from an airline customer.
Preferably the legal basis should be with respect to ...
0
votes
1
answer
713
views
oxford dictionary database for NLP
I am using NLP for sentiment analysis ,so I need to determine the type of speech , can any one help me where can I download dataset/database for oxford dictionary?
0
votes
0
answers
20
views
sales calls transcripts - outbound or inbound call center data
is there anywhere to find transcripts of sales calls? i am looking for outbound or inbound sales calls. i have already seen this post:Outbound sales call center data with no answers.
1
vote
1
answer
181
views
Is there any publically available job recommendation (person to job fit) dataset?
I want a dataset that contains resumes and job descriptions, and information about successful job applications for my research work. Is there any dataset available publically?
2
votes
2
answers
63
views
Where can I find pdf of articles in French, their titles and abstracts/summaries?
I have a task to find a title/make a summary of market research, in pdfs, in French.
So I'm trying to find a dataset of the closest to it to create a model.
I was thinking of press articles in pdf as ...
8
votes
5
answers
1k
views
Most common words in English
I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
4
votes
1
answer
91
views
User complaint/review description for running nlp-ner on telecom(preferably) data
I am looking for Consumer complaint/review description data which is not generated from automatic logs but manually entered by the end-user/customer-support.
The objective is to run the Stanford NLP-...
1
vote
1
answer
187
views
Dataset listing datasets for natural language processing
I am looking for a dataset listing datasets for natural language processing with as many following fields as possible:
name
annotations (e.g., part of speech, dependency parses, or named entities)
...
0
votes
0
answers
31
views
Looking For Datasets on U.S. City Locations for Data Science Project? [duplicate]
I am currently working on a project that requires datasets detailing the locations of different cities across the United States. Specifically, I'm looking for data that includes city names along with ...
3
votes
2
answers
54
views
Is there a corpus of "nice", inoffensive English words?
I'm looking for an English language corpus that doesn't include profanity or "unpleasant" words to generate easy to remember passwords and other strings for users. Does anybody know of such ...
1
vote
0
answers
15
views
Are there NLP datasets that label each word type
I'm looking for NLP datasets that contain word types.
For example,
There is an apple on the table.
They have to table a motion for debate at the next Party Conference.
Clearly, the world table is ...
2
votes
2
answers
669
views
mimic iii: could a pretrained word2vec be made available?
Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
3
votes
1
answer
732
views
Download OpenOffice/Hunspell dictionaries (.oxt / .dic+.aff) for many languages at once?
I would like dictionaries for the top ~100 languages or so. Manually searching and evaluating the results at https://extensions.openoffice.org is quite cumbersome at that scale.
Is there a command ...
2
votes
1
answer
82
views
Known datasets for long document analysis
Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
1
vote
0
answers
25
views
Data for multi-modal semantic search
Context: I am interested in the potential to use vector indexing and semantic search for multimodal data. For instance, a retail website may have unstructured text data from the advertising copy on ...
0
votes
0
answers
22
views
Customer review dataset that can be publicly reshareable
I'm looking for a dataset of customer reviews and whose license allows academic and industry researchers to annotate the dataset and publicly share the annotated dataset (e.g., via a GitHub repo).
I ...
4
votes
1
answer
258
views
Labeled dataset for sentiment analysis in Mandarin
I am doing my research on sentiment analysis for Standard Mandarin. I don't have any benchmark dataset. I need usable labeled dataset for my research.
1
vote
0
answers
32
views
Hierarchical semantic distances dataset
I need data (preferably human judgment) for the structural/hierarchical semantic distance between many couples (at least hundreds) of words.
For example, d(computer, television) < d(radio, ...
2
votes
1
answer
238
views
computer science corpus for language model training
I am looking for a domain-specific computer science corpus of at least 20M words (preferable >50M words), for the purpose of training a language model in it.
Is there anything out-of-the-box that I ...
6
votes
4
answers
8k
views
Dataset for english words of dictionary for a NLP project
I am working on a NLP project, and for that I need a dataset of English words (words typically found in dictionary). Could somebody please guide me how to put together such dataset?
Is there any ...
11
votes
7
answers
7k
views
Large French dataset for NLP (not formal, rather discussions/reviews)
What am I looking for ?
I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias).
Why this ...
14
votes
4
answers
12k
views
Paraphrase data sets
I am looking for paraphrase data sets.
I am aware of the following:
PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
4
votes
7
answers
8k
views
Where can I find a dataset containing legal documents?
I have a machine learning task I wish to pursue. For the task I will need several hundred sample legal documents of the following types: Employment contract, service contract, sale contract, rental ...
3
votes
0
answers
65
views
Corpus for intention mining
I need a corpus with intention words, but I was not able to get one yet. please, somebody, help me.
Note: I'm new to intention mining if you know some useful corpus or links on intention mining please ...
9
votes
4
answers
3k
views
Tool to extract the main concepts/topics from web pages
I need to find the main themes or topics for each of 50,000 website urls.
For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc.
I'm ...
2
votes
1
answer
427
views
Datasets for Topic Modeling
I'm looking to try and use deep learning methods for topic modeling as opposed to the more traditional methods of lda and word embedding methods. However, I'm having trouble finding good labeled ...
2
votes
0
answers
25
views
Dataset that contains human-written transcripts of videos or audio files
I'm looking for a dataset that contains human-written transcripts of videos or audio files (e.g., podcast). I'm aware of the IWSLT2011 (TED) dataset and OpenSubtitles. What else exists?
6
votes
2
answers
7k
views
ASCII Character Frequency Analysis
I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
1
vote
1
answer
368
views
Index of YouTube video titles
I'm looking for a way to identify (as many as possible) YouTube videos on a certain topics based on a keywords occurring in their titles.
YouTube Data API provides a way to search for videos based on ...
2
votes
0
answers
67
views
Getting cold calls data set
I am looking for cold calls data set for my research.
the data should be an audio file of recorded calls. ( sales calls ..)
Any idea where can I get such data?
2
votes
0
answers
36
views
Data on press conferences from English-speaking press conferences
I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
1
vote
0
answers
93
views
How many sample sentences are required to train a model in opennlp?
I need to create my own model in opennlp. I have to create my own dataset since I couldn't get the calendar events dataset. Can anyone tell how many sample sentences are required to train a model?
1
vote
0
answers
15
views
User reviews for consumer tech products, but in French
So I am working on a sentiment analysis project where I need to gather french reviews about some giving product (iPhone XR, PS5, or anything as long as there is enough data), I tried Reddit (praw API) ...
1
vote
0
answers
27
views
Is there any publicly available Radiology dataset for NLP (Natural Language Processing) purposes?
I'm looking for publicly available Radiology reports data collection which I can use to proceed with my research. Do you happen to know some?
2
votes
2
answers
83
views
Common text data sets in form of panel data
I want to test machine learning tasks on time-divided textual data set. For this purpose, I want to use a common text data set which is already validated and "good" for use. I already found a Web of ...
2
votes
0
answers
37
views
Looking for public news articles dataset with their associated categories
I'm looking for datasets that contain labeled news articles. I'm trying to build information retrieval application using latent semantic analysis.
I've already used:
http://qwone.com/~jason/...
0
votes
1
answer
59
views
Twitter dataset to train word embeddings
I'm working on a project related to manipulating word embeddings. In order to do this, I need to train them myself on twitter data. Given Twitter's policy, I am unable to find a suitable dataset. Does ...
1
vote
0
answers
18
views
Elder patient dialogue corpus
I am looking for a corpus with dialogue between elderly patients (in a nursing home, hospital, their houses) and caregivers (nurses, doctors, family members). Do you know of anything like this?
2
votes
1
answer
61
views
Is there a Simplified Chinese thesaurus file, like Moby for English?
I'm looking for a manually curated thesaurus/synonyms file for Simplified Chinese. Like the English Moby thesaurus, but in simplified Chinese. Does such a thing exist?
I'm aware that WordNet can be ...
1
vote
1
answer
55
views
(Serious) Dataset of paedophilic Youtube comments (or similar)?
I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image.
It'...
1
vote
1
answer
47
views
What are the best sources to find labelled review data sets for text classification?
I have been searching for labelled review data sets for training for label classification. However it has been a bit surprising for me that I could find only sentiment classification data sets and ...
5
votes
1
answer
152
views
Solved Programming Challenges Dataset
I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
2
votes
1
answer
71
views
Dataset for NLP Text Summarization
Looking for a dataset for NLP Text Summarization consisting of
articles and their headlines
long news articles
summaries of articles
sentences extracted from user reviews on a given topic
interviews
...
1
vote
2
answers
96
views
I need a dialogue dataset
Where can I find a dataset of 2 people chit-chat dialogues? I need the data to be of full conversations, from "Hi" to "bye" so to speak.
7
votes
1
answer
367
views
Dataset for queries that are questions or others
I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
2
votes
1
answer
72
views
repository of pretrained neural translation models
I'm looking for pretrained neural translation models, preferably for pytorch or tensorflow.
Pretrained models should be well documented. Ideally, the training should be reproducable with both data ...
1
vote
1
answer
16
views
What measure can I use for rank order comparison of most-common n-grams in two sets of data?
I have a real dataset of sequences of events and a "fake" dataset generated using an lstm model. The two datasets are made up of the same vocabulary but are of a different length. I'm putting together ...
5
votes
1
answer
78
views
Where to find medical related data?
I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these:
A collection (I mean thousands ...
0
votes
1
answer
293
views
Where can I find a dataset with labelled articles by topic?
I am looking for a dataset containing articles (with article-text, or alternatively I am fine with only URLs too) and the corresponding topic label (i.e. politics, art, gardening etc.)
Any idea?