Questions tagged [nlp]

Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.

Filter by
Sorted by
Tagged with
0 votes
0 answers
18 views

sales calls transcripts - outbound or inbound call center data

is there anywhere to find transcripts of sales calls? i am looking for outbound or inbound sales calls. i have already seen this post:Outbound sales call center data with no answers.
1 vote
1 answer
170 views

Is there any publically available job recommendation (person to job fit) dataset?

I want a dataset that contains resumes and job descriptions, and information about successful job applications for my research work. Is there any dataset available publically?
2 votes
2 answers
63 views

Where can I find pdf of articles in French, their titles and abstracts/summaries?

I have a task to find a title/make a summary of market research, in pdfs, in French. So I'm trying to find a dataset of the closest to it to create a model. I was thinking of press articles in pdf as ...
8 votes
5 answers
1k views

Most common words in English

I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
4 votes
1 answer
91 views

User complaint/review description for running nlp-ner on telecom(preferably) data

I am looking for Consumer complaint/review description data which is not generated from automatic logs but manually entered by the end-user/customer-support. The objective is to run the Stanford NLP-...
1 vote
1 answer
187 views

Dataset listing datasets for natural language processing

I am looking for a dataset listing datasets for natural language processing with as many following fields as possible: name annotations (e.g., part of speech, dependency parses, or named entities) ...
0 votes
0 answers
31 views

Looking For Datasets on U.S. City Locations for Data Science Project? [duplicate]

I am currently working on a project that requires datasets detailing the locations of different cities across the United States. Specifically, I'm looking for data that includes city names along with ...
3 votes
2 answers
54 views

Is there a corpus of "nice", inoffensive English words?

I'm looking for an English language corpus that doesn't include profanity or "unpleasant" words to generate easy to remember passwords and other strings for users. Does anybody know of such ...
1 vote
1 answer
4k views

Dataset that contains customer support interaction

I am looking for datasets containing customer support interaction. Not any aggregated statistics (resolution time, survey results), but the actually written emails/chat messages between customers and ...
1 vote
1 answer
21 views

Datasets of legal correspondences

I am searching for datasets of legal correspondences between for example lawyers. For example, a response to a complaint from an airline customer. Preferably the legal basis should be with respect to ...
1 vote
0 answers
12 views

Are there NLP datasets that label each word type

I'm looking for NLP datasets that contain word types. For example, There is an apple on the table. They have to table a motion for debate at the next Party Conference. Clearly, the world table is ...
0 votes
1 answer
592 views

oxford dictionary database for NLP

I am using NLP for sentiment analysis ,so I need to determine the type of speech , can any one help me where can I download dataset/database for oxford dictionary?
2 votes
2 answers
665 views

mimic iii: could a pretrained word2vec be made available?

Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
3 votes
1 answer
659 views

Download OpenOffice/Hunspell dictionaries (.oxt / .dic+.aff) for many languages at once?

I would like dictionaries for the top ~100 languages or so. Manually searching and evaluating the results at https://extensions.openoffice.org is quite cumbersome at that scale. Is there a command ...
2 votes
1 answer
81 views

Known datasets for long document analysis

Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
1 vote
0 answers
20 views

Data for multi-modal semantic search

Context: I am interested in the potential to use vector indexing and semantic search for multimodal data. For instance, a retail website may have unstructured text data from the advertising copy on ...
0 votes
0 answers
20 views

Customer review dataset that can be publicly reshareable

I'm looking for a dataset of customer reviews and whose license allows academic and industry researchers to annotate the dataset and publicly share the annotated dataset (e.g., via a GitHub repo). I ...
4 votes
1 answer
253 views

Labeled dataset for sentiment analysis in Mandarin

I am doing my research on sentiment analysis for Standard Mandarin. I don't have any benchmark dataset. I need usable labeled dataset for my research.
1 vote
0 answers
32 views

Hierarchical semantic distances dataset

I need data (preferably human judgment) for the structural/hierarchical semantic distance between many couples (at least hundreds) of words. For example, d(computer, television) < d(radio, ...
2 votes
1 answer
234 views

computer science corpus for language model training

I am looking for a domain-specific computer science corpus of at least 20M words (preferable >50M words), for the purpose of training a language model in it. Is there anything out-of-the-box that I ...
6 votes
4 answers
8k views

Dataset for english words of dictionary for a NLP project

I am working on a NLP project, and for that I need a dataset of English words (words typically found in dictionary). Could somebody please guide me how to put together such dataset? Is there any ...
11 votes
7 answers
7k views

Large French dataset for NLP (not formal, rather discussions/reviews)

What am I looking for ? I'm looking for a big dataset (at least a few GB) containing French text. This french text should not have too much quality (such as literature or encyclopedias). Why this ...
14 votes
4 answers
12k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
4 votes
7 answers
7k views

Where can I find a dataset containing legal documents?

I have a machine learning task I wish to pursue. For the task I will need several hundred sample legal documents of the following types: Employment contract, service contract, sale contract, rental ...
3 votes
0 answers
65 views

Corpus for intention mining

I need a corpus with intention words, but I was not able to get one yet. please, somebody, help me. Note: I'm new to intention mining if you know some useful corpus or links on intention mining please ...
9 votes
4 answers
3k views

Tool to extract the main concepts/topics from web pages

I need to find the main themes or topics for each of 50,000 website urls. For example, http://austinzencenter.org/ should return topics such as zen, monastic, austin, retreat, buddha, etc. I'm ...
2 votes
1 answer
407 views

Datasets for Topic Modeling

I'm looking to try and use deep learning methods for topic modeling as opposed to the more traditional methods of lda and word embedding methods. However, I'm having trouble finding good labeled ...
2 votes
0 answers
25 views

Dataset that contains human-written transcripts of videos or audio files

I'm looking for a dataset that contains human-written transcripts of videos or audio files (e.g., podcast). I'm aware of the IWSLT2011 (TED) dataset and OpenSubtitles. What else exists?
6 votes
2 answers
7k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
1 vote
1 answer
349 views

Index of YouTube video titles

I'm looking for a way to identify (as many as possible) YouTube videos on a certain topics based on a keywords occurring in their titles. YouTube Data API provides a way to search for videos based on ...
2 votes
0 answers
66 views

Getting cold calls data set

I am looking for cold calls data set for my research. the data should be an audio file of recorded calls. ( sales calls ..) Any idea where can I get such data?
2 votes
0 answers
35 views

Data on press conferences from English-speaking press conferences

I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
1 vote
0 answers
93 views

How many sample sentences are required to train a model in opennlp?

I need to create my own model in opennlp. I have to create my own dataset since I couldn't get the calendar events dataset. Can anyone tell how many sample sentences are required to train a model?
1 vote
0 answers
14 views

User reviews for consumer tech products, but in French

So I am working on a sentiment analysis project where I need to gather french reviews about some giving product (iPhone XR, PS5, or anything as long as there is enough data), I tried Reddit (praw API) ...
1 vote
0 answers
27 views

Is there any publicly available Radiology dataset for NLP (Natural Language Processing) purposes?

I'm looking for publicly available Radiology reports data collection which I can use to proceed with my research. Do you happen to know some?
2 votes
2 answers
83 views

Common text data sets in form of panel data

I want to test machine learning tasks on time-divided textual data set. For this purpose, I want to use a common text data set which is already validated and "good" for use. I already found a Web of ...
2 votes
0 answers
37 views

Looking for public news articles dataset with their associated categories

I'm looking for datasets that contain labeled news articles. I'm trying to build information retrieval application using latent semantic analysis. I've already used: http://qwone.com/~jason/...
0 votes
1 answer
59 views

Twitter dataset to train word embeddings

I'm working on a project related to manipulating word embeddings. In order to do this, I need to train them myself on twitter data. Given Twitter's policy, I am unable to find a suitable dataset. Does ...
1 vote
0 answers
18 views

Elder patient dialogue corpus

I am looking for a corpus with dialogue between elderly patients (in a nursing home, hospital, their houses) and caregivers (nurses, doctors, family members). Do you know of anything like this?
2 votes
1 answer
60 views

Is there a Simplified Chinese thesaurus file, like Moby for English?

I'm looking for a manually curated thesaurus/synonyms file for Simplified Chinese. Like the English Moby thesaurus, but in simplified Chinese. Does such a thing exist? I'm aware that WordNet can be ...
1 vote
1 answer
55 views

(Serious) Dataset of paedophilic Youtube comments (or similar)?

I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image. It'...
1 vote
1 answer
45 views

What are the best sources to find labelled review data sets for text classification?

I have been searching for labelled review data sets for training for label classification. However it has been a bit surprising for me that I could find only sentiment classification data sets and ...
5 votes
1 answer
144 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
2 votes
1 answer
70 views

Dataset for NLP Text Summarization

Looking for a dataset for NLP Text Summarization consisting of articles and their headlines long news articles summaries of articles sentences extracted from user reviews on a given topic interviews ...
1 vote
2 answers
93 views

I need a dialogue dataset

Where can I find a dataset of 2 people chit-chat dialogues? I need the data to be of full conversations, from "Hi" to "bye" so to speak.
user avatar
7 votes
1 answer
361 views

Dataset for queries that are questions or others

I am looking for a dataset of queries that are posted in live chats or service providing chats. I want to test my API for tagging a query that is entered by the customer as a question or not a ...
2 votes
1 answer
71 views

repository of pretrained neural translation models

I'm looking for pretrained neural translation models, preferably for pytorch or tensorflow. Pretrained models should be well documented. Ideally, the training should be reproducable with both data ...
1 vote
1 answer
16 views

What measure can I use for rank order comparison of most-common n-grams in two sets of data?

I have a real dataset of sequences of events and a "fake" dataset generated using an lstm model. The two datasets are made up of the same vocabulary but are of a different length. I'm putting together ...
5 votes
1 answer
78 views

Where to find medical related data?

I am wondering where to retrieve medical related data, particularly those related to Tropical Medicine? It would be wonderful if anyone can suggest where to find these: A collection (I mean thousands ...
0 votes
1 answer
277 views

Where can I find a dataset with labelled articles by topic?

I am looking for a dataset containing articles (with article-text, or alternatively I am fine with only URLs too) and the corresponding topic label (i.e. politics, art, gardening etc.) Any idea?