Questions tagged [nlp]
Natural language processing (NLP) is a subfield of artificial intelligence and machine learning that involves transforming or extracting useful information from natural language data.
149
questions
1
vote
1
answer
27
views
Where can I find pdf of articles in French, their titles and abstracts/summaries?
I have a task to find a title/make a summary of market research, in pdfs, in French.
So I'm trying to find a dataset of the closest to it to create a model.
I was thinking of press articles in pdf as ...
1
vote
0
answers
12
views
Data for multi-modal semantic search
Context: I am interested in the potential to use vector indexing and semantic search for multimodal data. For instance, a retail website may have unstructured text data from the advertising copy on ...
- 111
0
votes
0
answers
11
views
Customer review dataset that can be publicly reshareable
I'm looking for a dataset of customer reviews and whose license allows academic and industry researchers to annotate the dataset and publicly share the annotated dataset (e.g., via a GitHub repo).
I ...
- 7,700
0
votes
0
answers
39
views
Annotated Corpus for Named Entity Recognition in Finance
I'm looking for a textual dataset (e.g. documents) for a named entity recognition task in finance. The required entities are:
1- Credit Card Number
2- CVV Number
3- Account Balance
4- Salary
5- Tax ...
- 1
0
votes
0
answers
11
views
Sentiment analysis applied to reviews of pharmaceutical drugs
I'm looking for a dataset for sentiment analysis applied to reviews of pharmaceutical drugs. I.e. a set of sentences from reviews of pharmaceutical drugs labels with a score indicating their sentiment....
- 7,700
0
votes
0
answers
8
views
dataset with max 500 Token text with different content
for training a model on question answering im looking for a dataset that contains text from different sources, like a paragraph
should contain
from different sources like Wikipedia, random web article
...
- 61
0
votes
1
answer
80
views
oxford dictionary database for NLP
I am using NLP for sentiment analysis ,so I need to determine the type of speech , can any one help me where can I download dataset/database for oxford dictionary?
0
votes
1
answer
781
views
Dataset that contains customer support interaction
I am looking for datasets containing customer support interaction. Not any aggregated statistics (resolution time, survey results), but the actually written emails/chat messages between customers and ...
1
vote
0
answers
18
views
Dataset that contains human-written transcripts of videos or audio files
I'm looking for a dataset that contains human-written transcripts of videos or audio files (e.g., podcast). I'm aware of the IWSLT2011 (TED) dataset and OpenSubtitles. What else exists?
- 7,700
1
vote
1
answer
225
views
Index of YouTube video titles
I'm looking for a way to identify (as many as possible) YouTube videos on a certain topics based on a keywords occurring in their titles.
YouTube Data API provides a way to search for videos based on ...
- 233
1
vote
1
answer
116
views
Is there any publically available job recommendation (person to job fit) dataset?
I want a dataset that contains resumes and job descriptions, and information about successful job applications for my research work. Is there any dataset available publically?
- 11
2
votes
0
answers
34
views
Looking for public news articles dataset with their associated categories
I'm looking for datasets that contain labeled news articles. I'm trying to build information retrieval application using latent semantic analysis.
I've already used:
http://qwone.com/~jason/...
- 21
1
vote
0
answers
13
views
User reviews for consumer tech products, but in French
So I am working on a sentiment analysis project where I need to gather french reviews about some giving product (iPhone XR, PS5, or anything as long as there is enough data), I tried Reddit (praw API) ...
- 11
1
vote
0
answers
17
views
Elder patient dialogue corpus
I am looking for a corpus with dialogue between elderly patients (in a nursing home, hospital, their houses) and caregivers (nurses, doctors, family members). Do you know of anything like this?
- 111
2
votes
1
answer
47
views
Is there a Simplified Chinese thesaurus file, like Moby for English?
I'm looking for a manually curated thesaurus/synonyms file for Simplified Chinese. Like the English Moby thesaurus, but in simplified Chinese. Does such a thing exist?
I'm aware that WordNet can be ...
- 121
1
vote
1
answer
54
views
(Serious) Dataset of paedophilic Youtube comments (or similar)?
I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image.
It'...
- 133
0
votes
1
answer
52
views
Twitter dataset to train word embeddings
I'm working on a project related to manipulating word embeddings. In order to do this, I need to train them myself on twitter data. Given Twitter's policy, I am unable to find a suitable dataset. Does ...
1
vote
2
answers
50
views
I need a dialogue dataset
Where can I find a dataset of 2 people chit-chat dialogues? I need the data to be of full conversations, from "Hi" to "bye" so to speak.
1
vote
1
answer
36
views
What are the best sources to find labelled review data sets for text classification?
I have been searching for labelled review data sets for training for label classification. However it has been a bit surprising for me that I could find only sentiment classification data sets and ...
- 13
2
votes
1
answer
56
views
Dataset for NLP Text Summarization
Looking for a dataset for NLP Text Summarization consisting of
articles and their headlines
long news articles
summaries of articles
sentences extracted from user reviews on a given topic
interviews
...
- 1,661
2
votes
1
answer
57
views
repository of pretrained neural translation models
I'm looking for pretrained neural translation models, preferably for pytorch or tensorflow.
Pretrained models should be well documented. Ideally, the training should be reproducable with both data ...
- 133
2
votes
1
answer
66
views
Known datasets for long document analysis
Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
- 121
1
vote
1
answer
15
views
What measure can I use for rank order comparison of most-common n-grams in two sets of data?
I have a real dataset of sequences of events and a "fake" dataset generated using an lstm model. The two datasets are made up of the same vocabulary but are of a different length. I'm putting together ...
- 121
2
votes
1
answer
192
views
computer science corpus for language model training
I am looking for a domain-specific computer science corpus of at least 20M words (preferable >50M words), for the purpose of training a language model in it.
Is there anything out-of-the-box that I ...
- 21
0
votes
1
answer
161
views
Where can I find a dataset with labelled articles by topic?
I am looking for a dataset containing articles (with article-text, or alternatively I am fine with only URLs too) and the corresponding topic label (i.e. politics, art, gardening etc.)
Any idea?
Carbo
1
vote
0
answers
78
views
Where can I find Investopedia data set for download? [closed]
I want to train a NLP model based on investopedia data set but I am not able to find it.
- 111
0
votes
1
answer
62
views
Corpus suggestion for financial domain
I am looking for a financial corpus or any form of publicly available financial texts which is replete with technical terms and acronyms.
Any suggestion is appreciated
2
votes
0
answers
29
views
Where can I find labeled sentences?
I am looking for sentences csv labeled like this, or something similar:
I am going to run a marathon., achievement
I miss my high school friend., friendship
I would like to lose 10 pounds, ...
- 121
2
votes
1
answer
295
views
Datasets for Topic Modeling
I'm looking to try and use deep learning methods for topic modeling as opposed to the more traditional methods of lda and word embedding methods. However, I'm having trouble finding good labeled ...
- 121
2
votes
2
answers
74
views
Common text data sets in form of panel data
I want to test machine learning tasks on time-divided textual data set. For this purpose, I want to use a common text data set which is already validated and "good" for use. I already found a Web of ...
- 123
3
votes
0
answers
22
views
Knowledge-base of typical/notable values of attribute
For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns).
We are curious about ...
- 131
2
votes
1
answer
111
views
psychological / patient dialogue data for nlp analisys
I search data for chatbot for psychological task.
I found some source about it:
https://berkeleysciencereview.com/nlp-for-psychotherapy/
Where can I find data with dialogue of psychologist and ...
- 21
1
vote
0
answers
26
views
Is there any publicly available Radiology dataset for NLP (Natural Language Processing) purposes?
I'm looking for publicly available Radiology reports data collection which I can use to proceed with my research. Do you happen to know some?
- 11
0
votes
0
answers
12
views
reliable spanish word empeddings (word2vec output format)
I'm looking for spanish word vectors (preferably word2vec output format) to use in a scala nlp application. I've tried the ones on https://github.com/uchile-nlp/spanish-word-embeddings, but they are ...
- 121
2
votes
1
answer
46
views
Source of multilingual chat/online/contemporary corpus data?
I need to develop autocorrection and prediction for mobile keyboard app that will work for some 8-10 most common Latin languages + Russian (English, German, Spanish, Portugues, French, ...). For start,...
- 121
1
vote
0
answers
44
views
Conversation logs open data
Is there any open data on conversation logs?
I am looking for open data on conversation logs, yes between individual people. Ideally private chat logs. I am considering using a bot to scrape a ...
- 111
1
vote
0
answers
133
views
non functional requirements dataset
I am developing a machine learning project which analyzes requirement specification and categorizes the non-functional requirements into categories like database, web socket, backend technology, etc. ...
- 11
1
vote
0
answers
23
views
Estonian named entity recognition data
I'm looking for estonian named entity recognition data. Till now I am unable to find one. Although Estonia has 90% of it's Govt services online, I can't find their NER data anywhere. I tried estnltk, ...
2
votes
1
answer
259
views
Public dataset for spanish news articles with title and content
I am wondering if there are any public datasets of news in SPANISH similar to this dataset.
Which consists mostly of ENGLISH news. There is a similar question already answered here.
However, I require ...
David R.
0
votes
0
answers
193
views
Recent dump of names from facebook.com/directory?
For years all names of all Facebook users were listed at
https://www.facebook.com/directory.
Even without the links to the profiles themselves, it was a very useful dataset of diverse names and ...
2
votes
1
answer
153
views
Is there any public dataset on Bangla Language handwriting available?
I am willing to work on a natural language processing project that encompasses learning from Bangla handwritten texts. Hence, I am looking for publicly available Bangla handwritten texts' dataset.
- 23
4
votes
1
answer
98
views
Speech recognition english corpuses
Could someone provide a list (or link to) of english speech recognition corpuses with their availability and size (preferably in hours).
0
votes
2
answers
583
views
Looking for Databases with gender of names and Ethnicity information
I want to build a classifier which can classify gender and ethnicity based on the names.
I am looking for datasets to download where I take samples for supervised learning.
If there are no open ...
- 167
2
votes
0
answers
131
views
How to use DBpedia to identify the topics
In the paper "Discovering Relevant Topics using DBPedia providing non-obvious recommendations" they have used skos:broader property and dcterms:subject property.
In my task given the word I want to ...
- 201
1
vote
2
answers
620
views
mimic iii: could a pretrained word2vec be made available?
Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
- 19
2
votes
0
answers
79
views
Enron data set: Get labels whether an email has been replied or forwarded
I am currently browsing through the Enron data set in order to come up with a way to extract labels (true/false) on whether an email has been forwarded or replied to. The task would be to predict ...
- 121
1
vote
0
answers
29
views
Good sources for Data-sets for word problems of Calculus
I am currently working on a project involving solving word problems of Calculus through Natural Language Processing, AI algorithm. I tried to find a data-set for word problems of Calculus but could ...
4
votes
1
answer
582
views
Is there any open dataset for named entity linking?
Entity linking is the task of detecting mentions of entities from a knowledge base in a document.
Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
- 296
1
vote
0
answers
32
views
Hierarchical semantic distances dataset
I need data (preferably human judgment) for the structural/hierarchical semantic distance between many couples (at least hundreds) of words.
For example, d(computer, television) < d(radio, ...
- 111
3
votes
1
answer
168
views
Corpus of English text with tagged locations
I'm looking for corpora of English texts with locations tagged.
I am aware of CONLL2002. This is the type of corpus I'm looking for, but want more.
- 5,118