Questions tagged [language]

For questions related to human language. Use 'programming' instead for questions related to programming languages.

20 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
5
votes
0answers
713 views

Where to download the Forvo database?

Forvo.com is a website where native speakers submit pronunciation of words. The audio data is under the BY-NC-SA license. I can't find any obvious place to download the whole data. There is an API, ...
4
votes
0answers
103 views

List of inverse and polarity flip words required

I'm a computer science student and I'm doing a research on sentimental analysis with a large database. Therefore, i need to create dictionaries to mapping words. Now i'm facing the problem of "...
3
votes
0answers
140 views

Database of Diacritics

I'm working on a project to map Unicode English characters to diacritic characters in Javascript. When the user enters e.g. "doner" the search engine should also find e.g. "döner". So it should be ...
3
votes
0answers
55 views

American English pronunciation dictionary in text form showing syllables

Looking for pronunciation and syllabification data for American English. I want to analyze pronunciation and spelling rules/heuristics to see how accurate they are and identify exceptions. The goal ...
2
votes
0answers
53 views

Looking for open dataset mapping informal company names to ticker

We've looked for trained data for named entity recognition (in particular for company names). The end goal is to feed in a list of entity names (with potential misspellings, acronyms, punctuation etc) ...
1
vote
0answers
22 views

Paragraph Similar Pairs Dataset

I have been working on a project where I need to find whether two paragraphs convey the similar meaning. Same as Quora Question Pairs on Kaggle, but instead of questions, paragraphs. But I could not ...
1
vote
0answers
63 views

Is there a large database of unique surnames and their (origin) language?

Let me explain the phrases I use in my request: large: I'm looking for multiple languages (especially european languages if this constrain helps) and at least 2K surnames per language. But the more ...
1
vote
0answers
20 views

Dataset for English word trigrams

Does anyone know where to find such a dataset? There is Google's Ngram viewer but it is too big to be useful. I'm looking for something smaller. Perhaps with only the 100k most common English words ...
1
vote
0answers
16 views

Estonian named entity recognition data

I'm looking for estonian named entity recognition data. Till now I am unable to find one. Although Estonia has 90% of it's Govt services online, I can't find their NER data anywhere. I tried estnltk, ...
1
vote
0answers
18 views

Historical data of languages spoken in country by percent population?

I am looking for a dataset that contains the languages spoken in each country and their respective percentages of the population, going back as far back into the historical record as possible. I ...
1
vote
0answers
52 views

Where is a large list of declarative and imperative sentences

For a project I need a bunch (+500 each) grammatically correct sentences (English) that are declarative (basic or simple), imperative (command), and interrogative (question) (sorted by group or ...
1
vote
0answers
21 views

What are methods to create open text data from copyrighted texts?

Language data are either texts or spoken utterances. By default, any text is copyrighted. We have Open Data for relatively recent time periods, where text were written intentionally with an open ...
1
vote
0answers
27 views

Hierarchical semantic distances dataset

I need a data (preferably human judgment) for the structural/hierarchical semantic distance between many couples (at least hundreds) of word. For example, d(computer, television) < d(radio, ...
1
vote
0answers
166 views

Labeled dataset for sentiment analysis

I am doing my research on sentiment analysis for Standard Mandarin. I don't have any benchmark dataset. I need usable labeled dataset for my research.
1
vote
0answers
65 views

Mailing list datasets

Related to this question: Obtaining personal mail corpus I'm looking for a list of archived public mailing lists from diverse communities and in diverse languages. For example, a list would look ...
1
vote
0answers
27 views

Tourism/survival sentences in most languages

I am looking for the first 50 or 100 sentences/words that an English-only-speaking tourist would learn when staying in a non-English-speaking country for a few weeks. For instance, the first few ...
0
votes
0answers
23 views

Datasets for emotion recognition in German dialogues

I am currently working on the topic of emotion recognition in German dialogues (Speech). So far I only managed to find a single dataset related to this topic: Berlin Database of Emotional Speech. Is ...
0
votes
0answers
10 views

How to obtain multiple IGE datasheets simultaneously?

I am undertaking a study on the use of Galician based on certain sociodemographic variables. The IGE provides a good amount of data in this respect, but they are distributed in a large number of ...
0
votes
1answer
58 views

Looking for word frequency data for the Google Books ngrams

I have downloaded all the single words from Google Books ngram data (http://storage.googleapis.com/books/ngrams/books/datasetsv2.html) and I could write code to aggregate it all generate word ...
0
votes
0answers
99 views

Recent dump of names from facebook.com/directory?

For years all names of all Facebook users were listed at https://www.facebook.com/directory. Even without the links to the profiles themselves, it was a very useful dataset of diverse names and ...