Questions tagged [language]

For questions related to human language. Use 'programming' instead for questions related to programming languages.

Filter by
Sorted by
Tagged with
12
votes
6answers
4k views

Is there a free list of English word phonetics?

The list actually doesn't have to be free! I just need something that I can buy once or whatever. And if possible, but not needed, parts of speech. Before you say anything, I have googled for this ...
9
votes
3answers
4k views

Dataset of sentences translated into many languages

I'm looking for a dataset of human translated sentences. The ideal dataset would look like this: 1, en, The weather is nice today. 1, de, Das Wetter ist heute schön. 1, es, El clima es agradable hoy....
16
votes
2answers
3k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...
11
votes
1answer
3k views

Database of English words difficulty

Data request I am looking for a database that describes the "difficulty" of each English word. Difficulty of a word is not easy to define, but it is probably a mix of: Level of study needed to ...
12
votes
7answers
1k views

List of English words

I'm writing a program that requires a list of English words, such as that used by a spell checker. I have been unable to find any such word lists whatsoever, even after trying 2 search engines.
9
votes
2answers
859 views

List of abbreviations and acronyms

I am searching an list of abbreviations,acronyms which should be downloadable as a sql table or json or sth. like that so no api cause it might be not fast enough or has a limit like this one: http://...
7
votes
4answers
4k views

Database world cities with their names in all languages of the world

I'm looking for a database of cities in the world with their names in all languages of the world. Where it is possible to download?
13
votes
1answer
2k views

Speech audio databases with phonemes labelled

Can anyone point me to opensource databases of speech audio with phonemes labelled, .wav or the like + label files, e.g. # time, phoneme 0.31200 ao 0.41200 th 0.54200 er ... I'd prefer English, ...
4
votes
2answers
61 views

Source of aggressively toned texts for machine learning

I was looking for a source where there would be an extended amount of texts with aggressive tone. It can be intertwined with non-aggressive texts, but it would be good if the ratio of aggressive texts ...
4
votes
1answer
3k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
14
votes
6answers
11k views

Speech audio files dataset with language labels

I am working on building a language classifier in speech/audio samples. I have been trying to find a dataset which may have considerable number of speech samples in various languages. The audio files ...
12
votes
3answers
3k views

Is a spoken digit dataset available?

Is a labeled dataset of spoken digits, that means of people saying "zero", "one", "two", three", "four", "five", "six", "seven", "eight", or "nine" available? I would also be interested in such a ...
9
votes
5answers
331 views

Data set of news articles and scientific journals

I am working on a project in NLP area and in order to test the result I need to compare it against different data sources. I already have NYTimes data source. So, I am looking for another news source ...
11
votes
2answers
2k views

American English SMS Text Message Corpora

I'm seeking corpora of American English SMS (<=160 characters) text messages. What corpora are available?
5
votes
2answers
291 views

Do you know a technique for text mining judicial decisions?

I'm trying to find a method to mine sepecific informations in judicial decisions (judge's name, court, area of law and neutral citation number[canadian way to cite decisions uniformly across the ...
0
votes
0answers
99 views

Recent dump of names from facebook.com/directory?

For years all names of all Facebook users were listed at https://www.facebook.com/directory. Even without the links to the profiles themselves, it was a very useful dataset of diverse names and ...
5
votes
1answer
513 views

Dataset of Sentences Classified by Type?

Where can I find a labeled dataset of sentences classified by type (interrogative and declarative)? I'm particularly lookings for Russian sentences, but other open and labeled datasets of other ...
4
votes
2answers
464 views

Dataset for Named Entity Recognition on Informal Text

I'm currently searching for labeled datasets to use to train a model to extract named entities from informal text (think something similar to tweets). Because capitalization and grammar are often ...
4
votes
2answers
87 views

Keyboard keystrokes with timing

Similar to this question: Where to find key log data for keyboard usage? ...but it doesn't have the answers I am looking for. I am researching keyboard layouts. I want to get timing data for each ...