Skip to main content
8 votes
Accepted

List of abbreviations and acronyms

I found a github repository that scrapes the wiki list of roughly 6000 acronyms https://github.com/krishnakt031990/Crawl-Wiki-For-Acronyms raw acronyms file and then I wrote this python script to ...
philshem's user avatar
  • 17.6k
8 votes

Speech audio files dataset with language labels

I suggest looking at the SpokenLanguages2 dataset, which is very extensive, containing a bit more than one hour of speech for each of the 172 languages: https://community.topcoder.com/longcontest/?...
Ninn's user avatar
  • 81
7 votes

Speech audio files dataset with language labels

Maybe you can do something with https://rhinospike.com/language/ It's a bit like Tatoeba mentioned above edit : Take also a look at librivox (public domain audiobooks). It comes with an API, then you ...
fdeloche's user avatar
  • 131
7 votes
Accepted

Audio Datasets Featuring Different Speakers Saying the Same Sentence (English)?

The speech accent archive: uniformly presents a large set of speech samples from a variety of language backgrounds. As for English, the following subset contains the sentences: Please call ...
Laurent Duval's user avatar
6 votes

Speech audio files dataset with language labels

I've found something else. It is called the wide language index. See on github. It consists in a listing of radio podcasts. It's pretty impressive in the numbers of languages covered. Note : It was ...
fdeloche's user avatar
  • 131
6 votes

Database of English words pronunciation

Take a look at Project SHTOOKA
Denis Kulagin's user avatar
6 votes

Is a spoken digit dataset available?

https://github.com/Jakobovski/free-spoken-digit-dataset is a free spoken digit dataset (FSDD). As an added bonus it comes with a few useful python utility functions. I created this dataset because I ...
Jakobovski's user avatar
6 votes
Accepted

Is there any picture corpus?

You may be able to use the International Picture Naming Project (IPNP), but I think the total pictures are way less than 10k. Here's a link to the query tool. You may get lucky searching through "...
philshem's user avatar
  • 17.6k
6 votes

Where can I find a list of latin words?

You can get 8600 Latin words from Latin wikitionary or 879.898 Latin words from English wiktionary using PetScan. You can change output to csv or tsv in the "Output" tab.
Pere's user avatar
  • 381
5 votes

Phones dataset for speech recognition (not telephone number)

You can find US and British english language phones at university linguistic departments such as Berkeley, Ca. Though, what is useful for speech recognition are the features in statistical acoustic ...
Stoney's user avatar
  • 131
5 votes

Where can I find a list of latin words?

I haven't found any ready lists with just Latin words in txt format, but you can parse these lists to extract the Latin words from them: Dickinson College: LATIN CORE VOCABULARY. Terms of use: "(...)...
Tsundoku's user avatar
  • 229
5 votes

Swedish Noun Gender List

Probably the Swedish Academian Wordlist (SAOL) is the most authoritative source in this field. There exists SAOL for Android, the .obb expansion file is a regular SQLite database. This list was ...
Stanislav Kralin's user avatar
4 votes

Database of English words pronunciation

Maybe the Macmillan Dictionary API can help you
biology.info's user avatar
4 votes

Dataset of common typos in English

Here is a link to several corpora of commonly misspelled words in several varieties of English - list includes the Birbeck Spelling Error corpus
Brandon Loudermilk's user avatar
4 votes
Accepted

Dataset of English Poetry

To ensure public domain poetry, you can use Project Gutenberg. In particular, they have a "Bookshelf" specific to poetry. With some exceptions, Project Gutenberg is mostly English. You can download ...
philshem's user avatar
  • 17.6k
4 votes
Accepted

Wikidata label language: How to fallback to ANY language?

As optional get the label in English and in any language, then coalesce: SELECT ?item (SAMPLE(COALESCE(?en_label, ?item_label)) as ?label) WHERE { ?item wdt:P31 wd:Q22674925 . OPTIONAL {?item ...
Nicolas Raoul's user avatar
  • 8,446
4 votes
Accepted

Looking for a free dataset of book titles classified by some well-established and unified classification system

I think you may be underestimating the BL dataset - the "researcher-format" CSVs are small themed sets of papers, but the ones just above it on that page include the British National ...
Andrew is gone's user avatar
3 votes

ASCII Character Frequency Analysis

I wrote some code to analyse the reuters21578 corpus (thanks @philshem for pointing me to it)! You can find the results here - ascii_freq.txt or ascii_freq.json. The code used to generate them can be ...
PiersyP's user avatar
  • 131
3 votes

German news/text data set

Event registry provides access to news articles from more than 100.000 news sources in 15 languages including German. The only problem is that you can only get access to the last 3 years of articles. ...
Gregor Leban's user avatar
3 votes

Is a spoken digit dataset available?

How about the UCI in Arabic? Ther are not exactly audio files, but it gets the job done. https://archive.ics.uci.edu/ml/datasets/Spoken+Arabic+Digit
Pau Vilimelis Aceituno's user avatar
3 votes

American English SMS Text Message Corpora

I recently made a corpus available of text messages from Spanish-dominant bilingual young adults in New York City (Bilingual Youth Texts Corpus). It is at www.byts.commons.gc.cuny.edu
MichelleMc's user avatar
3 votes

List of English words phonetics

The CMU Pronunciation Dictionary sounds like it would be useful for something like this: http://www.speech.cs.cmu.edu/cgi-bin/cmudict It has pronunciation guides for 134,000 English words and uses ...
Geoff's user avatar
  • 39
3 votes

Is there any picture corpus?

Wikidata has linked various concepts and lexemes to images. For lexemes and their senses there are not that many images yet. For concepts there are many, but many are proper nouns or complex concepts, ...
Finn Årup Nielsen's user avatar
3 votes
Accepted

Where can I find subtitled recordings of university courses?

Any video on YouTube that has captions can be used, although you'll (probably) have to find a way to avoid auto-generated captions. For example, from MIT (with friendly CC license). You can use open ...
philshem's user avatar
  • 17.6k
3 votes

Audio data set of (telephone) conversations and their transcriptions

Most telephone recording datasets are privately owned by parties who have access to such data like for example call-centers and tech-support companies etc. This data is subject to various privacy laws ...
SuperKogito's user avatar
3 votes

English to Telugu and Telugu to English dictionary database

How about Wiktionary? https://te.wiktionary.org Bulk downloads are available: https://dumps.wikimedia.org/ https://dumps.wikimedia.org/tewiktionary/ https://dumps.wikimedia.org/tewiktionary/latest/...
philshem's user avatar
  • 17.6k
3 votes

CEFR for English words by level

Cambridge University Press is making the A1-C2 English Vocabulary Profile available free of charge to teachers and educationalists around the world. Go to EVP Online to access the resource.
Orophile's user avatar
  • 1,761
3 votes
Accepted

Linguistics. German verbs

This verbs.csv seems to be exactly what you are looking for. It includes 8049 verb with their associated conjugations. The list is part of the german-verbs-database.
SuperKogito's user avatar
2 votes

List of English words

Google N-grams As I mentioned elsewhere, Google Ngrams are perhaps the largest corpus of English words: http://storage.googleapis.com/books/ngrams/books/datasetsv2.html Keep in mind that it ...
Anton Tarasenko's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible