11
votes
Database world cities with their names in all languages of the world
Wikidata has a category called "city" which will give you a list of world cities
https://www.wikidata.org/wiki/Q515
You can use SPARQL to query Wikidata
https://www.mediawiki.org/wiki/...
- 17.6k
9
votes
Accepted
Speech audio files dataset with language labels
You can use the Tatoeba website which has full sentences in text and audio as downloads.
Sentences with audio
Download
http://downloads.tatoeba.org/exports/sentences_with_audio.tar.bz2
Fields and ...
- 17.6k
9
votes
Database world cities with their names in all languages of the world
I guess the Geonames project is the closest answer to your question. You can download the data directly on the website or you can also find it here and download it/use the api.
Cheers
- 1,157
8
votes
Accepted
List of abbreviations and acronyms
I found a github repository that scrapes the wiki list of roughly 6000 acronyms
https://github.com/krishnakt031990/Crawl-Wiki-For-Acronyms
raw acronyms file
and then I wrote this python script to ...
- 17.6k
8
votes
Speech audio files dataset with language labels
I suggest looking at the SpokenLanguages2 dataset, which is very extensive, containing a bit more than one hour of speech for each of the 172 languages: https://community.topcoder.com/longcontest/?...
- 81
7
votes
Speech audio files dataset with language labels
Maybe you can do something with https://rhinospike.com/language/ It's a bit like Tatoeba mentioned above
edit : Take also a look at librivox (public domain audiobooks). It comes with an API, then you ...
- 131
7
votes
Speech audio files dataset with language labels
UCLA Phonetics Lab Archive offers many audio files of spoken word in many languages, although you'll have to dig through and mix-match to your liking:
http://archive.phonetics.ucla.edu/
IPA Handbook ...
- 11.9k
7
votes
Accepted
Audio Datasets Featuring Different Speakers Saying the Same Sentence (English)?
The speech accent archive:
uniformly presents a large set of speech samples from a variety of
language backgrounds.
As for English, the following subset contains the sentences:
Please call ...
- 517
6
votes
6
votes
Is a spoken digit dataset available?
https://github.com/Jakobovski/free-spoken-digit-dataset is a free spoken digit dataset (FSDD).
As an added bonus it comes with a few useful python utility functions.
I created this dataset because I ...
- 160
6
votes
Speech audio files dataset with language labels
I've found something else. It is called the wide language index. See on github. It consists in a listing of radio podcasts. It's pretty impressive in the numbers of languages covered.
Note : It was ...
- 131
6
votes
German news/text data set
I think a good source would be the COSMAS II-Korpora from the Institut für Deutsche Sprache.
It seems there is free registration and downloads for non-commercial use.
- 17.6k
6
votes
Database world cities with their names in all languages of the world
As a variation of above, if you want all the labels in all the languages, you can get it from Wikidata like so:
SELECT DISTINCT ?city ?country (lang(?label) AS ?language) ?label
WHERE
{
?city ...
- 386
6
votes
Accepted
How to collect hand-writting data
The first step is splitting the image into character arrays. To do that, check out the answers in this question: Separate image of text into component character images. In particular, the ImageMagick ...
- 17.6k
6
votes
Accepted
Is there any picture corpus?
You may be able to use the International Picture Naming Project (IPNP), but I think the total pictures are way less than 10k.
Here's a link to the query tool.
You may get lucky searching through "...
- 17.6k
6
votes
Where can I find a list of latin words?
You can get 8600 Latin words from Latin wikitionary or 879.898 Latin words from English wiktionary using PetScan. You can change output to csv or tsv in the "Output" tab.
- 381
5
votes
Single-word Translations in All Languages
I'm not aware of an available dataset in the requested form, but it should be possible to obtain something similar by parsing data from wiktionary. The latest dump can be obtained at https://dumps....
- 153
5
votes
Phones dataset for speech recognition (not telephone number)
You can find US and British english language phones at university linguistic departments such as Berkeley, Ca. Though, what is useful for speech recognition are the features in statistical acoustic ...
- 131
5
votes
ASCII Character Frequency Analysis
You can pretty easily create character (or word) frequency data based on a few lines of code. Here is python 2.7 code that collects counts of each character
# -*- coding: utf-8 -*-
import string ...
- 17.6k
5
votes
Where can I find a list of latin words?
I haven't found any ready lists with just Latin words in txt format, but you can parse these lists to extract the Latin words from them:
Dickinson College: LATIN CORE VOCABULARY. Terms of use: "(...)...
- 229
5
votes
Swedish Noun Gender List
Probably the Swedish Academian Wordlist (SAOL) is the most authoritative source in this field.
There exists SAOL for Android, the .obb expansion file is a regular SQLite database.
This list was ...
- 2,965
4
votes
4
votes
Dataset of common typos in English
Here is a link to several corpora of commonly misspelled words in several varieties of English - list includes the Birbeck Spelling Error corpus
4
votes
Accepted
Dataset of English Poetry
To ensure public domain poetry, you can use Project Gutenberg. In particular, they have a "Bookshelf" specific to poetry. With some exceptions, Project Gutenberg is mostly English.
You can download ...
- 17.6k
4
votes
Accepted
Wikidata label language: How to fallback to ANY language?
As optional get the label in English and in any language, then coalesce:
SELECT
?item
(SAMPLE(COALESCE(?en_label, ?item_label)) as ?label)
WHERE {
?item wdt:P31 wd:Q22674925 .
OPTIONAL {?item ...
- 8,386
4
votes
Accepted
Looking for a free dataset of book titles classified by some well-established and unified classification system
I think you may be underestimating the BL dataset - the "researcher-format" CSVs are small themed sets of papers, but the ones just above it on that page include the British National ...
- 803
3
votes
Is a spoken digit dataset available?
How about the UCI in Arabic? Ther are not exactly audio files, but it gets the job done.
https://archive.ics.uci.edu/ml/datasets/Spoken+Arabic+Digit
3
votes
American English SMS Text Message Corpora
I recently made a corpus available of text messages from Spanish-dominant bilingual young adults in New York City (Bilingual Youth Texts Corpus). It is at www.byts.commons.gc.cuny.edu
- 31
3
votes
List of English words phonetics
The CMU Pronunciation Dictionary sounds like it would be useful for something like this:
http://www.speech.cs.cmu.edu/cgi-bin/cmudict
It has pronunciation guides for 134,000 English words and uses ...
- 39
Only top scored, non community-wiki answers of a minimum length are eligible