Questions tagged [english]
For questions related to the usage and characteristics of the English language.
51
questions
0
votes
1
answer
24
views
Extemporaneous speech, as text, tagged by speaker?
tl;dr; I'm looking for a corpus (or multiple of them) of un-scripted English speech, transcribed to text and tagged by who said what. Ideally, I'd like hundreds or even thousands of distinct speakers.
...
- 101
0
votes
1
answer
17
views
Looking for "minimum viable English utterances" to provide sufficient phoneme coverage for TTS training
There are quite a lot of really, really large utterance/phoneme datasets out there, but I can't seem to find anything small. I'm looking for the minimum viable set of utterances/sentences in English ...
- 101
2
votes
2
answers
89
views
Text Dataset for Entity Recognition of personal data
I am looking for a data set to train and set a personal information masking application. Is there a text data set available with name, location, bank account numbers, SSN, Name, Ip address etc (either ...
2
votes
2
answers
151
views
CEFR for English words by level
Are there any open source data for English words by CEFR level?
I found https://www.oxfordlearnersdictionaries.com/wordlists/oxford3000-5000 , which categorizes English words based on CEFR level, ...
- 71
1
vote
0
answers
15
views
English Dictionary with Syntax Classifications Download
I'm looking for an english dictionary with english words' meaning but also with grammar classifications e.g. Hi (exclamation).
- 11
2
votes
0
answers
19
views
English tenses exercises database (with answers)
Where can I find english tenses database to add them into my learning app
3
votes
0
answers
22
views
Knowledge-base of typical/notable values of attribute
For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns).
We are curious about ...
- 131
0
votes
2
answers
179
views
Online Dictionary for Scraping
Does anybody know if there is an extensive online dictionary other than Wiktionary that lists many words on a single page, as opposed to having to search for a single word?
None of the online ...
- 121
1
vote
0
answers
27
views
Dataset for English word trigrams
Does anyone know where to find such a dataset? There is Google's Ngram viewer but it is too big to be useful. I'm looking for something smaller. Perhaps with only the 100k most common English words ...
- 111
1
vote
1
answer
60
views
French/English word database for a hangman game
I'm currently developing a Hangman game in English for a French website that teaches English. I'm looking for a database containing a set of English words, preferably common nouns or verbs of more ...
- 11
1
vote
0
answers
69
views
Words and Frequency/Probability of Spelling Mistakes
Data Request
I am looking for some data that contains English words along with the probability that a person will spell it incorrectly.
The probability depends on various factors. However, a simple ...
- 111
1
vote
1
answer
330
views
Looking for word frequency data for the Google Books ngrams
I have downloaded all the single words from Google Books ngram data (http://storage.googleapis.com/books/ngrams/books/datasetsv2.html) and I could write code to aggregate it all generate word ...
- 11
2
votes
2
answers
86
views
Large English text corpus
I am interested in studying a few specific questions on entropy of different properties of English text. For instance, what is the entropy of capital letters in English? This might tell you something ...
- 125
0
votes
1
answer
31
views
Open dictionary for English with International Phonetic Alphabet for every word
I'm seeking a dictionary that contains the IPA transcription for every word. Is such a resource available for English?
- 649
1
vote
1
answer
58
views
Books with multiple main characters, one per chapter
I am looking for public domain, or creative commons fiction,
with:
multiple main characters,
written in 3rd person
Each chapter focuses on a particular character
Modern examples of such books ...
9
votes
1
answer
341
views
Word list with learning age
I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned.
WordNet linkage is a big bonus.
- 251
1
vote
1
answer
128
views
Corpus of utterances and transcribed words for testing speech recognition algorithms
I am looking for a free English data set to use for testing different ASR API's.
- 111
3
votes
0
answers
71
views
English vocabulary by levels [duplicate]
(Duplicated from /r/datasets https://www.reddit.com/r/datasets/comments/5iozdt/request_english_vocabulary_by_levels/)
My group is doing a data mining assignment in which we want to categorize english ...
- 131
4
votes
1
answer
53
views
English queries to GIS systems
I'm building a system that tries to answer geospatial English questions such as "Where is the closest restaurant" or "How many historic sites are in the east of Nantes?". Underlying database is OSM. ...
- 41
4
votes
1
answer
2k
views
Dataset of English Poetry
Is there a dataset containing a group of poems in English? I couldn't find any resource online. I could web scrape poetry sites, but I want to avoid copyright issues and even a dataset of older poems ...
- 143
4
votes
2
answers
722
views
Semantic dictionary of English language
I am looking for a dictionary of English words tagged with their semantics. Like:
red t:color
green t:color
long t:size t:max
huge t:size t:max
tiny t:size t:min
hot ...
- 291
4
votes
2
answers
313
views
List of English Nouns and their Plural Form
Is there a list of nouns and their plurals?
E.g. apple apples, genius geni, roof rooves, etc.
I have the GCIDE dictionary but that only contains singular nouns.
- 143
1
vote
1
answer
2k
views
Dataset of common typos in English
I am looking for a dataset of common typos in English. Ideally, it should mention the frequency of typo.
- 7,640
7
votes
4
answers
669
views
Most common words in English
I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
- 7,640
10
votes
4
answers
4k
views
Corpus of tagged text (English newspapers or any tagged text)
I'm developing a system to extract tags from text (English) and currently I have no dataset to test the system and evaluate, could someone point me to a source (preferably a free one) thanks.
NOTE:
By ...
- 101
2
votes
0
answers
32
views
Data on press conferences from English-speaking press conferences
I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
- 21
3
votes
0
answers
223
views
Open Audio Database of English Letters
I have embarked on a project to gather spoken english letters into a free and open database. I call it the English Alphabet Audio Database.
My question is simple: does any other such database already ...
- 131
4
votes
0
answers
116
views
List of inverse and polarity flip words required
I'm a computer science student and I'm doing a research on sentimental analysis with a large database. Therefore, i need to create dictionaries to mapping words.
Now i'm facing the problem of "...
- 281
6
votes
1
answer
135
views
How can I get a list of synonyms that work across all contexts?
Many synonyms are context specific. For example "force" is a synonym for "drive" in the context of urging or inspiring, but not in the context of journeying by vehicle.
Other synonyms seem to work ...
- 371
5
votes
2
answers
121
views
Looking for modern english texts in public domain / CC-BY-SA
Is there a library of public domain / CC-BY-SA english texts, written later than 1990? I need it to build a corpora with links to full texts, which isn't possible with copyrighted material. At the ...
- 291
3
votes
0
answers
62
views
Database of programming terms
I want to find a terminology database with programming terms , for example:
Front-end
UI/UX
ruby
RoR
HTML 5
HTML
Any idea ?
- 139
3
votes
1
answer
84
views
Basic English proficiency in the world
I am looking for data showing how all world countries compare in terms of basic English proficiency.
In answers, the SAME METRIC should be used for all countries.
Reasonably recent, at least after ...
- 8,003
4
votes
2
answers
64
views
Are there opendatasets of English terms describing nationalities, ethnicities?
Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
SeanEaster
4
votes
3
answers
176
views
Where can I get a complete word and phrase list for English?
I am looking for a complete set of all possible English words and phrases (i.e. 'fire', 'fire up', 'fire ant', 'under fire').
Actually, I need it for parsing online dictionary.
The best thing i found ...
- 43
4
votes
0
answers
42
views
Novels with chapters annotated POV
I'm looking for one or more novels, that multiple characters points of view.
(I don't care if it is 3rd person or 1st person),
with each chapter (or paragraph) annotated as to which character's POV ...
3
votes
0
answers
40
views
Amount of English fiction literature in characters / publications
What can be a rough estimate of all the English fiction literature published to date in characters? Or the trends for fiction books published yearly? What can be the public sources for such estimates?
...
3
votes
1
answer
255
views
source of character-level ngrams that include spaces
I'm looking for a source of character-level ngrams and counts that include spaces. I've found character-level ngram datasets, but they don't include spaces. Ideally, the dataset will include up to 8-...
- 31
3
votes
2
answers
187
views
Google translate english monolingual definitions
Is google translate monolingual definitions open for commercial use? Am I violating intellectual property to use english words definitions in my english quiz app?
- 863
14
votes
2
answers
3k
views
Free English Dictionary
Looking for a free monolingual english dictionary like oxford or longman dictionary, but which I can freely use, without violating any intellectual property. I want to use it in my iOS app.
I need ...
- 863
5
votes
1
answer
1k
views
Longman English Dictionary Database
Is Longman English Dictionary as database available for public or should I digitalise it?
I plan to create an app based on Longman English Dictionary, but I need the database somehow. Any idea how?
- 863
6
votes
2
answers
5k
views
Looking for audio data set for English words
I am trying to obtain an audio data set for a list of English words. The list doesn't have to be extensive (for example, the data set can only have four or five words), but each word should have more ...
- 191
18
votes
6
answers
7k
views
Is there a free list of English word phonetics?
The list actually doesn't have to be free! I just need something that I can buy once or whatever.
And if possible, but not needed, parts of speech.
Before you say anything, I have googled for this ...
- 181
2
votes
1
answer
39
views
Relationship Advice/Advice Column Corpora?
I have the benefit of having a fairly green field project on my hands where I need to perform some language analysis on advice and etiquette giving. This involves both centralized sources (advice ...
- 800
11
votes
2
answers
5k
views
Database of English words difficulty
Data request
I am looking for a database that describes the "difficulty" of each English word.
Difficulty of a word is not easy to define, but it is probably a mix of:
Level of study needed to ...
- 8,003
14
votes
1
answer
2k
views
Speech audio databases with phonemes labelled
Can anyone point me to opensource databases of speech audio with phonemes labelled,
.wav or the like + label files, e.g.
# time, phoneme
0.31200 ao
0.41200 th
0.54200 er
...
I'd prefer English, ...
- 436
9
votes
1
answer
655
views
Text message corpus for American english
I am doing a research project to identify some patterns in how people interact with each other using text messages. The scope of the project is confined to American users. Can someone suggest a good ...
- 191
21
votes
2
answers
261
views
Data for word hierarchies
I'm looking for a dataset which will give me is-a and has-a type relations between senses (and give senses from words). WordNet seems to be the most popular model, but I'm trying to evaluate other ...
- 311
4
votes
6
answers
1k
views
Stemming of long English text
I need to perform stemming in my application, but mostly for a small subset of stems. I.e. to check if a given word is of a certain stem out of a small list of stem words. Maybe a hundred stem words ...
- 141
14
votes
4
answers
6k
views
Database of English words pronunciation
Is there any downloadable open database of English words pronunciation in audio format?
- 473
11
votes
2
answers
3k
views
American English SMS Text Message Corpora
I'm seeking corpora of American English SMS (<=160 characters) text messages. What corpora are available?
- 540