Questions tagged [english]
For questions related to the usage and characteristics of the English language, or requests for data that must be in the English language.
55
questions
3
votes
2
answers
54
views
Is there a corpus of "nice", inoffensive English words?
I'm looking for an English language corpus that doesn't include profanity or "unpleasant" words to generate easy to remember passwords and other strings for users. Does anybody know of such ...
- 149
1
vote
0
answers
12
views
Seeking database, digital corpus, or text archive of Zen Buddhist texts
Particularly interested in Sutras and Koans in English (open domain).
3
votes
2
answers
307
views
Is it possible to download all audios of English words from Wiktionary
Inspired by this answer I downloaded 68563 pronunciation files(both mp3 and ogg), but I found that some audios are missing. For instance, cloze and demise. Then I tried WiktionaryParser:
from ...
- 255
1
vote
1
answer
379
views
Looking for a free dataset of book titles classified by some well-established and unified classification system
I am looking for a free dataset of book titles:
Classified by Dewey Decimal Classification (DDC) or by Library of Congress Classification (LCC).
Wide coverage. I've seen Researcher Format (CSV) ...
- 233
0
votes
1
answer
37
views
Extemporaneous speech, as text, tagged by speaker?
tl;dr; I'm looking for a corpus (or multiple of them) of un-scripted English speech, transcribed to text and tagged by who said what. Ideally, I'd like hundreds or even thousands of distinct speakers.
...
- 101
0
votes
1
answer
55
views
Looking for "minimum viable English utterances" to provide sufficient phoneme coverage for TTS training
There are quite a lot of really, really large utterance/phoneme datasets out there, but I can't seem to find anything small. I'm looking for the minimum viable set of utterances/sentences in English ...
- 101
2
votes
2
answers
157
views
Text Dataset for Entity Recognition of personal data
I am looking for a data set to train and set up a personal information masking application. Is there a text data set available with the name, location, bank account numbers, SSN, Name, Ip address etc (...
2
votes
2
answers
1k
views
CEFR for English words by level
Are there any open source data for English words by CEFR level?
I found https://www.oxfordlearnersdictionaries.com/wordlists/oxford3000-5000 , which categorizes English words based on CEFR level, ...
- 71
1
vote
0
answers
18
views
English Dictionary with Syntax Classifications Download
I'm looking for an english dictionary with english words' meaning but also with grammar classifications e.g. Hi (exclamation).
- 11
2
votes
0
answers
26
views
English tenses exercises database (with answers)
Where can I find english tenses database to add them into my learning app
3
votes
0
answers
22
views
Knowledge-base of typical/notable values of attribute
For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns).
We are curious about ...
- 131
0
votes
3
answers
405
views
Online Dictionary for Scraping
Does anybody know if there is an extensive online dictionary other than Wiktionary that lists many words on a single page, as opposed to having to search for a single word?
None of the online ...
- 121
1
vote
0
answers
43
views
Dataset for English word trigrams
Does anyone know where to find such a dataset? There is Google's Ngram viewer but it is too big to be useful. I'm looking for something smaller. Perhaps with only the 100k most common English words ...
- 111
1
vote
1
answer
87
views
French/English word database for a hangman game
I'm currently developing a Hangman game in English for a French website that teaches English. I'm looking for a database containing a set of English words, preferably common nouns or verbs of more ...
- 11
1
vote
0
answers
108
views
Words and Frequency/Probability of Spelling Mistakes
Data Request
I am looking for some data that contains English words along with the probability that a person will spell it incorrectly.
The probability depends on various factors. However, a simple ...
- 111
1
vote
1
answer
510
views
Looking for word frequency data for the Google Books ngrams
I have downloaded all the single words from Google Books ngram data (http://storage.googleapis.com/books/ngrams/books/datasetsv2.html) and I could write code to aggregate it all generate word ...
- 11
2
votes
2
answers
145
views
Large English text corpus
I am interested in studying a few specific questions on entropy of different properties of English text. For instance, what is the entropy of capital letters in English? This might tell you something ...
- 125
1
vote
2
answers
93
views
Open dictionary for English with International Phonetic Alphabet for every word
I'm seeking an openly-licensed dictionary that contains for every word the IPA transcription.
Is such a resource available for English?
- 661
1
vote
1
answer
61
views
Books with multiple main characters, one per chapter
I am looking for public domain, or creative commons fiction,
with:
multiple main characters,
written in 3rd person
Each chapter focuses on a particular character
Modern examples of such books ...
10
votes
1
answer
573
views
Word list with learning age
I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned.
WordNet linkage is a big bonus.
- 261
1
vote
1
answer
131
views
Corpus of utterances and transcribed words for testing speech recognition algorithms
I am looking for a free English data set to use for testing different ASR API's.
- 111
3
votes
0
answers
76
views
English vocabulary by levels [duplicate]
(Duplicated from /r/datasets https://www.reddit.com/r/datasets/comments/5iozdt/request_english_vocabulary_by_levels/)
My group is doing a data mining assignment in which we want to categorize english ...
- 131
4
votes
1
answer
55
views
English queries to GIS systems
I'm building a system that tries to answer geospatial English questions such as "Where is the closest restaurant" or "How many historic sites are in the east of Nantes?". Underlying database is OSM. ...
- 41
4
votes
1
answer
3k
views
Dataset of English Poetry
Is there a dataset containing a group of poems in English? I couldn't find any resource online. I could web scrape poetry sites, but I want to avoid copyright issues and even a dataset of older poems ...
- 143
4
votes
2
answers
766
views
Semantic dictionary of English language
I am looking for a dictionary of English words tagged with their semantics. Like:
red t:color
green t:color
long t:size t:max
huge t:size t:max
tiny t:size t:min
hot ...
- 291
4
votes
2
answers
359
views
List of English Nouns and their Plural Form
Is there a list of nouns and their plurals?
E.g. apple apples, genius geni, roof rooves, etc.
I have the GCIDE dictionary but that only contains singular nouns.
- 143
1
vote
1
answer
2k
views
Dataset of common typos in English
I am looking for a dataset of common typos in English. Ideally, it should mention the frequency of typo.
- 7,780
8
votes
5
answers
1k
views
Most common words in English
I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
- 7,780
10
votes
4
answers
5k
views
Corpus of tagged text (English newspapers or any tagged text)
I'm developing a system to extract tags from text (English) and currently I have no dataset to test the system and evaluate, could someone point me to a source (preferably a free one) thanks.
NOTE:
By ...
- 101
2
votes
0
answers
36
views
Data on press conferences from English-speaking press conferences
I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
- 21
3
votes
0
answers
239
views
Open Audio Database of English Letters
I have embarked on a project to gather spoken english letters into a free and open database. I call it the English Alphabet Audio Database.
My question is simple: does any other such database already ...
- 131
4
votes
0
answers
122
views
List of inverse and polarity flip words required
I'm a computer science student and I'm doing a research on sentimental analysis with a large database. Therefore, i need to create dictionaries to mapping words.
Now i'm facing the problem of "...
- 281
6
votes
1
answer
147
views
How can I get a list of synonyms that work across all contexts?
Many synonyms are context specific. For example "force" is a synonym for "drive" in the context of urging or inspiring, but not in the context of journeying by vehicle.
Other synonyms seem to work ...
- 371
5
votes
2
answers
142
views
Looking for modern english texts in public domain / CC-BY-SA
Is there a library of public domain / CC-BY-SA english texts, written later than 1990? I need it to build a corpora with links to full texts, which isn't possible with copyrighted material. At the ...
- 291
3
votes
0
answers
62
views
Database of programming terms
I want to find a terminology database with programming terms , for example:
Front-end
UI/UX
ruby
RoR
HTML 5
HTML
Any idea ?
- 139
3
votes
1
answer
90
views
Basic English proficiency in the world
I am looking for data showing how all world countries compare in terms of basic English proficiency.
In answers, the SAME METRIC should be used for all countries.
Reasonably recent, at least after ...
- 8,426
4
votes
2
answers
77
views
Are there opendatasets of English terms describing nationalities, ethnicities?
Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
SeanEaster
4
votes
3
answers
210
views
Where can I get a complete word and phrase list for English?
I am looking for a complete set of all possible English words and phrases (i.e. 'fire', 'fire up', 'fire ant', 'under fire').
Actually, I need it for parsing online dictionary.
The best thing i found ...
- 43
4
votes
0
answers
45
views
Novels with chapters annotated POV
I'm looking for one or more novels, that multiple characters points of view.
(I don't care if it is 3rd person or 1st person),
with each chapter (or paragraph) annotated as to which character's POV ...
3
votes
0
answers
41
views
Amount of English fiction literature in characters / publications
What can be a rough estimate of all the English fiction literature published to date in characters? Or the trends for fiction books published yearly? What can be the public sources for such estimates?
...
3
votes
1
answer
314
views
source of character-level ngrams that include spaces
I'm looking for a source of character-level ngrams and counts that include spaces. I've found character-level ngram datasets, but they don't include spaces. Ideally, the dataset will include up to 8-...
- 31
3
votes
2
answers
189
views
Google translate english monolingual definitions
Is google translate monolingual definitions open for commercial use? Am I violating intellectual property to use english words definitions in my english quiz app?
- 899
15
votes
2
answers
6k
views
Free English Dictionary
Looking for a free monolingual english dictionary like oxford or longman dictionary, but which I can freely use, without violating any intellectual property. I want to use it in my iOS app.
I need ...
- 899
5
votes
1
answer
2k
views
Longman English Dictionary Database
Is Longman English Dictionary as database available for public or should I digitalise it?
I plan to create an app based on Longman English Dictionary, but I need the database somehow. Any idea how?
- 899
6
votes
2
answers
7k
views
Looking for audio data set for English words
I am trying to obtain an audio data set for a list of English words. The list doesn't have to be extensive (for example, the data set can only have four or five words), but each word should have more ...
- 191
19
votes
8
answers
8k
views
List of English words phonetics
The list actually doesn't have to be free! I just need something that I can buy once or whatever.
And if possible, but not needed, parts of speech.
Before you say anything, I have googled for this ...
- 191
2
votes
1
answer
47
views
Relationship Advice/Advice Column Corpora?
I have the benefit of having a fairly green field project on my hands where I need to perform some language analysis on advice and etiquette giving. This involves both centralized sources (advice ...
- 810
12
votes
2
answers
6k
views
Database of English words difficulty
Data request
I am looking for a database that describes the "difficulty" of each English word.
Difficulty of a word is not easy to define, but it is probably a mix of:
Level of study needed to ...
- 8,426
14
votes
2
answers
2k
views
Speech audio databases with phonemes labelled
Can anyone point me to opensource databases of speech audio with phonemes labelled,
.wav or the like + label files, e.g.
# time, phoneme
0.31200 ao
0.41200 th
0.54200 er
...
I'd prefer English, ...
- 456
9
votes
1
answer
684
views
Text message corpus for American english
I am doing a research project to identify some patterns in how people interact with each other using text messages. The scope of the project is confined to American users. Can someone suggest a good ...
- 191