Questions tagged [english]
For questions related to the usage and characteristics of the English language.
2
votes
0answers
34 views
Words and Frequency/Probability of Spelling Mistakes
Data Request
I am looking for some data that contains English words along with the probability that a person will spell it incorrectly.
The probability depends on various factors. However, a simple ...
0
votes
1answer
21 views
Looking for word frequency data for the Google Books ngrams
I have downloaded all the single words from Google Books ngram data (http://storage.googleapis.com/books/ngrams/books/datasetsv2.html) and I could write code to aggregate it all generate word ...
1
vote
1answer
20 views
Large English text corpus
I am interested in studying a few specific questions on entropy of different properties of English text. For instance, what is the entropy of capital letters in English? This might tell you something ...
0
votes
1answer
12 views
Open dictionary for English with International Phonetic Alphabet for every word
I'm seeking a dictionary that contains the IPA transcription for every word. Is such a resource available for English?
1
vote
1answer
40 views
Books with multiple main characters, one per chapter
I am looking for public domain, or creative commons fiction,
with:
multiple main characters,
written in 3rd person
Each chapter focuses on a particular character
Modern examples of such books ...
0
votes
0answers
35 views
English Poetry Dataset categorized by meters
Is there a dataset that contains large number of English poems ?
It should be categorized by meters.
I couldn't find any resource online, i also can web scrape any site that have my needed dataset.
9
votes
1answer
167 views
Word list with learning age
I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned.
WordNet linkage is a big bonus.
1
vote
1answer
76 views
Corpus of utterances and transcribed words for testing speech recognition algorithms
I am looking for a free English data set to use for testing different ASR API's.
5
votes
0answers
58 views
English vocabulary by levels [duplicate]
(Duplicated from /r/datasets https://www.reddit.com/r/datasets/comments/5iozdt/request_english_vocabulary_by_levels/)
My group is doing a data mining assignment in which we want to categorize english ...
5
votes
1answer
52 views
English queries to GIS systems
I'm building a system that tries to answer geospatial English questions such as "Where is the closest restaurant" or "How many historic sites are in the east of Nantes?". Underlying database is OSM. ...
5
votes
1answer
894 views
Dataset of English Poetry
Is there a dataset containing a group of poems in English? I couldn't find any resource online. I could web scrape poetry sites, but I want to avoid copyright issues and even a dataset of older poems ...
4
votes
2answers
183 views
Semantic dictionary of English language
I am looking for a dictionary of English words tagged with their semantics. Like:
red t:color
green t:color
long t:size t:max
huge t:size t:max
tiny t:size t:min
hot ...
5
votes
2answers
145 views
List of English Nouns and their Plural Form
Is there a list of nouns and their plurals?
E.g. apple apples, genius geni, roof rooves, etc.
I have the GCIDE dictionary but that only contains singular nouns.
1
vote
1answer
774 views
Dataset of common typos in English
I am looking for a dataset of common typos in English. Ideally, it should mention the frequency of typo.
7
votes
4answers
227 views
Most common words in English
I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
9
votes
4answers
3k views
Corpus of tagged text (English newspapers or any tagged text)
I'm developing a system to extract tags from text (English) and currently I have no dataset to test the system and evaluate, could someone point me to a source (preferably a free one) thanks.
NOTE:
By ...
2
votes
0answers
30 views
Data on press conferences from English-speaking press conferences
I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
2
votes
0answers
149 views
Open Audio Database of English Letters
I have embarked on a project to gather spoken english letters into a free and open database. I call it the English Alphabet Audio Database.
My question is simple: does any other such database already ...
4
votes
0answers
99 views
List of inverse and polarity flip words required
I'm a computer science student and I'm doing a research on sentimental analysis with a large database. Therefore, i need to create dictionaries to mapping words.
Now i'm facing the problem of "...
6
votes
1answer
118 views
How can I get a list of synonyms that work across all contexts?
Many synonyms are context specific. For example "force" is a synonym for "drive" in the context of urging or inspiring, but not in the context of journeying by vehicle.
Other synonyms seem to work ...
6
votes
2answers
105 views
Looking for modern english texts in public domain / CC-BY-SA
Is there a library of public domain / CC-BY-SA english texts, written later than 1990? I need it to build a corpora with links to full texts, which isn't possible with copyrighted material. At the ...
3
votes
0answers
60 views
Database of programming terms
I want to find a terminology database with programming terms , for example:
Front-end
UI/UX
ruby
RoR
HTML 5
HTML
Any idea ?
3
votes
1answer
76 views
Basic English proficiency in the world
I am looking for data showing how all world countries compare in terms of basic English proficiency.
In answers, the SAME METRIC should be used for all countries.
Reasonably recent, at least after ...
4
votes
2answers
39 views
Are there opendatasets of English terms describing nationalities, ethnicities?
Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
5
votes
3answers
133 views
Where can I get a complete word and phrase list for English?
I am looking for a complete set of all possible English words and phrases (i.e. 'fire', 'fire up', 'fire ant', 'under fire').
Actually, I need it for parsing online dictionary.
The best thing i found ...
4
votes
0answers
40 views
Novels with chapters annotated POV
I'm looking for one or more novels, that multiple characters points of view.
(I don't care if it is 3rd person or 1st person),
with each chapter (or paragraph) annotated as to which character's POV ...
3
votes
0answers
37 views
Amount of English fiction literature in characters / publications
What can be a rough estimate of all the English fiction literature published to date in characters? Or the trends for fiction books published yearly? What can be the public sources for such estimates?
...
3
votes
1answer
189 views
source of character-level ngrams that include spaces
I'm looking for a source of character-level ngrams and counts that include spaces. I've found character-level ngram datasets, but they don't include spaces. Ideally, the dataset will include up to 8-...
3
votes
2answers
130 views
Google translate english monolingual definitions
Is google translate monolingual definitions open for commercial use? Am I violating intellectual property to use english words definitions in my english quiz app?
12
votes
2answers
1k views
Free English Dictionary
Looking for a free monolingual english dictionary like oxford or longman dictionary, but which I can freely use, without violating any intellectual property. I want to use it in my iOS app.
I need ...
5
votes
1answer
756 views
Longman English Dictionary Database
Is Longman English Dictionary as database available for public or should I digitalise it?
I plan to create an app based on Longman English Dictionary, but I need the database somehow. Any idea how?
5
votes
1answer
1k views
Looking for audio data set for english words
I am trying to obtain audio data set for a list of english words. The list doesn't have to be extensive (for example the data set can only have 4 or 5 words), but each word should have more than 10 ...
11
votes
6answers
3k views
Is there a free list of English word phonetics?
The list actually doesn't have to be free! I just need something that I can buy once or whatever.
And if possible, but not needed, parts of speech.
Before you say anything, I have googled for this ...
2
votes
1answer
31 views
Relationship Advice/Advice Column Corpora?
I have the benefit of having a fairly green field project on my hands where I need to perform some language analysis on advice and etiquette giving. This involves both centralized sources (advice ...
10
votes
1answer
2k views
Database of English words difficulty
Data request
I am looking for a database that describes the "difficulty" of each English word.
Difficulty of a word is not easy to define, but it is probably a mix of:
Level of study needed to ...
13
votes
1answer
2k views
Speech audio databases with phonemes labelled
Can anyone point me to opensource databases of speech audio with phonemes labelled,
.wav or the like + label files, e.g.
# time, phoneme
0.31200 ao
0.41200 th
0.54200 er
...
I'd prefer English, ...
9
votes
1answer
599 views
Text message corpus for American english
I am doing a research project to identify some patterns in how people interact with each other using text messages. The scope of the project is confined to American users. Can someone suggest a good ...
21
votes
2answers
228 views
Data for word hierarchies
I'm looking for a dataset which will give me is-a and has-a type relations between senses (and give senses from words). WordNet seems to be the most popular model, but I'm trying to evaluate other ...
4
votes
5answers
1k views
Stemming of long English text
I need to perform stemming in my application, but mostly for a small subset of stems. I.e. to check if a given word is of a certain stem out of a small list of stem words. Maybe a hundred stem words ...
10
votes
3answers
3k views
Database of English words pronunciation
Is there any downloadable open database of English words pronunciation in audio format?
11
votes
2answers
2k views
American English SMS Text Message Corpora
I'm seeking corpora of American English SMS (<=160 characters) text messages. What corpora are available?
8
votes
1answer
965 views
Database with English words with grammatical classification?
Is there open database with English words with grammatical classification?
I mean the list of words, with the information, which part of speech this word is (f.e. verb, noun, pronoun etc.).
