Open Data Beta

Questions tagged [english]

Ask Question

For questions related to the usage and characteristics of the English language.

50 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
1
vote
1answer
13 views

Text Dataset for Entity Recognition of personal data

I am looking for a data set to train and set a personal information masking application. Is there a text data set available with name, location, bank account numbers, SSN, Name, Ip address etc (either ...
1
vote
2answers
59 views

CEFR for English words by level

Are there any open source data for English words by CEFR level? I found https://www.oxfordlearnersdictionaries.com/wordlists/oxford3000-5000 , which categorizes English words based on CEFR level, ...
1
vote
0answers
9 views

English Dictionary with Syntax Classifications Download

I'm looking for an english dictionary with english words' meaning but also with grammar classifications e.g. Hi (exclamation).
1
vote
0answers
12 views

English tenses exercises database (with answers)

Where can I find english tenses database to add them into my learning app
3
votes
0answers
21 views

Knowledge-base of typical/notable values of attribute

For processing English language, we use semantic networks, such as ConceptNet, to check various relations (e.g., part-of, used-for, etc.) between objects (typically nouns). We are curious about ...
0
votes
0answers
8 views

English phoneme dataset [duplicate]

I am working on a speech recognition system. To do that I need all English audio phonemes to feed them to my neural network. Where can I find such dataset? Thank you.
0
votes
2answers
48 views

Online Dictionary for Scraping

Does anybody know if there is an extensive online dictionary other than Wiktionary that lists many words on a single page, as opposed to having to search for a single word? None of the online ...
1
vote
0answers
20 views

Dataset for English word trigrams

Does anyone know where to find such a dataset? There is Google's Ngram viewer but it is too big to be useful. I'm looking for something smaller. Perhaps with only the 100k most common English words ...
1
vote
1answer
28 views

French/English word database for a hangman game

I'm currently developing a Hangman game in English for a French website that teaches English. I'm looking for a database containing a set of English words, preferably common nouns or verbs of more ...
1
vote
0answers
55 views

Words and Frequency/Probability of Spelling Mistakes

Data Request I am looking for some data that contains English words along with the probability that a person will spell it incorrectly. The probability depends on various factors. However, a simple ...
1
vote
1answer
83 views

Looking for word frequency data for the Google Books ngrams

I have downloaded all the single words from Google Books ngram data (http://storage.googleapis.com/books/ngrams/books/datasetsv2.html) and I could write code to aggregate it all generate word ...
2
votes
2answers
53 views

Large English text corpus

I am interested in studying a few specific questions on entropy of different properties of English text. For instance, what is the entropy of capital letters in English? This might tell you something ...
0
votes
1answer
18 views

Open dictionary for English with International Phonetic Alphabet for every word

I'm seeking a dictionary that contains the IPA transcription for every word. Is such a resource available for English?
1
vote
1answer
47 views

Books with multiple main characters, one per chapter

I am looking for public domain, or creative commons fiction, with: multiple main characters, written in 3rd person Each chapter focuses on a particular character Modern examples of such books ...
8
votes
1answer
238 views

Word list with learning age

I'm looking for word databases, mainly in English and Swedish, which contain lists of words associated with the ages where they are typically learned. WordNet linkage is a big bonus.
1
vote
1answer
125 views

Corpus of utterances and transcribed words for testing speech recognition algorithms

I am looking for a free English data set to use for testing different ASR API's.
3
votes
0answers
61 views

English vocabulary by levels [duplicate]

(Duplicated from /r/datasets https://www.reddit.com/r/datasets/comments/5iozdt/request_english_vocabulary_by_levels/) My group is doing a data mining assignment in which we want to categorize english ...
4
votes
1answer
52 views

English queries to GIS systems

I'm building a system that tries to answer geospatial English questions such as "Where is the closest restaurant" or "How many historic sites are in the east of Nantes?". Underlying database is OSM. ...
4
votes
1answer
2k views

Dataset of English Poetry

Is there a dataset containing a group of poems in English? I couldn't find any resource online. I could web scrape poetry sites, but I want to avoid copyright issues and even a dataset of older poems ...
4
votes
2answers
619 views

Semantic dictionary of English language

I am looking for a dictionary of English words tagged with their semantics. Like: red t:color green t:color long t:size t:max huge t:size t:max tiny t:size t:min hot ...
4
votes
2answers
220 views

List of English Nouns and their Plural Form

Is there a list of nouns and their plurals? E.g. apple apples, genius geni, roof rooves, etc. I have the GCIDE dictionary but that only contains singular nouns.
1
vote
1answer
1k views

Dataset of common typos in English

I am looking for a dataset of common typos in English. Ideally, it should mention the frequency of typo.
7
votes
4answers
262 views

Most common words in English

I am looking for a machine readable data set (e.g., a mere txt file with one word per row) containing the X most common words in English, excluding proper nouns (unlike this list). If possible, ...
10
votes
4answers
4k views

Corpus of tagged text (English newspapers or any tagged text)

I'm developing a system to extract tags from text (English) and currently I have no dataset to test the system and evaluate, could someone point me to a source (preferably a free one) thanks. NOTE: By ...
2
votes
0answers
30 views

Data on press conferences from English-speaking press conferences

I looking for open data on press conferences from English-speaking football/soccer leagues, preferably from the EPL, Champions League, or MLS but any English-speaking league would do. I need ...
2
votes
0answers
206 views

Open Audio Database of English Letters

I have embarked on a project to gather spoken english letters into a free and open database. I call it the English Alphabet Audio Database. My question is simple: does any other such database already ...
4
votes
0answers
105 views

List of inverse and polarity flip words required

I'm a computer science student and I'm doing a research on sentimental analysis with a large database. Therefore, i need to create dictionaries to mapping words. Now i'm facing the problem of "...
6
votes
1answer
128 views

How can I get a list of synonyms that work across all contexts?

Many synonyms are context specific. For example "force" is a synonym for "drive" in the context of urging or inspiring, but not in the context of journeying by vehicle. Other synonyms seem to work ...
5
votes
2answers
110 views

Looking for modern english texts in public domain / CC-BY-SA

Is there a library of public domain / CC-BY-SA english texts, written later than 1990? I need it to build a corpora with links to full texts, which isn't possible with copyrighted material. At the ...
3
votes
0answers
60 views

Database of programming terms

I want to find a terminology database with programming terms , for example: Front-end UI/UX ruby RoR HTML 5 HTML Any idea ?
3
votes
1answer
78 views

Basic English proficiency in the world

I am looking for data showing how all world countries compare in terms of basic English proficiency. In answers, the SAME METRIC should be used for all countries. Reasonably recent, at least after ...
4
votes
2answers
48 views

Are there opendatasets of English terms describing nationalities, ethnicities?

Say one needs to parse text for any mention of nationality or ethnicity, or otherwise use these terms in the course of an NLP project. Is there a comprehensive resource of English words describing ...
4
votes
3answers
141 views

Where can I get a complete word and phrase list for English?

I am looking for a complete set of all possible English words and phrases (i.e. 'fire', 'fire up', 'fire ant', 'under fire'). Actually, I need it for parsing online dictionary. The best thing i found ...
4
votes
0answers
40 views

Novels with chapters annotated POV

I'm looking for one or more novels, that multiple characters points of view. (I don't care if it is 3rd person or 1st person), with each chapter (or paragraph) annotated as to which character's POV ...
3
votes
0answers
39 views

Amount of English fiction literature in characters / publications

What can be a rough estimate of all the English fiction literature published to date in characters? Or the trends for fiction books published yearly? What can be the public sources for such estimates? ...
3
votes
1answer
219 views

source of character-level ngrams that include spaces

I'm looking for a source of character-level ngrams and counts that include spaces. I've found character-level ngram datasets, but they don't include spaces. Ideally, the dataset will include up to 8-...
3
votes
2answers
166 views

Google translate english monolingual definitions

Is google translate monolingual definitions open for commercial use? Am I violating intellectual property to use english words definitions in my english quiz app?
12
votes
2answers
2k views

Free English Dictionary

Looking for a free monolingual english dictionary like oxford or longman dictionary, but which I can freely use, without violating any intellectual property. I want to use it in my iOS app. I need ...
5
votes
1answer
1k views

Longman English Dictionary Database

Is Longman English Dictionary as database available for public or should I digitalise it? I plan to create an app based on Longman English Dictionary, but I need the database somehow. Any idea how?
6
votes
2answers
3k views

Looking for audio data set for English words

I am trying to obtain an audio data set for a list of English words. The list doesn't have to be extensive (for example, the data set can only have four or five words), but each word should have more ...
15
votes
6answers
4k views

Is there a free list of English word phonetics?

The list actually doesn't have to be free! I just need something that I can buy once or whatever. And if possible, but not needed, parts of speech. Before you say anything, I have googled for this ...
2
votes
1answer
33 views

Relationship Advice/Advice Column Corpora?

I have the benefit of having a fairly green field project on my hands where I need to perform some language analysis on advice and etiquette giving. This involves both centralized sources (advice ...
11
votes
1answer
3k views

Database of English words difficulty

Data request I am looking for a database that describes the "difficulty" of each English word. Difficulty of a word is not easy to define, but it is probably a mix of: Level of study needed to ...
13
votes
1answer
2k views

Speech audio databases with phonemes labelled

Can anyone point me to opensource databases of speech audio with phonemes labelled, .wav or the like + label files, e.g. # time, phoneme 0.31200 ao 0.41200 th 0.54200 er ... I'd prefer English, ...
9
votes
1answer
629 views

Text message corpus for American english

I am doing a research project to identify some patterns in how people interact with each other using text messages. The scope of the project is confined to American users. Can someone suggest a good ...
21
votes
2answers
238 views

Data for word hierarchies

I'm looking for a dataset which will give me is-a and has-a type relations between senses (and give senses from words). WordNet seems to be the most popular model, but I'm trying to evaluate other ...
4
votes
5answers
1k views

Stemming of long English text

I need to perform stemming in my application, but mostly for a small subset of stems. I.e. to check if a given word is of a certain stem out of a small list of stem words. Maybe a hundred stem words ...
11
votes
3answers
4k views

Database of English words pronunciation

Is there any downloadable open database of English words pronunciation in audio format?
11
votes
2answers
2k views

American English SMS Text Message Corpora

I'm seeking corpora of American English SMS (<=160 characters) text messages. What corpora are available?
8
votes
1answer
1k views

Database with English words with grammatical classification?

Is there open database with English words with grammatical classification? I mean the list of words, with the information, which part of speech this word is (f.e. verb, noun, pronoun etc.).