12

There is actually a Wikipedia page about this very topic, and they maintain a machine-readable list that you can use as a starting point if you're writing a tool.


11

The English Language & Usage stackexchange site has a question with answers related to your question What's the largest open-source dictionary that includes brief definitions of each word? Source The popular answer is WordNet from Princeton. You can either browse or download the full data set, although it's about 10 years old. The license allows ...


8

Wiktionary is the Wikimedia project's dictionary. Here is an example of a page, although the definitions are still quite technical: https://en.wiktionary.org/wiki/data#English Additionally, like simple.wikipedia, there is a Simple English Wiktionary page. Here is an example: http://simple.wiktionary.org/wiki/data The definition you are looking for: ...


7

If GPL licenced is acceptable to you, then you can use the German <-> English dictionary included in the Ding package: http://www-user.tu-chemnitz.de/~fri/ding/


7

The Wordnik API will tell you whether any single word is a valid scrabble word (among other information). http://developer.wordnik.com/docs.html#!/word/getWord_get_1 I am not sure that's exactly what you're looking for, but it's the best I've got.


6

Try http://en.wiktionary.org – it's free and it has a lot of idioms and phrases.


6

Probably the Swedish Academian Wordlist (SAOL) is the most authoritative source in this field. There exists SAOL for Android, the .obb expansion file is a regular SQLite database. This list was extracted from the .obb database file. The list contains more than 90 000 nouns (whereas the list from dict.cc contains less than 9 000 nouns). About 75% of nouns ...


5

You can find an API here as well: Free Scrabble Dictionary API updated link The current function of the scrabble dictionary API is to inform you whether the word you are looking up is located in any of the official scrabble word lists (TWL also referred to as Official Tournament and Club Word List, SOWPODS and ENABLE). Our API is free for anyone to ...


5

The dict.cc dictionary is available to download as a machine readable text file (tab-delimited, UTF-8), with free registration. There are some licensing terms, mostly related to not sharing the data set (but you can share what you create, of course). In addition to German <-> English, many other language pairs are available under the same terms


5

I haven't found any ready lists with just Latin words in txt format, but you can parse these lists to extract the Latin words from them: Dickinson College: LATIN CORE VOCABULARY. Terms of use: "(...) Dickinson College Commentaries by Dickinson College is licensed under a Creative Commons Attribution-ShareAlike License (CC BY-SA)." Bill Casselman: Latin ...


5

You can get 8600 Latin words from Latin wikitionary or 879.898 Latin words from English wiktionary using PetScan. You can change output to csv or tsv in the "Output" tab.


4

This particular dictionary's legal notice says that: Users are not entitled to [...] transmit [..] it on any other website without the express permission of Pearson. You must not use data mining, robots, scraping or similar data gathering or extraction methods on any part of this Site without our express prior written consent (my emphasis) So either ...


4

Here's a way to scrape the country name from Wikipedia. Not so useful after @Anastasios Ventouris's answer, but I'll post it anyway. Each wiki page has a link to different language pages HTML looks like this: <li class="interlanguage-link interwiki-ace"><a href="//ace.wikipedia.org/wiki/Jeureuman" title="Jeureuman – Achinese" lang="ace" hreflang="...


4

A list of the names of each ISO country code in up to 114 languages was produced by Jonah Ellison in 2011 (the number of languages available varies by country). There's a link to the UTF-8 CSV file on his page: 21,640 Translated Country Names. Each line contains the ISO country code, the ISO language code, and the name of the country in that language. ...


4

There is a popular GitHub repo that has CSV, XML and JSON country lists in several languages. LINK Unfortunately, the translations are only: "translations": { "de": "Österreich", "es": "Austria", "fr": "Autriche", "it": "Austria", "ja": "オーストリア", "nl": "Oostenrijk", "hr": "Austrija" },


4

Here's a list of all the offensive words banned from Google's "What Do You Love?" site: https://gist.github.com/jamiew/1112488 Wiktionary has a pretty thorough list of English Euphemisms: https://en.wiktionary.org/wiki/Category:English_euphemisms Wiktionary also has a (seemingly) scarce list of Spanish Euphemisms: https://en.wiktionary.org/wiki/...


4

If you are just interested in words (and not translations) you can check out Wortschatz at Universität Leipzig. An alternative (with very different coverage across languages, but actually providing translations) is the Wiktionary.


3

Merriam-Webster's Medical Dictionary with Audio Free for noncommercial (which here means not generating any revenue) use provided you submit less than 1000 queries a day. Other forms of licensing are available upon request. description, licencing and fees


3

Well, you picked a very commercial word list so even 'finding' a copy of the dataset could lead to legal problems or results you can't publish. But, to get a taste, there is a web-app that I found after chasing down some broken links. It's apparently endorsed by Cynthia herself. Check it out here. Now, interestingly, the creator of that site posts a link ...


3

OK I have a unique solution that may work for any langauge pair. The fact that you ask for Japanese makes it tough because it requires unicode support for the characters (so many .txt dictionary files are out of the question and I'm not sure how useful OCR would be). We search the wonderful flashcard program anki for Japanese: results. Then, we find a large ...


3

dict.cc has downloadable dictionaries https://www1.dict.cc/translation_file_request.php?l=e You can choose either English (EN) to Swedish (SV) or from German (DE) to SV, and the opposite direction. Email address is required to receive download links. The file is tab-separated, and each noun (is labeled as u, n or pl) öl {u} beer noun örhänge {n} ...


2

As I can understand, you want something custom. I don't know any database or any library where you can have access on the dictionary of the words, but you can see here a greek version where it works like you describe on your question. If you know python, you can change it a bit and make it to fit on your problem Link


2

Given that language is not a fixed thing, I'd hesitate to put much stock in a fixed database of "definite" stems. Here's the source code for the NLTK (python) Porter stemmer (GPL). It looks like it has no serious dependencies on anything else in NLTK -- just an interface that you could discard and some stuff for unicode compatibility that you could adapt. ...


2

Edit: Here are some useful Ruby packages I've used: https://github.com/aurelian/ruby-stemmer https://github.com/romanbsd/fast-stemmer There's also a full suite package named Treat which contains stemming among other things: https://github.com/louismullie/treat Truth be told, Python has the better packages for this, but just in case you're trying to do it ...


2

If you have to treat long, natural English, I would go for the Porter stemming algorithm (with implementations) in order to stem both the text and your dictionary and then simply do (Python/pseudo-code): for word in stemmed_document: if word in stemmed_dictionary: pass # do something with a matching word stem


2

If you are really looking for this dictionary approach, you can just roll your own. In python this would be something like, stem_dict = ... stemmed_doc = [] for word in original_doc : stemmed_doc.append(stem_dict[word])


2

I found another source, halfway hidden, with roughly 180k English words http://scrabutility.com/TWL06.txt (archived link) and based on: Tournament Word List (TWL06) TWL - the American dictionary, based on the Official Scrabble Players' Dictionary , used in North American and Canadian tournaments. which links this site: https://www.isc.ro/en/...


2

Maybe this will help you: Word List - Commonly Misspelled English Words


2

I set up a spreadsheet derived from UN Multilingual Terminology Database for you here


2

Wikipedia has a great list for what you are looking. Here is the index and here is an example: Countries A-C. If you are satistfied with the data, just let me know and I will create a CSV file for what you need and update the answer here with a new link.


Only top voted, non community-wiki answers of a minimum length are eligible