The English Language & Usage stackexchange site has a question with answers related to your question
What's the largest open-source dictionary that includes brief definitions of each word?
The popular answer is WordNet from Princeton. You can either browse or download the full data set, although it's about 10 years old.
The license allows ...
Wiktionary is the Wikimedia project's dictionary. Here is an example of a page, although the definitions are still quite technical:
Additionally, like simple.wikipedia, there is a Simple English Wiktionary page. Here is an example:
The definition you are looking for:
The dict.cc dictionary is available to download as a machine readable text file (tab-delimited, UTF-8), with free registration. There are some licensing terms, mostly related to not sharing the data set (but you can share what you create, of course).
In addition to German <-> English, many other language pairs are available under the same terms
You can find an API here as well:
Free Scrabble Dictionary API
The current function of the scrabble dictionary API is to inform you whether the word you are looking up is located in any of the official scrabble word lists (TWL also referred to as Official Tournament and Club Word List, SOWPODS and ENABLE).
Our API is free for anyone to use as ...
I haven't found any ready lists with just Latin words in txt format, but you can parse these lists to extract the Latin words from them:
Bill Casselman: Latin ...
Probably the Swedish Academian Wordlist (SAOL) is the most authoritative source in this field.
There exists SAOL for Android, the .obb expansion file is a regular SQLite database.
This list was extracted from the .obb database file. The list contains more than 90 000 nouns (whereas the list from dict.cc contains less than 9 000 nouns). About 75% of nouns ...
Given that language is not a fixed thing, I'd hesitate to put much stock in a fixed database of "definite" stems.
Here's the source code for the NLTK (python) Porter stemmer (GPL). It looks like it has no serious dependencies on anything else in NLTK -- just an interface that you could discard and some stuff for unicode compatibility that you could adapt. ...
OK I have a unique solution that may work for any langauge pair. The fact that you ask for Japanese makes it tough because it requires unicode support for the characters (so many .txt dictionary files are out of the question and I'm not sure how useful OCR would be).
We search the wonderful flashcard program anki for Japanese:
Then, we find a large ...
This particular dictionary's legal notice says that:
Users are not entitled to [...] transmit [..] it on any other website without the express permission of Pearson.
You must not use data mining, robots, scraping or similar data gathering or extraction methods on any part of this Site without our express prior written consent (my emphasis)
So either ...
Here's a way to scrape the country name from Wikipedia. Not so useful after @Anastasios Ventouris's answer, but I'll post it anyway.
Each wiki page has a link to different language pages
HTML looks like this:
<li class="interlanguage-link interwiki-ace"><a href="//ace.wikipedia.org/wiki/Jeureuman" title="Jeureuman – Achinese" lang="ace" hreflang="...
A list of the names of each ISO country code in up to 114 languages was produced by Jonah Ellison in 2011 (the number of languages available varies by country).
There's a link to the UTF-8 CSV file on his page: 21,640 Translated Country Names.
Each line contains the ISO country code, the ISO language code, and the name of the country in that language.
There is a popular GitHub repo that has CSV, XML and JSON country lists in several languages.
Unfortunately, the translations are only:
Here's a list of all the offensive words banned from Google's "What Do You Love?" site:
Wiktionary has a pretty thorough list of English Euphemisms:
Wiktionary also has a (seemingly) scarce list of Spanish Euphemisms:
Well, you picked a very commercial word list so even 'finding' a copy of the dataset could lead to legal problems or results you can't publish.
But, to get a taste, there is a web-app that I found after chasing down some broken links. It's apparently endorsed by Cynthia herself. Check it out here.
Now, interestingly, the creator of that site posts a link ...
Merriam-Webster's Medical Dictionary with Audio
Free for noncommercial (which here means not generating any revenue) use provided you submit less than 1000 queries a day. Other forms of licensing are available upon request.
description, licencing and fees
As I can understand, you want something custom. I don't know any database or any library where you can have access on the dictionary of the words, but you can see here a greek version where it works like you describe on your question. If you know python, you can change it a bit and make it to fit on your problem
I found another source, halfway hidden, with roughly 180k English words
http://scrabutility.com/TWL06.txt (archived link)
and based on:
Tournament Word List (TWL06)
TWL - the American dictionary, based on the Official Scrabble Players' Dictionary , used in North American and Canadian tournaments.
which links this site: https://www.isc.ro/en/commands/lists....
Edit: Here are some useful Ruby packages I've used:
There's also a full suite package named Treat which contains stemming among other things: https://github.com/louismullie/treat
Truth be told, Python has the better packages for this, but just in case you're trying to do it ...
If you have to treat long, natural English, I would go for the Porter stemming algorithm (with implementations) in order to stem both the text and your dictionary and then simply do (Python/pseudo-code):
for word in stemmed_document:
if word in stemmed_dictionary:
pass # do something with a matching word stem
If you are really looking for this dictionary approach, you can just roll your own.
In python this would be something like,
stem_dict = ...
stemmed_doc = 
for word in original_doc :
Another wordlist, Collins Scrabble Words, CSW15, is available as a txt file:
Here is a hack (some might consider it ugly):
Download the english and the german wikipedia and/or wiktionary
Make a list of articles that are translations of each other
Use the page titles as words of your dictionary
I admit, this is not an easy-to-parse format, but a huge data source that is sometimes overlooked.
I am not sure for 100% that you can do all of what you want with wordnet.
I have used it a few months before with Python and it has many many options. Have you tried it? Maybe there are more functionalities that can help you.