I need to develop autocorrection and prediction for mobile keyboard app that will work for some 8-10 most common Latin languages + Russian (English, German, Spanish, Portugues, French, ...). For start, I need NLP corpus for each of those languages.
Ideally all corpora should be from same source and match at least some of these criteria:
- Written language, typos removed.
- Large enough: at least 10 million words, the more the better
- Texts typed in online chats, emails, forms, apps... Or similar. Should include language typically used in those situations.
I have no need for syntax or other tagging, raw texts (optionally tokenized) are just fine. I can pay reasonable price.
Any help or even a pointer into resource is greatly appreciated!