2

I am looking for a domain-specific computer science corpus of at least 20M words (preferable >50M words), for the purpose of training a language model in it.

Is there anything out-of-the-box that I could use? *I tried to look for the sciBERT corpus, but can not find how to access it.

Improve this question

1 Answer 1

Reset to default
1

Could the Semantic Scholar Open Research Corpus (S2ORC) be of help?

S2ORC contains 12.7M+ full text papers, of which 7.2% pertain to computer science (according to their paper, at p. 4974).

Improve this answer

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.