The NYTimes Archive goes back to 1851.
Here's a random example, showing that the articles are machine readable.
They also have an API for developers.
And they have an N-gram tool called Chronicle) where you can click on the results to view each article.