I'm looking for the materials of major newspapers, such as *The New York Times*, *Washington Post*, and *The Economist*. A random sample of their articles or headlines would suffice, but each newspaper has complications.

* *The New York Times* has an [article search API](http://developer.nytimes.com/docs/read/article_search_api_v2) that gives access to the newspaper's archives. There's a [Python wrapper](http://dlab.berkeley.edu/blog/scraping-new-york-times-articles-python-tutorial) for it. The NYT allow frequent queries ( > [5,000 calls per day](http://developer.nytimes.com/docs/faq)) after contacting them (non-commercial use only).

* *The Guardian* grants free [API access][1] to 1.7M articles.

Some newspapers allow crawling.

Naturally, paid services search across newspapers and may do some export. See [LexisNexis](http://www.lexisnexis.com/ap/academic/form_news_wires.asp) and [Archives.gov](http://www.archives.gov/research/alic/tools/online-databases.html).

Is there an open academic dataset of the newspaper content?


  [1]: http://open-platform.theguardian.com/documentation/