6
votes
Accepted
how to search archive.org for PDF files on a captured website between some date range
here's how i automated the process within R
setwd( "C:/path/to/PDFs" )
year <- 2008
domain_name <- "anthem.com"
archive_org_captures <-
readLines(
paste0(
"http://...
4
votes
how to search archive.org for PDF files on a captured website between some date range
Here is one way, although the API probably has more efficient methods.
You can append * to the end of a URL in the Wayback Machine and it will return all of the saved URLs for that domain. The link ...
2
votes
how to search archive.org for PDF files on a captured website between some date range
Using the official wayback_machine_downloader tool:
wayback_machine_downloader https://www.anthem.com --from 2005 --to 2008 --only "/\.(pdf)$/i"
1
vote
Accepted
Searching for a specific file name across websites on Wayback Machine
I now contacted the IA directly and Mark Graham kindly told me that this is impossible, as there is no fts url index.
1
vote
Accepted
Where can I find HTML5 metadata?
HTML is machine-readable/can be parsed, so not sure what you mean by "unprocesable". The document containing the information you desire may as well be valid markup, but more importantly proves its ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
html × 9web-crawling × 3
archive.org × 2
data-request × 1
openfda × 1
machine-learning × 1
tool-request × 1
best-practice × 1
python × 1
json × 1
wikipedia × 1
extracting × 1
opencorporates × 1
parsing × 1
openrefine × 1