Starting in 1996, Alexa Internet has been donating their crawl data to the Internet Archive. Flowing in every day, these data are added to the Wayback Machine after an embargo period.
Starting in 1996, Alexa Internet has been donating their crawl data to the Internet Archive. Flowing in every day, these data are added to the Wayback Machine after an embargo period.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20110809011847/http://www.searchengineoptimising.com:80/glossary/seo-glossary-of-terms/crawlfrequency
This is how often a site is crawled, or spidered. A site which has a lot of unique content will get crawled more often than one that is seen as low quality with spammy links.
SEO Resources 
