Starting in 1996, Alexa Internet has been donating their crawl data to the Internet Archive. Flowing in every day, these data are added to the Wayback Machine after an embargo period.
Starting in 1996, Alexa Internet has been donating their crawl data to the Internet Archive. Flowing in every day, these data are added to the Wayback Machine after an embargo period.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20110809010023/http://www.searchengineoptimising.com:80/glossary/seo-glossary-of-terms/crawldepth
This is the term for how deeply a spider will crawl a website in order to rank it. As searches are getting more and more complex a spider will often have to crawl deeper within a website in order to see how relevant to that search a website is.
SEO Resources 
