Reply to this post | Go Back

View Post [edit]

Poster:	James983	Date:	July 17, 2012 01:29:58pm
Forum:	web	Subject:	Question for Jeff regarding contradictory statements on web crawling policy

The Wayback Machine FAQ says: "We will only capture the one page you enter, and it does not get added to any sort of list to be crawled regularly, so doing this will not ensure that your site will be captured regularly or with any completeness."

Whereas you say: "click the "Latest" button to add your site to the database and capture the live shot. The live shot will only be captured the one time. After that the next capture will be whenever it is crawled again."

So my question is, does the page URL get added to the database to be crawled or not?

Reply to this post

Reply [edit]

Poster:	Jeff Kaplan	Date:	July 17, 2012 02:36:57pm
Forum:	web	Subject:	Re: Question for Jeff regarding contradictory statements on web crawling policy

my bad. clicking "latest" will only capture that instance of that url. it does not as i suggested add it to a database for future crawling.