Skip to main content

View Post [edit]

Poster: TechLord Date: Jul 4, 2018 12:15pm
Forum: web Subject: Trivial question: Wayback excludes Quora.com despite already blocked by robots.txt?

Quora.com/robots.txt already blocks Wayback (at least with a saturated and solid explaination), but why is there a need to exclude it while it is already blocked?

Nothing important, I was just wondering.