Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That's funny. The normal technique for telling the Wayback Machine not to archive would result in the message "Page cannot be crawled or displayed due to robots.txt.". How do you get "excluded" this way?


I don't know about the message, but you can ask for your site to be removed from the Wayback Machine.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: