# robots.txt for http://vt100.net/ # 1999-03-29 MegaSheep v1.0 disallowed because of crap relative URL parsing User-agent: MegaSheep Disallow: / User-agent: ia_archiver Disallow: / # 2004-06-01 Mirago disallowed because of Referer spamming User-agent: Mirago Disallow: / User-agent: Googlebot Disallow: /*.pdf$