User-agent: * Disallow: /404.html Disallow: /images/ Disallow: /cgi/ Disallow: /guest/ Disallow: /stats/ Disallow: /cr/ User-Agent: MSIECrawler Disallow: / User-agent: googlebot-image Disallow: / User-agent: webclipping Disallow: / User-agent: cfm-searchbot Disallow: / User-agent: nutch Disallow: / User-agent: nutchcvs Disallow: / User-agent: nutchorg Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: webfilter robot 1.0 Disallow: /