# robots.txt - http://www.aisne.cci.fr User-agent: msnbot Crawl-delay: 15 User-agent: slurp Crawl-delay: 10 User-agent: * Disallow: /stats/ Disallow: /usages/ Disallow: /webalizer/ Disallow: /magpierss/