# robots.txt generated at http://www.mcanerin.com User-agent: Googlebot Disallow: User-agent: * Disallow: / Crawl-delay: 120 Disallow: /cgi-bin/ Sitemap: http://www.corruptive.co.uk/news/sitemap.xml.gz