User-agent: * Disallow: /cgi-bin/ Disallow: /adm/ Disallow: /phphits/ Disallow: /phphits.inc.php Disallow: /settings.inc.php User-agent: Slurp Disallow: / User-Agent: WIRE Disallow: / User-Agent: twiceler Disallow: /