User-agent: * Disallow: /cgi-bin/ Disallow: /scgi-bin/ Disallow: /resources/ Disallow: .htaccess Disallow: .htpasswd Disallow: /