User-agent: * Disallow: /cgi-bin Disallow: /logs Disallow: /ftp Disallow: /css Disallow: /en/css Disallow: /non-public