User-agent: * Disallow: /cgi-bin/ Disallow: /a/ Disallow: /public/css/ Disallow: /public/images/ Disallow: /public/scripts/