User-agent: * Disallow: /site_assets/ Disallow: /css/ Disallow: /scripts/