User-agent: * Disallow: /sitecore/ Disallow: /sitecore modules/ Disallow: /sitecore_files/ Disallow: /App_Data/ Disallow: /bin/