User-agent: * Disallow: /.htaccess Disallow: /images/ Disallow: /assets/