Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
Contao robots.txt
User-agent: *
Disallow: /check/
Disallow: /contao/
Disallow: /system/
Disallow: /templates/
Disallow: /vendor/
Disallow: /share/index.php
Disallow: /build.xml
Disallow: /composer.json
Disallow: /composer.lock
Disallow: /README.md
Allow: /system/cron/cron.txt
Allow: /system/modules/*/assets/
Allow: /system/*.js
Allow: /system/*.css
Allow: /plugins/*.js
Allow: /plugins/*.css
Allow: /assets/*.js
Allow: /assets/*.css
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment