Skip to content

Instantly share code, notes, and snippets.

@og-shawn-crigger
Created January 26, 2012 00:09
Show Gist options
  • Save og-shawn-crigger/1679911 to your computer and use it in GitHub Desktop.
Save og-shawn-crigger/1679911 to your computer and use it in GitHub Desktop.
Robots txt file for bonfire
user-agent: *
disallow: /assets/
disallow: /assets/images/
disallow: /assets/css/
disallow: /assets/js/
disallow: /classes/
disallow: /captcha/
disallow: /bonfire/
disallow: /bonfire/codeigniter/
disallow: /bonfire/application/confiq/
disallow: /bonfire/application/controllers/
disallow: /bonfire/application/errors/
disallow: /bonfire/application/helpers/
disallow: /bonfire/application/hooks/
disallow: /bonfire/application/models/
disallow: /bonfire/application/libraries/
disallow: /bonfire/application/language/
disallow: /bonfire/modules/
disallow: /bonfire/themes/
User-agent: Googlebot-Image
Disallow:
Allow: *
Sitemap: http://www.example.com/sitemaps/sitemap.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment