Skip to content

Instantly share code, notes, and snippets.

@philipborbon

philipborbon/Robots Environment .htaccess

Forked from chadclark/Robots Environment .htaccess
Created April 16, 2020 03:46
Show Gist options
  • Save philipborbon/36562ee446ecdb1ca5947ac07cb6c1ae to your computer and use it in GitHub Desktop.
Save philipborbon/36562ee446ecdb1ca5947ac07cb6c1ae to your computer and use it in GitHub Desktop.
Download ZIP
Robots.txt for Staging and Production. By adding these rewrite rules to your .htaccess file, robots_dev.txt will be served as robots.txt on any non-production server.
Raw
Robots Environment .htaccess
RewriteEngine On
# Robots.txt for Staging and Production -- change productiondomain.com to the actual url of your production site
RewriteCond %{HTTP_HOST} !productiondomain.com$ [NC]
RewriteRule ^robots.txt robots_dev.txt [L]
Raw
robots.txt
User-agent: *
Allow: /
Raw
robots_dev.txt
User-agent: *
Disallow: /
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment