Skip to content

Instantly share code, notes, and snippets.

@shabbirbhimani
Last active May 1, 2019 12:33
Show Gist options
  • Save shabbirbhimani/b13cda94bed774c4526dfe40dd791811 to your computer and use it in GitHub Desktop.
Save shabbirbhimani/b13cda94bed774c4526dfe40dd791811 to your computer and use it in GitHub Desktop.
Robots.txt file for WordPress
User-agent: *
Disallow: /go/
Disallow: /recommended/
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /comments/feed/
Disallow: /trackback/
Disallow: /xmlrpc.php
sitemap: /sitemap_index.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment