Skip to content

Instantly share code, notes, and snippets.

@shabbirbhimani

shabbirbhimani/robots.txt

Last active May 1, 2019 12:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save shabbirbhimani/b13cda94bed774c4526dfe40dd791811 to your computer and use it in GitHub Desktop.
Save shabbirbhimani/b13cda94bed774c4526dfe40dd791811 to your computer and use it in GitHub Desktop.
Download ZIP
Robots.txt file for WordPress
Raw
robots.txt
User-agent: *
Disallow: /go/
Disallow: /recommended/
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /comments/feed/
Disallow: /trackback/
Disallow: /xmlrpc.php
sitemap: /sitemap_index.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment