Skip to content

Instantly share code, notes, and snippets.

@bKNN

bKNN/robots.txt for Wordpress

Last active October 25, 2019 09:36
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save bKNN/175ba87e9ea70b835dca2b48f2cf2afa to your computer and use it in GitHub Desktop.
Save bKNN/175ba87e9ea70b835dca2b48f2cf2afa to your computer and use it in GitHub Desktop.
Download ZIP
robots.txt boilerplate for Wordpress
Raw
robots.txt for Wordpress
User-agent: *
Disallow: /wp-admin/
Disallow: /cgi-bin/
Disallow: /trackback/
Disallow: /comment-page-*
Disallow: /?s=*
Disallow: /*.php$
Allow: /wp-admin/admin-ajax.php
Sitemap: https://YOUR-DOMAIN.com/sitemap.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment