Skip to content

Instantly share code, notes, and snippets.

@chuckreynolds

chuckreynolds/robots.txt

Last active May 22, 2023 18:44
Show Gist options
  • Star 11 You must be signed in to star a gist
  • Fork 5 You must be signed in to fork a gist
  • Save chuckreynolds/135728 to your computer and use it in GitHub Desktop.
Save chuckreynolds/135728 to your computer and use it in GitHub Desktop.
Download ZIP
Solid start Robots.txt for WordPress Sites. (HEADS UP: Make sure you're viewing the most recent version of this Gist) https://gist.github.com/chuckreynolds/135728/
Raw
robots.txt
# robots.txt for wordpress
# https://gist.github.com/chuckreynolds/135728
User-agent: *
Disallow: /cgi-bin/
Disallow: /trackback/
Disallow: /comment-page-*
Disallow: /?s=*
Disallow: /*.php$
Sitemap: https://YOUR-DOMAIN.com/sitemap.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment