Skip to content

Instantly share code, notes, and snippets.

@miziomon

miziomon/gist:4467983

Created January 6, 2013 15:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save miziomon/4467983 to your computer and use it in GitHub Desktop.
Save miziomon/4467983 to your computer and use it in GitHub Desktop.
Download ZIP
My WordPress robot.txt
Raw
gistfile1.txt
User-agent: *
Disallow:
Disallow: /blackhole/*
Disallow: /cgi-bin/
Disallow: /bin/
Disallow: /wp-includes/
Disallow: /wp-content/
Disallow: /wp-admin/
Disallow: /app/
User-agent: msnbot
Crawl-delay: 60
User-agent: Googlebot
Crawl-delay: 60
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment