Skip to content

Instantly share code, notes, and snippets.

@KoolPal
Forked from deeman/robots.txt
Created February 4, 2020 10:29
Show Gist options
  • Save KoolPal/390ef3904353e122c2cb6bbd8e8d1c95 to your computer and use it in GitHub Desktop.
Save KoolPal/390ef3904353e122c2cb6bbd8e8d1c95 to your computer and use it in GitHub Desktop.
Custom WordpPress/WooCommerce Robots.txt
User-agent: *
Disallow: /wp-admin/
Disallow: /?s=
Disallow: /search/
Allow: /admin/admin-ajax.php
Disallow: /cgi-bin/
Disallow: /wp-content/cache/
Disallow: /trackback/
Disallow: */trackback/
#WooCommerce
Disallow: /*?product_cat*
Disallow: /*?product_tag*
Disallow: /*?source_id*
Disallow: /*?orderby*
Disallow: /*?product_order*
Disallow: /*?product_count*
Disallow: /*?page_size*
Disallow: /?add-to-cart*
# MISC Parts
# Allways allow CSS, JS. Do not block
Allow: /*.css$
Allow: /*.js$
#Sajtkartor
Sitemap: https://yourdomain.com/sitemap.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment