Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
Blocking hygiene pages from crawling and indexation in robots.txt for demandware
User-Agent: *
Disallow: /on/demandware.store/Sites-yoursite-Site/default/Account-StartRegister
Disallow: /on/demandware.store/Sites-yoursite-Site/default/Account-PasswordResetDialog
Disallow: /on/demandware.store/Sites-yoursite-Site/default/GiftCert-Purchase
Disallow: /on/demandware.store/Sites-yoursite-Site/default/GiftRegistry-Start
Disallow: /on/demandware.store/Sites-yoursite-Site/default/Page-Show
Disallow: /on/demandware.store/Sites-yoursite-Site/default/Wishlist-SetShippingAddress
Disallow: /on/demandware.static/-/Sites-yoursite-Library/default
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment