Skip to content

Instantly share code, notes, and snippets.

@CapWebSolutions

CapWebSolutions/capweb-screaming-frog-excludes.txt

Created March 15, 2022 14:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save CapWebSolutions/e07c414dbb8229190f16096691e41af3 to your computer and use it in GitHub Desktop.
Save CapWebSolutions/e07c414dbb8229190f16096691e41af3 to your computer and use it in GitHub Desktop.
Download ZIP
Starting list of URLs to exclude when creating Screaming Frog config file for WordPress site.
Raw
capweb-screaming-frog-excludes.txt
/**
* WordPress URL Exclude List for Screaming Frog Spider
* @author Matt Ryan - https://capwebsolutions.com
* @date 2022-03-15
*/
// Nav: Configuration | Exclude
// Gets rid of:
// wp-content plugins, themes, mu-plugins, uploads, etc.
// all the WP core folders & contents
// any query parms.
//
/wp-content/.*
/wp-admin/.*
/wp-includes/.*
/\?.*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment