Skip to content

Instantly share code, notes, and snippets.

@samsargent

samsargent/wget-crawl.sh

Created February 13, 2019 01:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save samsargent/5fa321e456e2b767032407f4dc74eb21 to your computer and use it in GitHub Desktop.
Save samsargent/5fa321e456e2b767032407f4dc74eb21 to your computer and use it in GitHub Desktop.
Download ZIP
wget crawl and download local mirror of site and all files
Raw
wget-crawl.sh
wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://domain.com/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment