Skip to content

Instantly share code, notes, and snippets.

@lukas-h
Created August 11, 2020 09:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save lukas-h/b6c745f864bfc23d6acde39d288fcf36 to your computer and use it in GitHub Desktop.
Save lukas-h/b6c745f864bfc23d6acde39d288fcf36 to your computer and use it in GitHub Desktop.
Scrape website recursively
wget \
--recursive \
--no-clobber \
--page-requisites \
--convert-links \
--restrict-file-names=windows \
--domains $1 \
--no-parent \
https://$1/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment