Skip to content

Instantly share code, notes, and snippets.

@stream7
Created April 3, 2016 08:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save stream7/4e0037fa497664987455cdb48aff9de9 to your computer and use it in GitHub Desktop.
Save stream7/4e0037fa497664987455cdb48aff9de9 to your computer and use it in GitHub Desktop.
wget commands for downloading a whole website
// Get the pages
wget \
--recursive \
--no-clobber \
--page-requisites \
--html-extension \
--convert-links \
--no-parent \
--restrict-file-names=nocontrol \
http://url.com
// Get the images
wget -e robots=off \
-H -nc -np \
--recursive -p \
--level=1 \
--domains url.com,cloudfront.net \
http://url.com
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment