Skip to content

Instantly share code, notes, and snippets.

@voidlizard

voidlizard/dump.bash

Created November 5, 2019 06:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save voidlizard/c28e47845cd44b2786352873b32db6e7 to your computer and use it in GitHub Desktop.
Save voidlizard/c28e47845cd44b2786352873b32db6e7 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
dump.bash
wget \
--recursive \
--no-clobber \
--page-requisites \
--html-extension \
--convert-links \
--level=2 \
--follow-tags=a\
-U "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1700.102 Safari/537.36"\
--reject '*.js,*.css,*.ico,*.txt,*.gif,*.jpg,*.jpeg,*.png,*.mp3,*.pdf,*.tgz,*.flv,*.avi,*.mpeg,*.iso'\
--restrict-file-names=windows \
--domains icobench.com \
--no-parent \
https://example.com
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment