Skip to content

Instantly share code, notes, and snippets.

@jarthod

jarthod/website-dump.md

Created August 10, 2022 18:36
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jarthod/37f54f1cf4d29cf22848b040d208309c to your computer and use it in GitHub Desktop.
Save jarthod/37f54f1cf4d29cf22848b040d208309c to your computer and use it in GitHub Desktop.
Download ZIP
How to dump a website using wget
Raw
website-dump.md

Example with wget:

wget --no-parent -rpk --wait=1 --random-wait https://wbsite.com/page

--no-parent prevents going up in the URLs --wait=1 --random-wait slows down request and add jitter to go easy on the server

If it needs a connected session:

--header="Cookie: session=xxxx"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment