Skip to content

Instantly share code, notes, and snippets.

@stepney141

stepney141/wget-waybacker.sh

Created April 22, 2021 08:52
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save stepney141/9b503bd71cdd40fe21453c63a4023796 to your computer and use it in GitHub Desktop.
Save stepney141/9b503bd71cdd40fe21453c63a4023796 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
wget-waybacker.sh
#!/bin/bash
# ref: https://webapps.stackexchange.com/questions/115369/how-to-archive-the-whole-website
wget -m -nv -o logfile.txt $1
find . -name '*.htm' -or -name '*.html' -exec curl -v "https://web.archive.org/save/https://{}" ';'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment