Skip to content

Instantly share code, notes, and snippets.

@SteelPangolin
Created January 23, 2015 21:28
Show Gist options
  • Save SteelPangolin/2002f4e7a6ace21ed0f9 to your computer and use it in GitHub Desktop.
Save SteelPangolin/2002f4e7a6ace21ed0f9 to your computer and use it in GitHub Desktop.
wget optimized for creating locally browseable archives
#!/bin/bash
wget \
--execute robots=off \
--no-check-certificate \
--mirror \
--html-extension \
--convert-links \
--backup-converted \
--page-requisites \
--timestamping \
--no-parent \
--follow-ftp \
--reject "index.html\\@C=[NMSD];O=[AD].html" \
--reject "index.html\\@[NMSD]=[AD].html" \
--restrict-file-names=windows \
--tries 1 \
--timeout 10 \
"$@"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment