Skip to content

Instantly share code, notes, and snippets.

@mnsami

mnsami/crawl-website.sh

Created January 4, 2016 16:25
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save mnsami/a8ccbbf6768985562253 to your computer and use it in GitHub Desktop.
Save mnsami/a8ccbbf6768985562253 to your computer and use it in GitHub Desktop.
Download ZIP
wget to download website for offline viewing
Raw
crawl-website.sh
#!/bin/sh
wget=/usr/bin/wget
if [ ! -x "$wget" ]; then
echo "ERROR: No wget." >&2
exit 1
fi
# This script is to download website to make it available for offline viewing.
$wget --recursive --page-requisites --html-extension --convert-links $1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment