Skip to content

Instantly share code, notes, and snippets.

@mikaelz
Created July 17, 2016 08:55
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mikaelz/9d0a060d1e5c313ff6c537dc59215a10 to your computer and use it in GitHub Desktop.
Save mikaelz/9d0a060d1e5c313ff6c537dc59215a10 to your computer and use it in GitHub Desktop.
Linkchecker alternative via wget with recursive spider options
#!/bin/bash
timestamp=$(date +"%Y%m%d%H%M%S")
cd /tmp
time wget -4 --spider -r --delete-after \
--no-cache --no-http-keep-alive --no-dns-cache \
-U "Wget" \
-X/blog \
http://www.example.com -o"/tmp/wget-example-com-$timestamp.log"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment