Skip to content

Instantly share code, notes, and snippets.



Created Jul 17, 2016
What would you like to do?
Linkchecker alternative via wget with recursive spider options
timestamp=$(date +"%Y%m%d%H%M%S")
cd /tmp
time wget -4 --spider -r --delete-after \
--no-cache --no-http-keep-alive --no-dns-cache \
-U "Wget" \
-X/blog \ -o"/tmp/wget-example-com-$timestamp.log"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.