Skip to content

Instantly share code, notes, and snippets.

@cristiroma
Created October 28, 2020 07:42
Show Gist options
  • Save cristiroma/519bd3dff60d4944b75f5b821388a9b2 to your computer and use it in GitHub Desktop.
Save cristiroma/519bd3dff60d4944b75f5b821388a9b2 to your computer and use it in GitHub Desktop.
wget commands
# Spider through website up to level 5 links
wget --no-verbose --recursive --spider --force-html --level=5 --no-directories --reject=jpg,jpeg,png,gif,pdf,doc,docx http://example.com
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment