Skip to content

Instantly share code, notes, and snippets.

@baslie
Last active June 1, 2016 03:20
Show Gist options
  • Save baslie/d2b32bc86d1d573ab2be9d9145abe041 to your computer and use it in GitHub Desktop.
Save baslie/d2b32bc86d1d573ab2be9d9145abe041 to your computer and use it in GitHub Desktop.
WGET: Using wget for proper site-grabbing
// This command downloads only one directory without 'parents' and includes cyrillic filenames
wget --page-requisites --restrict-file-names=nocontrol --no-parent -r -l 20 -e robots=off -U mozilla http://site.com
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment