Skip to content

Instantly share code, notes, and snippets.

@realsby
Last active July 12, 2018 21:07
Show Gist options
  • Save realsby/00633dec2ea23fb221ca659503a2bfcb to your computer and use it in GitHub Desktop.
Save realsby/00633dec2ea23fb221ca659503a2bfcb to your computer and use it in GitHub Desktop.
Download website with wget
wget --adjust-extension --span-hosts --convert-links --backup-converted --page-requisites --no-parent https://tr.sputniknews.com
wget --span-hosts --backup-converted --page-requisites --no-parent --content-disposition https://tr.sputniknews.com
file qs.sh
-------
# /bin/bash
for i in `find $1 -type f`
do
mv $i `echo $i | cut -d? -f1`
done
-------
Run to remove ?23423 querystrings from file names
./qs.sh .
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment