Skip to content

Instantly share code, notes, and snippets.

@pfactum
Created February 11, 2014 21:31
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save pfactum/8944627 to your computer and use it in GitHub Desktop.
Save pfactum/8944627 to your computer and use it in GitHub Desktop.
#!/usr/bin/env bash
local_storage="/home/pf/work/tmp/mirrors"
mirrors="\
ck;http://ck.kolivas.org;patches/ \
bfq;http://algo.ing.unimo.it;people/paolo/disk_sched/patches/ \
"
for mirror in $mirrors
do
mirror_name=$(echo $mirror | cut -d ';' -f 1)
mirror_site=$(echo $mirror | cut -d ';' -f 2)
mirror_path=$(echo $mirror | cut -d ';' -f 3)
mirror_path_hops=$(echo $mirror_path | grep -o "/" | wc -l)
mkdir -p "$local_storage/$mirror_name"
wget -r -np -nH --cut-dirs=$mirror_path_hops -N -R *.html* --directory-prefix="$local_storage/$mirror_name" $mirror_site/$mirror_path
find "$local_storage/$mirror_name" -type d -empty -delete
done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment