description.md

Recursively download directory contents with wget.

Explanation - download all files and subfolders in ddd directory:

• recursively (-r),
• not going to upper directories, like ccc/... (-np),
• not saving files to hostname folder (-nH),
• but to ddd by omitting first 3 folders aaa, bbb, ccc (--cut-dirs=3),
• excluding index.html files (-R index.html)

via http://bmwieczorek.wordpress.com/2008/10/01/wget-recursively-download-all-files-from-certain-directory-listed-by-apache/

(obviously this depends on robots.txt not being to strict)

wgetter.sh

wget -r -np -nH --cut-dirs=3 -R index.html http://hostname/aaa/bbb/ccc/ddd/