Downloading HTTP directory with all files and sub-directories

readme.md

wget -r -N -np -nH --cut-dirs=3 -R index.html http://hostname/aaa/bbb/ccc/ddd/

Explanation:

0. It will download all files and subfolders in ddd directory:
1. recursively (-r),
2. not going to upper directories, like ccc/… (-np),
3. not saving files to hostname folder (-nH),
4. but to ddd by omitting first 3 folders aaa, bbb, ccc (--cut-dirs=3)
5. excluding index.html files (-R index.html)
6. Omitting download if file already exists

Reference:
http://bmwieczorek.wordpress.com/2008/10/01/wget-recursively-download-all-files-from-certain-directory-listed-by-apache/
https://stackoverflow.com/questions/23446635/how-to-download-http-directory-with-all-files-and-sub-directories-as-they-appear