Skip to content

Instantly share code, notes, and snippets.

@skulumani
Last active February 4, 2017 01:21
Show Gist options
  • Save skulumani/c80cb8bb16c2e6c98f32ec965d272fa2 to your computer and use it in GitHub Desktop.
Save skulumani/c80cb8bb16c2e6c98f32ec965d272fa2 to your computer and use it in GitHub Desktop.
Log into the site first and export the cookie
# HTTP Cookie File for domains related to xcdsystem.com.
# Downloaded with cookies.txt Chrome Extension (https://chrome.google.com/webstore/detail/njabckikapfpffapmjgojcnbfjonfjfg)
# Example: wget -x --load-cookies cookies.txt https://www.xcdsystem.com/aas/papers/index.cfm
#
www.xcdsystem.com FALSE / TRUE 0 JSESSIONID 40BA2E3B73B9C344A288EA59CA41DC4F.cfusion
First command I haven't tried yet
wget --load-cookies cookies.txt -U "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.76 Safari/537.36" --wait=0.25 --random-wait --recursive --domains xcdsystem.com -A pdf,doc,docx --execute robots=off "https://www.xcdsystem.com/aas/papers/index.cfm"
This one seems good
wget --load-cookies cookies.txt --execute robots=off --domains xcdsystem.com -H -N -k -p -r "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.76 Safari/537.36" "https://www.xcdsystem.com/aas/papers/index.cfm"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment