Skip to content

Instantly share code, notes, and snippets.

@Rosika2

Rosika2/gist:4507557b4fbf12b481f216851dafdf36 Secret

Last active August 4, 2020 10:35
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Rosika2/4507557b4fbf12b481f216851dafdf36 to your computer and use it in GitHub Desktop.
Save Rosika2/4507557b4fbf12b481f216851dafdf36 to your computer and use it in GitHub Desktop.
Download ZIP
--debug output for the wget command and with different "User-Agent" values for wget
Raw
gistfile1.txt
1.) User-Agent chromium:
firejail wget --debug --user-agent="Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/83.0.4103.61 Chrome/83.0.4103.61 Safari/537.36" "https://distrowatch.tradepub.com/?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn="
Setting --user-agent (useragent) to Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/83.0.4103.61 Chrome/83.0.4103.61 Safari/537.36
Setting --user-agent (useragent) to Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/83.0.4103.61 Chrome/83.0.4103.61 Safari/537.36
DEBUG output created by Wget 1.19.4 on linux-gnu.
Reading HSTS entries from /home/rosika/.wget-hsts
URI encoding = ‘UTF-8’
Converted file name 'index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=' (UTF-8) -> 'index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=' (UTF-8)
--2020-08-03 16:37:32-- https://distrowatch.tradepub.com/?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=
Resolving distrowatch.tradepub.com (distrowatch.tradepub.com)... 209.133.56.107
Caching distrowatch.tradepub.com => 209.133.56.107
Connecting to distrowatch.tradepub.com (distrowatch.tradepub.com)|209.133.56.107|:443... connected.
Created socket 5.
Releasing 0x000056272e3f7350 (new refcount 1).
Initiating SSL handshake.
Handshake successful; connected socket 5 to SSL handle 0x000056272e3f80c0
certificate:
subject: CN=*.tradepub.com,OU=Secure Link SSL Wildcard,OU=IT,O=NetLine Corporation,street=750 University Ave,L=Los Gatos,ST=CA,postalCode=95032,C=US
issuer: CN=Network Solutions OV Server CA 2,O=Network Solutions L.L.C.,L=Herndon,ST=VA,C=US
X509 certificate successfully verified and matches host distrowatch.tradepub.com
---request begin---
GET /?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn= HTTP/1.1
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/83.0.4103.61 Chrome/83.0.4103.61 Safari/537.36
Accept: */*
Accept-Encoding: identity
Host: distrowatch.tradepub.com
Connection: Keep-Alive
---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Mon, 03 Aug 2020 14:37:38 GMT
Server: Apache/2.2.3 (CentOS)
Content-disposition: attachment; filename="w_linu01.pdf"
Set-Cookie: Apache=209.133.56.103.1596465458537850; path=/; domain=.tradepub.com
Content-length: 959314
Cneonction: close
Content-Type: application/pdf
---response end---
200 OK
cdm: 1
Stored cookie tradepub.com -1 (ANY) / <session> <insecure> [expiry none] Apache 209.133.56.103.1596465458537850
Registered socket 5 for persistent reuse.
Length: 959314 (937K) [application/pdf]
Saving to: ‘index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=’
index.html?p=w_linu01&w=d&email=3bernhard@tempr.emai 100%[===================================================================================================================>] 936,83K 224KB/s in 5,4s
2020-08-03 16:37:44 (173 KB/s) - ‘index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=’ saved [959314/959314]
rosika@rosika-Lenovo-H520e /m/r/f/D/D/n/Projekt_if_download_pdf> echo $status
0
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
2.) User-Agent falkon:
firejail wget --debug --user-agent="Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Falkon/3.0.0 Chrome/56.0.2924.122 Safari/537.36" "https://distrowatch.tradepub.com/?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn="
Setting --user-agent (useragent) to Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Falkon/3.0.0 Chrome/56.0.2924.122 Safari/537.36
Setting --user-agent (useragent) to Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Falkon/3.0.0 Chrome/56.0.2924.122 Safari/537.36
DEBUG output created by Wget 1.19.4 on linux-gnu.
Reading HSTS entries from /home/rosika/.wget-hsts
URI encoding = ‘UTF-8’
Converted file name 'index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=' (UTF-8) -> 'index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=' (UTF-8)
--2020-08-03 16:44:03-- https://distrowatch.tradepub.com/?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=
Resolving distrowatch.tradepub.com (distrowatch.tradepub.com)... 209.133.56.107
Caching distrowatch.tradepub.com => 209.133.56.107
Connecting to distrowatch.tradepub.com (distrowatch.tradepub.com)|209.133.56.107|:443... connected.
Created socket 5.
Releasing 0x0000560029db3320 (new refcount 1).
Initiating SSL handshake.
Handshake successful; connected socket 5 to SSL handle 0x0000560029db4050
certificate:
subject: CN=*.tradepub.com,OU=Secure Link SSL Wildcard,OU=IT,O=NetLine Corporation,street=750 University Ave,L=Los Gatos,ST=CA,postalCode=95032,C=US
issuer: CN=Network Solutions OV Server CA 2,O=Network Solutions L.L.C.,L=Herndon,ST=VA,C=US
X509 certificate successfully verified and matches host distrowatch.tradepub.com
---request begin---
GET /?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn= HTTP/1.1
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Falkon/3.0.0 Chrome/56.0.2924.122 Safari/537.36
Accept: */*
Accept-Encoding: identity
Host: distrowatch.tradepub.com
Connection: Keep-Alive
---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Mon, 03 Aug 2020 14:44:05 GMT
Server: Apache/2.2.3 (CentOS)
Content-disposition: attachment; filename="w_linu01.pdf"
Set-Cookie: Apache=209.133.56.103.1596465845052942; path=/; domain=.tradepub.com
Content-length: 959314
Cneonction: close
Content-Type: application/pdf
---response end---
200 OK
cdm: 1
Stored cookie tradepub.com -1 (ANY) / <session> <insecure> [expiry none] Apache 209.133.56.103.1596465845052942
Registered socket 5 for persistent reuse.
Length: 959314 (937K) [application/pdf]
Saving to: ‘index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=’
index.html?p=w_linu01&w=d&email=3bernhard@tempr.emai 100%[===================================================================================================================>] 936,83K 245KB/s in 4,1s
2020-08-03 16:44:09 (230 KB/s) - ‘index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=’ saved [959314/959314]
rosika@rosika-Lenovo-H520e /m/r/f/D/D/n/Projekt_if_download_pdf> echo $status
0
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
3.) User-Agent firefox:
firejail wget --debug --user-agent="Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:79.0) Gecko/20100101 Firefox/79.0" "https://distrowatch.tradepub.com/?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn="
Setting --user-agent (useragent) to Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:79.0) Gecko/20100101 Firefox/79.0
Setting --user-agent (useragent) to Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:79.0) Gecko/20100101 Firefox/79.0
DEBUG output created by Wget 1.19.4 on linux-gnu.
Reading HSTS entries from /home/rosika/.wget-hsts
URI encoding = ‘UTF-8’
Converted file name 'index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=' (UTF-8) -> 'index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=' (UTF-8)
--2020-08-03 16:46:42-- https://distrowatch.tradepub.com/?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=
Resolving distrowatch.tradepub.com (distrowatch.tradepub.com)... 209.133.56.107
Caching distrowatch.tradepub.com => 209.133.56.107
Connecting to distrowatch.tradepub.com (distrowatch.tradepub.com)|209.133.56.107|:443... connected.
Created socket 5.
Releasing 0x00005620527752e0 (new refcount 1).
Initiating SSL handshake.
Handshake successful; connected socket 5 to SSL handle 0x0000562052776050
certificate:
subject: CN=*.tradepub.com,OU=Secure Link SSL Wildcard,OU=IT,O=NetLine Corporation,street=750 University Ave,L=Los Gatos,ST=CA,postalCode=95032,C=US
issuer: CN=Network Solutions OV Server CA 2,O=Network Solutions L.L.C.,L=Herndon,ST=VA,C=US
X509 certificate successfully verified and matches host distrowatch.tradepub.com
---request begin---
GET /?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn= HTTP/1.1
User-Agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:79.0) Gecko/20100101 Firefox/79.0
Accept: */*
Accept-Encoding: identity
Host: distrowatch.tradepub.com
Connection: Keep-Alive
---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 200 OK
Date: Mon, 03 Aug 2020 14:46:44 GMT
Server: Apache/2.2.3 (CentOS)
Set-Cookie: Apache=209.133.56.103.1596466004616019; path=/; domain=.tradepub.com
Cneonction: close
Transfer-Encoding: chunked
Content-Type: application/pdf
---response end---
200 OK
cdm: 1
Stored cookie tradepub.com -1 (ANY) / <session> <insecure> [expiry none] Apache 209.133.56.103.1596466004616019
Registered socket 5 for persistent reuse.
Length: unspecified [application/pdf]
Saving to: ‘index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=’
index.html?p=w_linu01&w=d&email=3bernhard@tempr.emai [ <=> ] 936,85K 202KB/s in 6,2s
2020-08-03 16:46:51 (151 KB/s) - ‘index.html?p=w_linu01&w=d&email=3bernhard@tempr.email&key=GcIEvQ1el3M7EFMP0ZFg&ts=65248&u=0821130991791596207566&e=M2Jlcm5oYXJkQHRlbXByLmVtYWls&_afn=’ saved [959330]
rosika@rosika-Lenovo-H520e /m/r/f/D/D/n/Projekt_if_download_pdf> echo $status
0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment