Skip to content

Instantly share code, notes, and snippets.

@robbishop
robbishop / code
Created March 15, 2018 11:28 — forked from merajsiddiqui/code
Wget Website Downloader
wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-name=windows --domains {domain-name} --no-parent http://domain-name/
in case the above code gives 403 error try this
wget --limit-rate=500k --no-clobber --convert-links --random-wait -r -p -E -e robots=off -U mozilla http://www.xyz.com/abc/
@robbishop
robbishop / code
Created March 15, 2018 11:28 — forked from merajsiddiqui/code
Wget Website Downloader
wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-name=windows --domains {domain-name} --no-parent http://domain-name/
in case the above code gives 403 error try this
wget --limit-rate=500k --no-clobber --convert-links --random-wait -r -p -E -e robots=off -U mozilla http://www.xyz.com/abc/
@robbishop
robbishop / openresty-ubuntu-install.sh
Created December 31, 2016 09:02 — forked from alex-roman/openresty-ubuntu-install.sh
Easy install openresty (used and tested on Ubuntu 14.04, 15.10 and 16.04)
#!/bin/bash
apt-get -y update
apt-get -y install nginx-extras build-essential libpcre3-dev libssl-dev libgeoip-dev libpq-dev libxslt1-dev libgd2-xpm-dev
wget -c https://openresty.org/download/openresty-1.9.15.1.tar.gz
tar zxvf openresty-1.9.15.1.tar.gz
cd openresty-1.9.15.1
./configure \
--sbin-path=/usr/sbin/nginx \
--conf-path=/etc/nginx/nginx.conf \