Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
squid cache_peer with crawlera/proxyhub
Change: $scrapinhub/crawlera_hostname$, $username$, $password$ and you're ready to go.
Tested with squid3
hierarchy_stoplist cgi-bin ?
acl QUERY urlpath_regex cgi-bin \?
no_cache deny QUERY
hosts_file /etc/hosts
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern . 0 20% 4320
acl all src all
acl localhost src
acl to_localhost dst
acl purge method PURGE
cache_mem 1024 MB
http_access allow manager localhost
http_access deny manager
http_access allow purge localhost
http_access deny purge
acl lan src
http_access allow localhost
http_access allow lan
http_access deny all
http_reply_access allow all
icp_access allow all
coredump_dir /var/spool/squid
http_port 3128
cache_peer $scrapinhub/crawlera_hostname$ parent 8010 0 login=$username$:$password$ no-delay no-query proxy-only
never_direct allow all
request_header_access From deny all
request_header_access Via deny all
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment