This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
####################################################### | |
### nginx.conf site wp vhost include start | |
####################################################### | |
### | |
### deny crawlers without 403 response | |
### | |
if ($http_user_agent ~* (HTTrack|HTMLParser|libwww|wget) ) { | |
return 444; | |
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
// Use Gists to store code you would like to remember later on | |
console.log(window); // log the "window" object to the console |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from scrapy.spider import BaseSpider | |
from scrapy.conf import settings | |
from scrapy.http import Request | |
from random import choice | |
class DoubleIPSpider(BaseSpider): | |
name = "double_ip_test" | |
allowed_domains = ["httpbin.org"] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
---start--- | |
find /var/www/grav-onepage -type d -exec chmod 0755 {} \; &> /dev/null | |
find /var/www/grav-onepage -type f -exec chmod 0644 {} \; &> /dev/null | |
chown -R www72:www-data /var/www/grav-onepage | |
find /var/www/grav-onepage/bin -type d -exec chmod 02755 {} \; &> /dev/null | |
find /var/www/grav-onepage/bin -type f -exec chmod 0755 {} \; &> /dev/null | |
find /var/www/grav-onepage/tmp -type d -exec chmod 02775 {} \; &> /dev/null |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
####################################################### | |
### nginx Grav CMS basic configuration start | |
####################################################### | |
### | |
### Add recommended HTTP headers | |
### | |
add_header Access-Control-Allow-Origin *; | |
add_header X-Frame-Options SAMEORIGIN; | |
add_header X-Content-Type-Options nosniff; |