allthingsdem
allthingsdem
/ gist:e8eccb231d278335d821
Created
July 6, 2014 07:18
My long list of bad bots to block in htaccess, ready to copy and paste!
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Start Bad Bot Prevention | |
| <IfModule mod_setenvif.c> | |
| # SetEnvIfNoCase User-Agent ^$ bad_bot | |
| SetEnvIfNoCase User-Agent "^12soso.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^192.comAgent.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^1Noonbot.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^1on1searchBot.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3D_SEARCH.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3DE_SEARCH2.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3GSE.*" bad_bot |
allthingsdem
/ gist:63b3223a7d14ac1f2457
Created
July 6, 2014 07:17
My long list of bad bots to block in htaccess, ready to copy and paste!
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Start Bad Bot Prevention | |
| <IfModule mod_setenvif.c> | |
| # SetEnvIfNoCase User-Agent ^$ bad_bot | |
| SetEnvIfNoCase User-Agent "^12soso.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^192.comAgent.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^1Noonbot.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^1on1searchBot.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3D_SEARCH.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3DE_SEARCH2.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3GSE.*" bad_bot |
allthingsdem
/ gist:19627bb4bcae1d2d9b4e
Created
July 6, 2014 06:40
My long list of bad bots to block in htaccess, ready to copy and paste!
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Start Bad Bot Prevention | |
| <IfModule mod_setenvif.c> | |
| # SetEnvIfNoCase User-Agent ^$ bad_bot | |
| SetEnvIfNoCase User-Agent "^12soso.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^192.comAgent.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^1Noonbot.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^1on1searchBot.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3D_SEARCH.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3DE_SEARCH2.*" bad_bot | |
| SetEnvIfNoCase User-Agent "^3GSE.*" bad_bot |