Skip to content

Instantly share code, notes, and snippets.

View danielvonmitschke's full-sized avatar

danielvonmitschke

View GitHub Profile
# BEGIN close out bad bots
# ####################################################
Options All -Indexes
RewriteEngine on
# Block Bad Bots & Scrapers
SetEnvIfNoCase User-Agent ^$ bad_bot
SetEnvIfNoCase User-Agent "^AESOP_com_SpiderMan" bad_bot
SetEnvIfNoCase User-Agent "^Alexibot" bad_bot