Skip to content

Instantly share code, notes, and snippets.

@xmorave2
Last active April 4, 2024 11:53
Show Gist options
  • Save xmorave2/a5f0b7f59664409384119ffa0efcce7b to your computer and use it in GitHub Desktop.
Save xmorave2/a5f0b7f59664409384119ffa0efcce7b to your computer and use it in GitHub Desktop.
Block bots
BrowserMatchNoCase "360Spider" bots
BrowserMatchNoCase "80legs" bots
BrowserMatchNoCase "Abonti" bots
BrowserMatchNoCase "Aboundex" bots
BrowserMatchNoCase "AcoonBot" bots
BrowserMatchNoCase "Acunetix" bots
BrowserMatchNoCase "adbeat_bot" bots
BrowserMatchNoCase "AddThis.com" bots
BrowserMatchNoCase "adidxbot" bots
BrowserMatchNoCase "ADmantX" bots
BrowserMatchNoCase "AhrefsBot" bots
BrowserMatchNoCase "AIBOT" bots
BrowserMatchNoCase "aiHitBot" bots
BrowserMatchNoCase "Alexibot" bots
BrowserMatchNoCase "Alligator" bots
BrowserMatchNoCase "AllSubmitter" bots
BrowserMatchNoCase "AngloINFO" bots
BrowserMatchNoCase "Antelope" bots
BrowserMatchNoCase "Apexoo" bots
BrowserMatchNoCase "asterias" bots
BrowserMatchNoCase "attach" bots
BrowserMatchNoCase "BackDoorBot" bots
BrowserMatchNoCase "BackStreet" bots
BrowserMatchNoCase "BackWeb" bots
BrowserMatchNoCase "Badass" bots
BrowserMatchNoCase "Baid" bots
BrowserMatchNoCase "Baiduspider" bots
BrowserMatchNoCase "BaiduSpider" bots
BrowserMatchNoCase "Bandit" bots
BrowserMatchNoCase "BatchFTP" bots
BrowserMatchNoCase "BBBike" bots
BrowserMatchNoCase "BeetleBot" bots
BrowserMatchNoCase "Bigfoot" bots
BrowserMatchNoCase "billigerbot" bots
BrowserMatchNoCase "binlar" bots
BrowserMatchNoCase "bitlybot" bots
BrowserMatchNoCase "Black.Hole" bots
BrowserMatchNoCase "BlackWidow" bots
BrowserMatchNoCase "BLEXBot" bots
BrowserMatchNoCase "Blow" bots
BrowserMatchNoCase "BlowFish" bots
BrowserMatchNoCase "BLP_bbot" bots
BrowserMatchNoCase "BoardReader" bots
BrowserMatchNoCase "Bolt 0" bots
BrowserMatchNoCase "BOT for JCE" bots
BrowserMatchNoCase "Bot mailto:craftbot@yahoo.com" bots
BrowserMatchNoCase "BotALot" bots
BrowserMatchNoCase "Buddy" bots
BrowserMatchNoCase "BuiltBotTough" bots
BrowserMatchNoCase "Bullseye" bots
BrowserMatchNoCase "BunnySlippers" bots
BrowserMatchNoCase "casper" bots
BrowserMatchNoCase "CazoodleBot" bots
BrowserMatchNoCase "CCBot" bots
BrowserMatchNoCase "Cegbfeieh" bots
BrowserMatchNoCase "checkprivacy" bots
BrowserMatchNoCase "CheeseBot" bots
BrowserMatchNoCase "CherryPicker" bots
BrowserMatchNoCase "ChinaClaw" bots
BrowserMatchNoCase "chromeframe" bots
BrowserMatchNoCase "Clerkbot" bots
BrowserMatchNoCase "Cliqzbot" bots
BrowserMatchNoCase "clshttp" bots
BrowserMatchNoCase "Cogentbot" bots
BrowserMatchNoCase "cognitiveseo" bots
BrowserMatchNoCase "Collector" bots
BrowserMatchNoCase "CommonCrawler" bots
BrowserMatchNoCase "comodo" bots
BrowserMatchNoCase "Copier" bots
BrowserMatchNoCase "CopyRightCheck" bots
BrowserMatchNoCase "cosmos" bots
BrowserMatchNoCase "CPython" bots
BrowserMatchNoCase "crawler4j" bots
BrowserMatchNoCase "Crawlera" bots
BrowserMatchNoCase "CRAZYWEBCRAWLER" bots
BrowserMatchNoCase "Crescent" bots
BrowserMatchNoCase "CSHttp" bots
BrowserMatchNoCase "Curious" bots
BrowserMatchNoCase "Curl" bots
BrowserMatchNoCase "Custo" bots
BrowserMatchNoCase "CWS_proxy" bots
BrowserMatchNoCase "Default Browser 0" bots
BrowserMatchNoCase "Demon" bots
BrowserMatchNoCase "DeuSu" bots
BrowserMatchNoCase "Devil" bots
BrowserMatchNoCase "diavol" bots
BrowserMatchNoCase "DigExt" bots
BrowserMatchNoCase "Digincore" bots
BrowserMatchNoCase "DIIbot" bots
BrowserMatchNoCase "DISCo" bots
BrowserMatchNoCase "discobot" bots
BrowserMatchNoCase "DittoSpyder" bots
BrowserMatchNoCase "DoCoMo" bots
BrowserMatchNoCase "DotBot" bots
BrowserMatchNoCase "Download.Demon" bots
BrowserMatchNoCase "Download.Devil" bots
BrowserMatchNoCase "Download.Wonder" bots
BrowserMatchNoCase "Download Demo" bots
BrowserMatchNoCase "dragonfly" bots
BrowserMatchNoCase "Drip" bots
BrowserMatchNoCase "DTS.Agent" bots
BrowserMatchNoCase "EasouSpider" bots
BrowserMatchNoCase "EasyDL" bots
BrowserMatchNoCase "ebingbong" bots
BrowserMatchNoCase "eCatch" bots
BrowserMatchNoCase "ecxi" bots
BrowserMatchNoCase "EirGrabber" bots
BrowserMatchNoCase "Elmer" bots
BrowserMatchNoCase "EmailCollector" bots
BrowserMatchNoCase "EmailSiphon" bots
BrowserMatchNoCase "EmailWolf" bots
BrowserMatchNoCase "EroCrawler" bots
BrowserMatchNoCase "Exabot" bots
BrowserMatchNoCase "ExaleadCloudView" bots
BrowserMatchNoCase "ExpertSearch" bots
BrowserMatchNoCase "ExpertSearchSpider" bots
BrowserMatchNoCase "Express" bots
BrowserMatchNoCase "Express WebPictures" bots
BrowserMatchNoCase "extract" bots
BrowserMatchNoCase "Extractor" bots
BrowserMatchNoCase "ExtractorPro" bots
BrowserMatchNoCase "EyeNetIE" bots
BrowserMatchNoCase "Ezooms" bots
BrowserMatchNoCase "F2S" bots
BrowserMatchNoCase "FastSeek" bots
BrowserMatchNoCase "feedfinder" bots
BrowserMatchNoCase "FeedlyBot" bots
BrowserMatchNoCase "FHscan" bots
BrowserMatchNoCase "finbot" bots
BrowserMatchNoCase "Flamingo_SearchEngine" bots
BrowserMatchNoCase "FlappyBot" bots
BrowserMatchNoCase "FlashGet" bots
BrowserMatchNoCase "flicky" bots
BrowserMatchNoCase "Flipboard" bots
BrowserMatchNoCase "FlipboardProxy" bots
BrowserMatchNoCase "flunky" bots
BrowserMatchNoCase "Foobot" bots
BrowserMatchNoCase "FrontPage" bots
BrowserMatchNoCase "g00g1e" bots
BrowserMatchNoCase "GalaxyBot" bots
BrowserMatchNoCase "genieo" bots
BrowserMatchNoCase "Genieo" bots
BrowserMatchNoCase "GetRight" bots
BrowserMatchNoCase "GetWeb!" bots
BrowserMatchNoCase "GigablastOpenSource" bots
BrowserMatchNoCase "Go-Ahead-Got-It" bots
BrowserMatchNoCase "Go!Zilla" bots
BrowserMatchNoCase "gotit" bots
BrowserMatchNoCase "GozaikBot" bots
BrowserMatchNoCase "GPTBot" bots
BrowserMatchNoCase "grab" bots
BrowserMatchNoCase "Grabber" bots
BrowserMatchNoCase "GrabNet" bots
BrowserMatchNoCase "Grafula" bots
BrowserMatchNoCase "GrapeshotCrawler" bots
BrowserMatchNoCase "GT::WWW" bots
BrowserMatchNoCase "GTB5" bots
BrowserMatchNoCase "Guzzle" bots
BrowserMatchNoCase "harvest" bots
BrowserMatchNoCase "Harvest" bots
BrowserMatchNoCase "HEADMasterSEO" bots
BrowserMatchNoCase "heritrix" bots
BrowserMatchNoCase "hloader" bots
BrowserMatchNoCase "HMView" bots
BrowserMatchNoCase "HomePageBot" bots
BrowserMatchNoCase "htmlparser" bots
BrowserMatchNoCase "HTTP::Lite" bots
BrowserMatchNoCase "httrack" bots
BrowserMatchNoCase "HTTrack" bots
BrowserMatchNoCase "HubSpot" bots
BrowserMatchNoCase "humanlinks" bots
BrowserMatchNoCase "ia_archiver" bots
BrowserMatchNoCase "icarus6" bots
BrowserMatchNoCase "id-search" bots
BrowserMatchNoCase "IDBot" bots
BrowserMatchNoCase "IlseBot" bots
BrowserMatchNoCase "Image.Stripper" bots
BrowserMatchNoCase "Image.Sucker" bots
BrowserMatchNoCase "Image Stripper" bots
BrowserMatchNoCase "Image Sucker" bots
BrowserMatchNoCase "imagefetch" bots
BrowserMatchNoCase "Indigonet" bots
BrowserMatchNoCase "Indy Library" bots
BrowserMatchNoCase "InfoNaviRobot" bots
BrowserMatchNoCase "InfoTekies" bots
BrowserMatchNoCase "integromedb" bots
BrowserMatchNoCase "Intelliseek" bots
BrowserMatchNoCase "InterGET" bots
BrowserMatchNoCase "Internet Ninja" bots
BrowserMatchNoCase "InternetSeer.com" bots
BrowserMatchNoCase "Iria" bots
BrowserMatchNoCase "IRLbot" bots
BrowserMatchNoCase "ISC Systems iRc Search 2.1" bots
BrowserMatchNoCase "jakarta" bots
BrowserMatchNoCase "Jakarta" bots
BrowserMatchNoCase "Java" bots
BrowserMatchNoCase "JennyBot" bots
BrowserMatchNoCase "JetCar" bots
BrowserMatchNoCase "JikeSpider" bots
BrowserMatchNoCase "JobdiggerSpider" bots
BrowserMatchNoCase "JOC" bots
BrowserMatchNoCase "JOC Web Spider" bots
BrowserMatchNoCase "Jooblebot" bots
BrowserMatchNoCase "JustView" bots
BrowserMatchNoCase "Jyxobot" bots
BrowserMatchNoCase "kanagawa" bots
BrowserMatchNoCase "Kenjin.Spider" bots
BrowserMatchNoCase "Keyword.Density" bots
BrowserMatchNoCase "KINGSpider" bots
BrowserMatchNoCase "kmccrew" bots
BrowserMatchNoCase "larbin" bots
BrowserMatchNoCase "LeechFTP" bots
BrowserMatchNoCase "LeechGet" bots
BrowserMatchNoCase "LexiBot" bots
BrowserMatchNoCase "lftp" bots
BrowserMatchNoCase "libWeb" bots
BrowserMatchNoCase "libwww" bots
BrowserMatchNoCase "libwww-perl" bots
BrowserMatchNoCase "likse" bots
BrowserMatchNoCase "Lingewoud" bots
BrowserMatchNoCase "LinkChecker" bots
BrowserMatchNoCase "linkdexbot" bots
BrowserMatchNoCase "LinkextractorPro" bots
BrowserMatchNoCase "LinkScan" bots
BrowserMatchNoCase "LinksCrawler" bots
BrowserMatchNoCase "LinksManager.com_bot" bots
BrowserMatchNoCase "linkwalker" bots
BrowserMatchNoCase "LinkWalker" bots
BrowserMatchNoCase "LinqiaRSSBot" bots
BrowserMatchNoCase "LivelapBot" bots
BrowserMatchNoCase "LNSpiderguy" bots
BrowserMatchNoCase "ltx71" bots
BrowserMatchNoCase "LubbersBot" bots
BrowserMatchNoCase "lwp-trivial" bots
BrowserMatchNoCase "Mag-Net" bots
BrowserMatchNoCase "Magnet" bots
BrowserMatchNoCase "Mail.RU_Bot" bots
BrowserMatchNoCase "majestic12" bots
BrowserMatchNoCase "MarkWatch" bots
BrowserMatchNoCase "Mass.Downloader" bots
BrowserMatchNoCase "Mass Downloader" bots
BrowserMatchNoCase "masscan" bots
BrowserMatchNoCase "Mata.Hari" bots
BrowserMatchNoCase "maverick" bots
BrowserMatchNoCase "Maxthon$" bots
BrowserMatchNoCase "Mediatoolkitbot" bots
BrowserMatchNoCase "megaindex" bots
BrowserMatchNoCase "MegaIndex" bots
BrowserMatchNoCase "Memo" bots
BrowserMatchNoCase "MetaURI" bots
BrowserMatchNoCase "MFC_Tear_Sample" bots
BrowserMatchNoCase "Microsoft URL Control" bots
BrowserMatchNoCase "microsoft.url" bots
BrowserMatchNoCase "MIDown tool" bots
BrowserMatchNoCase "MIIxpc" bots
BrowserMatchNoCase "miner" bots
BrowserMatchNoCase "Missigua Locator" bots
BrowserMatchNoCase "Mister PiX" bots
BrowserMatchNoCase "MJ12bot" bots
BrowserMatchNoCase "Mozilla.*Indy" bots
BrowserMatchNoCase "Mozilla.*NEWT" bots
BrowserMatchNoCase "MSFrontPage" bots
BrowserMatchNoCase "MSIECrawler" bots
BrowserMatchNoCase "msnbot" bots
BrowserMatchNoCase "NAMEPROTECT" bots
BrowserMatchNoCase "Navroad" bots
BrowserMatchNoCase "NearSite" bots
BrowserMatchNoCase "Net Vampire" bots
BrowserMatchNoCase "NetAnts" bots
BrowserMatchNoCase "Netcraft" bots
BrowserMatchNoCase "netEstate" bots
BrowserMatchNoCase "NetMechanic" bots
BrowserMatchNoCase "NetSpider" bots
BrowserMatchNoCase "NetZIP" bots
BrowserMatchNoCase "NextGenSearchBot" bots
BrowserMatchNoCase "NICErsPRO" bots
BrowserMatchNoCase "niki-bot" bots
BrowserMatchNoCase "NimbleCrawler" bots
BrowserMatchNoCase "Nimbostratus-Bot" bots
BrowserMatchNoCase "Ninja" bots
BrowserMatchNoCase "nmap" bots
BrowserMatchNoCase "Nmap" bots
BrowserMatchNoCase "NPbot" bots
BrowserMatchNoCase "nutch" bots
BrowserMatchNoCase "Octopus" bots
BrowserMatchNoCase "Offline.Explorer" bots
BrowserMatchNoCase "Offline.Navigator" bots
BrowserMatchNoCase "Offline Explorer" bots
BrowserMatchNoCase "Offline Navigator" bots
BrowserMatchNoCase "Openfind" bots
BrowserMatchNoCase "OpenindexSpider" bots
BrowserMatchNoCase "OpenLinkProfiler" bots
BrowserMatchNoCase "OpenWebSpider" bots
BrowserMatchNoCase "OrangeBot" bots
BrowserMatchNoCase "OutfoxBot" bots
BrowserMatchNoCase "Owlin" bots
BrowserMatchNoCase "PageGrabber" bots
BrowserMatchNoCase "PagesInventory" bots
BrowserMatchNoCase "panopta" bots
BrowserMatchNoCase "panscient.com" bots
BrowserMatchNoCase "Papa Foto" bots
BrowserMatchNoCase "pavuk" bots
BrowserMatchNoCase "pcBrowser" bots
BrowserMatchNoCase "PECL::HTTP" bots
BrowserMatchNoCase "PeoplePal" bots
BrowserMatchNoCase "Photon" bots
BrowserMatchNoCase "PHPCrawl" bots
BrowserMatchNoCase "Pixray" bots
BrowserMatchNoCase "planetwork" bots
BrowserMatchNoCase "PleaseCrawl" bots
BrowserMatchNoCase "PNAMAIN.EXE" bots
BrowserMatchNoCase "Pockey" bots
BrowserMatchNoCase "PodcastPartyBot" bots
BrowserMatchNoCase "prijsbest" bots
BrowserMatchNoCase "probethenet" bots
BrowserMatchNoCase "ProPowerBot" bots
BrowserMatchNoCase "ProWebWalker" bots
BrowserMatchNoCase "proximic" bots
BrowserMatchNoCase "psbot" bots
BrowserMatchNoCase "Pump" bots
BrowserMatchNoCase "purebot" bots
BrowserMatchNoCase "pycurl" bots
BrowserMatchNoCase "python-requests" bots
BrowserMatchNoCase "QueryN.Metasearch" bots
BrowserMatchNoCase "QuerySeekerSpider" bots
BrowserMatchNoCase "R6_CommentReader" bots
BrowserMatchNoCase "R6_FeedFetcher" bots
BrowserMatchNoCase "RealDownload" bots
BrowserMatchNoCase "Reaper" bots
BrowserMatchNoCase "Recorder" bots
BrowserMatchNoCase "ReGet" bots
BrowserMatchNoCase "RepoMonkey" bots
BrowserMatchNoCase "Riddler" bots
BrowserMatchNoCase "Ripper" bots
BrowserMatchNoCase "Rippers 0" bots
BrowserMatchNoCase "RMA" bots
BrowserMatchNoCase "rogerbot" bots
BrowserMatchNoCase "RSSingBot" bots
BrowserMatchNoCase "rv:1.9.1" bots
BrowserMatchNoCase "RyzeCrawler" bots
BrowserMatchNoCase "SafeSearch" bots
BrowserMatchNoCase "SBIder" bots
BrowserMatchNoCase "scanbot" bots
BrowserMatchNoCase "Scrapy" bots
BrowserMatchNoCase "Screaming" bots
BrowserMatchNoCase "SeaMonkey$" bots
BrowserMatchNoCase "search_robot" bots
BrowserMatchNoCase "search.goo.ne.jp" bots
BrowserMatchNoCase "SearchmetricsBot" bots
BrowserMatchNoCase "Semrush" bots
BrowserMatchNoCase "SemrushBot" bots
BrowserMatchNoCase "SentiBot" bots
BrowserMatchNoCase "SEOkicks" bots
BrowserMatchNoCase "SEOkicks-Robot" bots
BrowserMatchNoCase "seoscanners" bots
BrowserMatchNoCase "SeznamBot" bots
BrowserMatchNoCase "ShowyouBot" bots
BrowserMatchNoCase "SightupBot" bots
BrowserMatchNoCase "Siphon" bots
BrowserMatchNoCase "SISTRIX" bots
BrowserMatchNoCase "sitecheck.internetseer.com" bots
BrowserMatchNoCase "siteexplorer.info" bots
BrowserMatchNoCase "Siteimprove" bots
BrowserMatchNoCase "SiteSnagger" bots
BrowserMatchNoCase "SiteSucker" bots
BrowserMatchNoCase "skygrid" bots
BrowserMatchNoCase "Slackbot" bots
BrowserMatchNoCase "Slurp" bots
BrowserMatchNoCase "SlySearch" bots
BrowserMatchNoCase "SmartDownload" bots
BrowserMatchNoCase "Snake" bots
BrowserMatchNoCase "Snapbot" bots
BrowserMatchNoCase "Snoopy" bots
BrowserMatchNoCase "sogou" bots
BrowserMatchNoCase "Sogou" bots
BrowserMatchNoCase "Sosospider" bots
BrowserMatchNoCase "SpaceBison" bots
BrowserMatchNoCase "SpankBot" bots
BrowserMatchNoCase "spanner" bots
BrowserMatchNoCase "spaumbot" bots
BrowserMatchNoCase "spbot" bots
BrowserMatchNoCase "Spinn4r" bots
BrowserMatchNoCase "Sqworm" bots
BrowserMatchNoCase "Steeler" bots
BrowserMatchNoCase "Stripper" bots
BrowserMatchNoCase "sucker" bots
BrowserMatchNoCase "Sucker" bots
BrowserMatchNoCase "SuperBot" bots
BrowserMatchNoCase "Superfeedr" bots
BrowserMatchNoCase "SuperHTTP" bots
BrowserMatchNoCase "SurdotlyBot" bots
BrowserMatchNoCase "Surfbot" bots
BrowserMatchNoCase "suzuran" bots
BrowserMatchNoCase "Szukacz" bots
BrowserMatchNoCase "tAkeOut" bots
BrowserMatchNoCase "Teleport" bots
BrowserMatchNoCase "Teleport Pro" bots
BrowserMatchNoCase "Telesoft" bots
BrowserMatchNoCase "The.Intraformant" bots
BrowserMatchNoCase "TheNomad" bots
BrowserMatchNoCase "TightTwatBot" bots
BrowserMatchNoCase "TinEye" bots
BrowserMatchNoCase "TinEye-bot" bots
BrowserMatchNoCase "Titan" bots
BrowserMatchNoCase "Toata dragostea mea pentru diavola" bots
BrowserMatchNoCase "Toplistbot" bots
BrowserMatchNoCase "trendictionbot" bots
BrowserMatchNoCase "trovitBot" bots
BrowserMatchNoCase "True_Robot" bots
BrowserMatchNoCase "turingos" bots
BrowserMatchNoCase "turnit" bots
BrowserMatchNoCase "TurnitinBot" bots
BrowserMatchNoCase "Twitterbot" bots
BrowserMatchNoCase "URI::Fetch" bots
BrowserMatchNoCase "urllib" bots
BrowserMatchNoCase "URLy.Warning" bots
BrowserMatchNoCase "Vacuum" bots
BrowserMatchNoCase "Vagabondo" bots
BrowserMatchNoCase "VCI" bots
BrowserMatchNoCase "VidibleScraper" bots
BrowserMatchNoCase "vikspider" bots
BrowserMatchNoCase "VoidEYE" bots
BrowserMatchNoCase "VoilaBot" bots
BrowserMatchNoCase "WallpapersHD" bots
BrowserMatchNoCase "WBSearchBot" bots
BrowserMatchNoCase "Web.Image.Collector" bots
BrowserMatchNoCase "Web Image Collector" bots
BrowserMatchNoCase "Web Sucker" bots
BrowserMatchNoCase "webalta" bots
BrowserMatchNoCase "WebAuto" bots
BrowserMatchNoCase "WebBandit" bots
BrowserMatchNoCase "WebCollage" bots
BrowserMatchNoCase "WebCopier" bots
BrowserMatchNoCase "WebEnhancer" bots
BrowserMatchNoCase "WebFetch" bots
BrowserMatchNoCase "WebFuck" bots
BrowserMatchNoCase "WebGo IS" bots
BrowserMatchNoCase "WebLeacher" bots
BrowserMatchNoCase "WebmasterWorldForumBot" bots
BrowserMatchNoCase "WebPix" bots
BrowserMatchNoCase "WebReaper" bots
BrowserMatchNoCase "WebSauger" bots
BrowserMatchNoCase "WebShag" bots
BrowserMatchNoCase "Website.eXtractor" bots
BrowserMatchNoCase "Website eXtractor" bots
BrowserMatchNoCase "Website Quester" bots
BrowserMatchNoCase "Webster" bots
BrowserMatchNoCase "WebStripper" bots
BrowserMatchNoCase "WebSucker" bots
BrowserMatchNoCase "WebWhacker" bots
BrowserMatchNoCase "WebZIP" bots
BrowserMatchNoCase "Wells Search II" bots
BrowserMatchNoCase "WEP Search" bots
BrowserMatchNoCase "WeSEE" bots
BrowserMatchNoCase "Wget" bots
BrowserMatchNoCase "Whack" bots
BrowserMatchNoCase "Whacker" bots
BrowserMatchNoCase "Widow" bots
BrowserMatchNoCase "WinHTTrack" bots
BrowserMatchNoCase "WinInet" bots
BrowserMatchNoCase "WISENutbot" bots
BrowserMatchNoCase "woobot" bots
BrowserMatchNoCase "woopingbot" bots
BrowserMatchNoCase "worldwebheritage.org" bots
BrowserMatchNoCase "Wotbox" bots
BrowserMatchNoCase "WPScan" bots
BrowserMatchNoCase "WWW-Collector-E" bots
BrowserMatchNoCase "WWW-Mechanize" bots
BrowserMatchNoCase "WWWOFFLE" bots
BrowserMatchNoCase "Xaldon" bots
BrowserMatchNoCase "Xaldon WebSpider" bots
BrowserMatchNoCase "Xenu" bots
BrowserMatchNoCase "XoviBot" bots
BrowserMatchNoCase "yacybot" bots
BrowserMatchNoCase "Yandex" bots
BrowserMatchNoCase "YandexBot" bots
BrowserMatchNoCase "YisouSpider" bots
BrowserMatchNoCase "Zade" bots
BrowserMatchNoCase "zermelo" bots
BrowserMatchNoCase "Zeus" bots
BrowserMatchNoCase "zh-CN" bots
BrowserMatchNoCase "ZmEu" bots
BrowserMatchNoCase "ZumBot" bots
BrowserMatchNoCase "Zyborg" bots
BrowserMatchNoCase "ZyBorg" bots
<Directory /usr/local/vufind/public/ >
...
Deny from env=bots
...
</Directory>
<Directory /usr/local/vufind/... >
...
Deny from env=bots
...
</Directory>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment