Skip to content

Instantly share code, notes, and snippets.

Avatar

Mert Yazıcıoğlu merty

View GitHub Profile
@merty
merty / filter-googlebot-ips.sh
Last active Nov 8, 2019
Performs reverse and forward DNS lookups to list Googlebot's IPs, given a list of IP addresses as a file. Useful for filtering access logs to find out actual Googlebot visits. An implementation of https://support.google.com/webmasters/answer/80553?hl=en
View filter-googlebot-ips.sh
#/bin/bash
#
# Performs reverse and forward DNS lookups to list Googlebot's IPs, given a list
# of IP addresses as a file. Useful for filtering access logs to find out actual
# Googlebot visits.
#
# An implementation of https://support.google.com/webmasters/answer/80553?hl=en
while IFS='' read -r IP_ADDRESS || [[ -n "$IP_ADDRESS" ]];
do
You can’t perform that action at this time.