Skip to content

Instantly share code, notes, and snippets.

@arzola
Forked from chrisle/gist:2252209
Created February 11, 2017 20:17
Show Gist options
  • Save arzola/7fd49d153f2837c0313e3c50c655d304 to your computer and use it in GitHub Desktop.
Save arzola/7fd49d153f2837c0313e3c50c655d304 to your computer and use it in GitHub Desktop.
CURL as GoogleBot 2.1
curl --user-agent "Googlebot/2.1 (+http://www.google.com/bot.html)" -v $@
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment