Skip to content

Instantly share code, notes, and snippets.

@ashsmith

ashsmith/gist:524d176eaf48bfd87aab

Created February 18, 2015 16:55
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ashsmith/524d176eaf48bfd87aab to your computer and use it in GitHub Desktop.
Save ashsmith/524d176eaf48bfd87aab to your computer and use it in GitHub Desktop.
Download ZIP
Fake your user agent to look like Googlebot.
Raw
gistfile1.sh
curl -A "'Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)')" http://MYDOMAIN.COM/ --head
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment