Skip to content

Instantly share code, notes, and snippets.

@dr-dimitru
Last active October 6, 2018 18:57
Show Gist options
  • Save dr-dimitru/69c1dc10c12a57822b1404c15e765036 to your computer and use it in GitHub Desktop.
Save dr-dimitru/69c1dc10c12a57822b1404c15e765036 to your computer and use it in GitHub Desktop.
Query website as GoogleBot using curl
# As default browser:
curl http://example.com
# As GoogleBot:
curl -A GoogleBot http://example.com
# As GoogleBot (old/deprecated) style:
curl -A GoogleBot http://example.com?_escaped_fragment_=
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment