Skip to content

Instantly share code, notes, and snippets.

@alvnfaiz

alvnfaiz/gist:1ef307f7c66f3b995a784c671b37bde1

Forked from chrisle/gist:2252209
Created August 15, 2019 17:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save alvnfaiz/1ef307f7c66f3b995a784c671b37bde1 to your computer and use it in GitHub Desktop.
Save alvnfaiz/1ef307f7c66f3b995a784c671b37bde1 to your computer and use it in GitHub Desktop.
Download ZIP
CURL as GoogleBot 2.1
Raw
gistfile1.txt
curl --user-agent "Googlebot/2.1 (+http://www.google.com/bot.html)" -v $@
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment