Skip to content

Instantly share code, notes, and snippets.

Created March 30, 2012 15:15
What would you like to do?
CURL as GoogleBot 2.1
curl --user-agent "Googlebot/2.1 (+" -v $@
Copy link


Copy link

zabaala commented Jul 30, 2018


Copy link


Copy link

Nice! Thanks

Copy link

Blumed commented Dec 10, 2020

This is using desktop and Google is moving toward mobile first. May want to update this. Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z‡ Mobile Safari/537.36 (compatible; Googlebot/2.1; +

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment