Skip to content

Instantly share code, notes, and snippets.

@Paratron

Paratron/agents.md

Last active February 26, 2024 12:28
Show Gist options
  • Star 10 You must be signed in to star a gist
  • Fork 2 You must be signed in to fork a gist
  • Save Paratron/8676518 to your computer and use it in GitHub Desktop.
Save Paratron/8676518 to your computer and use it in GitHub Desktop.
Download ZIP
Social Network Crawler User Agents
Raw
agents.md

#Social Network Crawler User Agents Users can post URLs on a lot of different platforms nowadays. Most of those platforms will send a request to that URL to generate some preview data from it.

These are a couple of user agents I quickly tested out.

##Facebook

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

##Google+

Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google (+https://developers.google.com/+/web/snippet/)

##Xing

XING-contenttabreceiver/2.0

##LinkedIn

LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)

##Delicious

Java/1.7.0_45
@philbenoit-ibsa
Copy link

philbenoit-ibsa commented Jan 13, 2018 •
edited

Also Twitterbot/1.0

https://developer.twitter.com/en/docs/tweets/optimize-with-cards/guides/getting-started#crawling

@joaquinco
Copy link

For skype

"Mozilla/5.0 (Windows NT 6.1; WOW64) SkypeUriPreview Preview/0.5"

Didn't find documentation but I saw it on server logs when sharing through skype.

@BistroStu
Copy link

Microsoft Teams uses this one.

For skype

"Mozilla/5.0 (Windows NT 6.1; WOW64) SkypeUriPreview Preview/0.5"

Didn't find documentation but I saw it on server logs when sharing through skype.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment