Skip to content

Instantly share code, notes, and snippets.

@crookm

crookm/TwitterLinkBots.txt

Last active February 6, 2018 09:49
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save crookm/0180a16e979806a7582805bff1be8d1e to your computer and use it in GitHub Desktop.
Save crookm/0180a16e979806a7582805bff1be8d1e to your computer and use it in GitHub Desktop.
Download ZIP
A few of the first bots to access a link on Twitter
Raw
TwitterLinkBots.txt
Timestamp IPv6 Country UserAgent
2017-07-21 07:51:34.473 0x00000000000000000000FFFFC39AD99A FR Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.21 (KHTML, like Gecko) wpif Safari/537.21
2017-07-21 07:30:43.570 0x00000000000000000000FFFF1760D089 US Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; Trident/6.0)
2017-07-21 07:13:19.950 0x00000000000000000000FFFF6D44A64C BE NULL
2017-07-21 07:10:54.773 0x00000000000000000000FFFF25BBA2B8 FR Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)
2017-07-21 07:10:15.083 0x00000000000000000000FFFF586340D6 DE Mozilla/5.0 (compatible; um-LN/1.0; mailto: techinfo@ubermetrics-technologies.com)
2017-07-21 07:09:59.693 0x00000000000000000000FFFF481E0E51 US Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
2017-07-21 07:09:23.240 0x00000000000000000000FFFF904C17E3 DE Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.6) Gecko/20050321 Firefox/1.0.2
2017-07-21 07:09:09.380 0x00000000000000000000FFFF481E0E51 US Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
2017-07-21 07:09:09.160 0x00000000000000000000FFFF481E0E51 US Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
2017-07-21 07:09:09.083 0x00000000000000000000FFFF3415AD10 US Mozilla/5.0 (BlackBerry; U; BlackBerry 9800; en-US) AppleWebKit/534.8+ (KHTML, like Gecko) Version/6.0.0.701 Mobile Safari/534.8+
2017-07-21 07:09:08.897 0x00000000000000000000FFFF1716C48B US help@dataminr.com
2017-07-21 07:09:08.833 0x00000000000000000000FFFF369E73DE US help@dataminr.com
2017-07-21 07:09:08.770 0x200141D000026B4B0000000000000001 FR Ruby
2017-07-21 07:09:08.647 0x00000000000000000000FFFF33FE26B4 FR Apache-HttpClient/4.5.2 (Java/1.8.0_121)
2017-07-21 07:09:08.613 0x00000000000000000000FFFFCD90AB7B US facebookexternalhit
2017-07-21 07:09:08.083 0x00000000000000000000FFFF118E9A24 US Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1; +http://www.apple.com/go/applebot)
2017-07-21 07:09:07.630 0x00000000000000000000FFFFC73B96B7 US Twitterbot/1.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment