Skip to content

Instantly share code, notes, and snippets.

@googleanalyticsresoneo

googleanalyticsresoneo/networks hosting crawlers.html

Last active November 15, 2016 16:50
Show Gist options
  • Star 2 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save googleanalyticsresoneo/6306509 to your computer and use it in GitHub Desktop.
Save googleanalyticsresoneo/6306509 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
networks hosting crawlers.html
<!-- Regexp to recognize fake trafic from JS enabled crawlers
For use in Google Analytics **Filters** on the "ISP Organization" field, corresponding dimension in reporting is "Service Provider"
This lists fits within the 255 characters limit (!doesn't any more, to be optimized) of the filter field if you want to have a Profile/View that will include only that traffic
Most crawlers have Java disabled
You can also disable logging the activity of web monitoring services through a test on user-agent string, see https://gist.github.com/googleanalyticsresoneo/964266
-->
inktomi|google i|yahoo! i|amazon|ec2|facebook i|microsoft co|server|qwest c|eircom|host(ing|ed)|data ?(service|center)|cloud|limelight|ip.?label|kaspersky|^internet services$|2 rue amelo|c2-reseaux|(dedibox|online) s|iliad|ng distanc|colt tech|dnsslave|ovh (sys|sas|static)|obs cust|digital o|vodafone isp
@nicholasblexrud
Copy link

Good stuff, Olivier!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment