Skip to content

Instantly share code, notes, and snippets.

@cbzehner
Created March 19, 2018 20:08
Show Gist options
  • Save cbzehner/0ada6d69499007a89f273e299a7f8883 to your computer and use it in GitHub Desktop.
Save cbzehner/0ada6d69499007a89f273e299a7f8883 to your computer and use it in GitHub Desktop.
Ones where I could find T&C:
https://www.octoparse.com/terms-and-conditions
https://dexi.io/terms
https://www.screamingfrog.co.uk/seo-spider/terms-conditions/
https://www.import.io/terms-conditions/ (<-- They also have a GDPR section, might be interesting)
https://www.incapsula.com/terms-of-use.html
Others: You can try searching google with `site:<website> Terms` to only search a specific site for pages that have "Terms" somewhere on the site.
http://webscraper.io/
https://scrapy.org/
Here's a list of more scrapers: http://scraping.pro/software-for-web-scraping/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment