Skip to content

Instantly share code, notes, and snippets.

@ivanliu
Last active January 28, 2018 07:11
Show Gist options
  • Save ivanliu/ec98f91ef069039c33bce569178c808f to your computer and use it in GitHub Desktop.
Save ivanliu/ec98f91ef069039c33bce569178c808f to your computer and use it in GitHub Desktop.
How to scrapy website
1. Spynner
https://github.com/makinacorpus/spynner
a) Install libpng
http://ethan.tira-thompson.com/Mac_OS_X_Ports.html
b)
2. Mechanize
http://www.pythonforbeginners.com/mechanize/browsing-in-python-with-mechanize/
http://www.pythonforbeginners.com/cheatsheet/python-mechanize-cheat-sheet
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment