Skip to content

Instantly share code, notes, and snippets.

@AglaianWoman
Forked from ivanliu/website_scrapy_options
Created January 28, 2018 07:11
Show Gist options
  • Save AglaianWoman/8fe42020196cdfdf8d0c33a41a271316 to your computer and use it in GitHub Desktop.
Save AglaianWoman/8fe42020196cdfdf8d0c33a41a271316 to your computer and use it in GitHub Desktop.
How to scrapy website
1. Spynner
https://github.com/makinacorpus/spynner
a) Install libpng
http://ethan.tira-thompson.com/Mac_OS_X_Ports.html
b)
2. Mechanize
http://www.pythonforbeginners.com/mechanize/browsing-in-python-with-mechanize/
http://www.pythonforbeginners.com/cheatsheet/python-mechanize-cheat-sheet
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment