Skip to content

Instantly share code, notes, and snippets.

@khunreus

khunreus/install_modules_start_scrapy_project.txt

Last active February 9, 2019 14:10
Show Gist options
  • Save khunreus/3274a24095c6a16aafcdc1d45753d995 to your computer and use it in GitHub Desktop.
Save khunreus/3274a24095c6a16aafcdc1d45753d995 to your computer and use it in GitHub Desktop.
Download ZIP
airbnb scraping sample
Raw
install_modules_start_scrapy_project.txt
#Command line
pip install scrapy
pip install selenium
#cd your/desired/project/path/
scrapy startproject airbnb #will create a project "airbnb" in the folder you are in
cd airbnb/ #need to cd to a folder with a scrapy.cfg file
#this is the test address to kick off the project
#homes.py created in airbnb/airbnb/spiders/
scrapy genspider homes 'https://www.airbnb.ae'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment