Skip to content

Instantly share code, notes, and snippets.

@miztiik

miztiik/python-scrapy-install-centos.sh

Last active March 3, 2021 04:16
Show Gist options
  • Star 7 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save miztiik/80a057be292e1e88b7095b3e5a014b74 to your computer and use it in GitHub Desktop.
Save miztiik/80a057be292e1e88b7095b3e5a014b74 to your computer and use it in GitHub Desktop.
Download ZIP
Installing scrapy in CentOS
Raw
python-scrapy-install-centos.sh
# Install deltarpm to reduce the size of download
yum install -y deltarpm \
&& yum install -y python-pip \
&& pip install --upgrade pip
# Scrapy Pre-Requisites
yum install -y gcc libffi-devel python-devel openssl-devel
yum install -y libxslt-devel libxml++-devel libxml2-devel
pip install lxml incremental
# Install Scrapy
pip install scrapy
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment