Skip to content

Instantly share code, notes, and snippets.

@miztiik
Last active March 3, 2021 04:16
Show Gist options
  • Save miztiik/80a057be292e1e88b7095b3e5a014b74 to your computer and use it in GitHub Desktop.
Save miztiik/80a057be292e1e88b7095b3e5a014b74 to your computer and use it in GitHub Desktop.
Installing scrapy in CentOS
# Install deltarpm to reduce the size of download
yum install -y deltarpm \
&& yum install -y python-pip \
&& pip install --upgrade pip
# Scrapy Pre-Requisites
yum install -y gcc libffi-devel python-devel openssl-devel
yum install -y libxslt-devel libxml++-devel libxml2-devel
pip install lxml incremental
# Install Scrapy
pip install scrapy
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment