Skip to content

Instantly share code, notes, and snippets.

@immunda
Last active August 29, 2015 14:26
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save immunda/729118c9a3440e63b281 to your computer and use it in GitHub Desktop.
Save immunda/729118c9a3440e63b281 to your computer and use it in GitHub Desktop.
Scrapy Dockerfile
FROM debian:wheezy
MAINTAINER Phil Howell
RUN apt-get update && apt-get upgrade -y && apt-get install -y git python-pip python-dev build-essential libssl-dev libffi-dev libxslt-dev
COPY requirements.txt /tmp/requirements.txt
RUN pip install -r /tmp/requirements.txt
RUN mkdir /projects
ADD . /spiders
WORKDIR /spiders
ENTRYPOINT ["scrapy", "crawl"]
bleach==1.4.1
html5lib==1.0b3
Scrapy==0.24.4
Twisted==14.0.0
cffi==0.8.6
cryptography==0.5.4
cssselect==0.9.1
lxml==3.4.0
pyOpenSSL==0.14
pycparser==2.10
queuelib==1.2.2
requests==2.4.3
six==1.8.0
w3lib==1.10.0
wsgiref==0.1.2
zope.interface==4.1.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment