1 installing scrapy

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

C:\Windows\system32>easy_install -U Scrapy
Searching for Scrapy
Reading http://pypi.python.org/simple/Scrapy/
Reading http://scrapy.org
Best match: scrapy 0.14.4
Processing scrapy-0.14.4-py2.7.egg
scrapy 0.14.4 is already the active version in easy-install.pth
Installing scrapy script to C:\Python27\Scripts
Installing scrapy.bat script to C:\Python27\Scripts

Using c:\python27\lib\site-packages\scrapy-0.14.4-py2.7.egg
Processing dependencies for Scrapy
Searching for lxml
Reading http://pypi.python.org/simple/lxml/
Reading http://codespeak.net/lxml
Best match: lxml 2.3.4
Downloading http://lxml.de/files/lxml-2.3.4.tgz
Processing lxml-2.3.4.tgz
Running lxml-2.3.4\setup.py -q bdist_egg --dist-dir c:\users\wizek-lt\appdata\lo
cal\temp\easy_install-jg4cit\lxml-2.3.4\egg-dist-tmp-n_icjn
Building lxml version 2.3.4.
Building without Cython.
ERROR: 'xslt-config' is not recognized as an internal or external command,
operable program or batch file.

** make sure the development packages of libxml2 and libxslt are installed **

Using build configuration of libxslt
warning: no files found matching 'lxml.etree.c' under directory 'src\lxml'
warning: no files found matching 'lxml.objectify.c' under directory 'src\lxml'
warning: no files found matching 'lxml.etree.h' under directory 'src\lxml'
warning: no files found matching 'lxml.etree_api.h' under directory 'src\lxml'
warning: no files found matching 'etree_defs.h' under directory 'src\lxml'
warning: no files found matching 'pubkey.asc' under directory 'doc'
warning: no files found matching 'tagpython*.png' under directory 'doc'
warning: no files found matching 'Makefile' under directory 'doc'
cl : Command line warning D9025 : overriding '/W3' with '/w'
lxml.etree.c
c:\users\wizek-lt\appdata\local\temp\easy_install-jg4cit\lxml-2.3.4\src\lxml\etr
ee_defs.h(9) : fatal error C1083: Cannot open include file: 'libxml/xmlversion.h
': No such file or directory
error: Setup script exited with error: command '"c:\Program Files (x86)\Microsof
t Visual Studio 9.0\VC\BIN\cl.exe"' failed with exit status 2

C:\Windows\system32>scrapy
Traceback (most recent call last):
  File "C:\Python27\Scripts\scrapy", line 4, in <module>
    import pkg_resources
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 2603, in <module>
    working_set.require(__requires__)
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 666, in require
    needed = self.resolve(parse_requirements(requirements))
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 565, in resolve
    raise DistributionNotFound(req)  # XXX put more info here
pkg_resources.DistributionNotFound: lxml

C:\Windows\system32>

2 installing lxml

C:\Windows\system32>easy_install -U lxml
Searching for lxml
Reading http://pypi.python.org/simple/lxml/
Reading http://codespeak.net/lxml
Best match: lxml 2.3.4
Downloading http://lxml.de/files/lxml-2.3.4.tgz
Processing lxml-2.3.4.tgz
Running lxml-2.3.4\setup.py -q bdist_egg --dist-dir c:\users\wizek-lt\appdata\lo
cal\temp\easy_install-gnkipe\lxml-2.3.4\egg-dist-tmp-gb0d2t
Building lxml version 2.3.4.
Building without Cython.
ERROR: 'xslt-config' is not recognized as an internal or external command,
operable program or batch file.

** make sure the development packages of libxml2 and libxslt are installed **

Using build configuration of libxslt
warning: no files found matching 'lxml.etree.c' under directory 'src\lxml'
warning: no files found matching 'lxml.objectify.c' under directory 'src\lxml'
warning: no files found matching 'lxml.etree.h' under directory 'src\lxml'
warning: no files found matching 'lxml.etree_api.h' under directory 'src\lxml'
warning: no files found matching 'etree_defs.h' under directory 'src\lxml'
warning: no files found matching 'pubkey.asc' under directory 'doc'
warning: no files found matching 'tagpython*.png' under directory 'doc'
warning: no files found matching 'Makefile' under directory 'doc'
cl : Command line warning D9025 : overriding '/W3' with '/w'
lxml.etree.c
c:\users\wizek-lt\appdata\local\temp\easy_install-gnkipe\lxml-2.3.4\src\lxml\etr
ee_defs.h(9) : fatal error C1083: Cannot open include file: 'libxml/xmlversion.h
': No such file or directory
error: Setup script exited with error: command '"c:\Program Files (x86)\Microsof
t Visual Studio 9.0\VC\BIN\cl.exe"' failed with exit status 2

3 with pip

C:\Windows\system32>easy_install pip
Searching for pip
Reading http://pypi.python.org/simple/pip/
Reading http://pip.openplans.org
Reading http://www.pip-installer.org
Best match: pip 1.1
Downloading http://pypi.python.org/packages/source/p/pip/pip-1.1.tar.gz#md5=62a9
f08dd5dc69d76734568a6c040508
Processing pip-1.1.tar.gz
Running pip-1.1\setup.py -q bdist_egg --dist-dir c:\users\wizek-lt\appdata\local
\temp\easy_install-xk1pdq\pip-1.1\egg-dist-tmp-sg3wne
warning: no files found matching '*.html' under directory 'docs'
warning: no previously-included files matching '*.txt' found under directory 'do
cs\_build'
no previously-included directories found matching 'docs\_build\_sources'
Adding pip 1.1 to easy-install.pth file
Installing pip-script.py script to C:\Python27\Scripts
Installing pip.exe script to C:\Python27\Scripts
Installing pip.exe.manifest script to C:\Python27\Scripts
Installing pip-2.7-script.py script to C:\Python27\Scripts
Installing pip-2.7.exe script to C:\Python27\Scripts
Installing pip-2.7.exe.manifest script to C:\Python27\Scripts

Installed c:\python27\lib\site-packages\pip-1.1-py2.7.egg
Processing dependencies for pip
Finished processing dependencies for pip

C:\Windows\system32>pip
Usage: pip-script.py COMMAND [OPTIONS]

pip-script.py: error: You must give a command (use "pip help" to see a list of c
ommands)

C:\Windows\system32>pip install Scrapy
Requirement already satisfied (use --upgrade to upgrade): Scrapy in c:\python27\
lib\site-packages\scrapy-0.14.4-py2.7.egg
Downloading/unpacking Twisted>=2.5 (from Scrapy)
  Downloading Twisted-12.0.0.tar.bz2 (2.8Mb): 2.8Mb downloaded
  Running setup.py egg_info for package Twisted

Downloading/unpacking w3lib (from Scrapy)
  Downloading w3lib-1.2.tar.gz
  Running setup.py egg_info for package w3lib

Downloading/unpacking pyOpenSSL (from Scrapy)
  Downloading pyOpenSSL-0.13.tar.gz (250Kb): 250Kb downloaded
  Running setup.py egg_info for package pyOpenSSL

    error: Only found improper OpenSSL directories: ['C:\\Program Files (x86)\\g
it']
    Complete output from command python setup.py egg_info:
    running egg_info

creating pip-egg-info\pyOpenSSL.egg-info

writing pip-egg-info\pyOpenSSL.egg-info\PKG-INFO

writing top-level names to pip-egg-info\pyOpenSSL.egg-info\top_level.txt

writing dependency_links to pip-egg-info\pyOpenSSL.egg-info\dependency_links.txt


writing manifest file 'pip-egg-info\pyOpenSSL.egg-info\SOURCES.txt'

warning: manifest_maker: standard file '-c' not found



error: Only found improper OpenSSL directories: ['C:\\Program Files (x86)\\git']


----------------------------------------
Command python setup.py egg_info failed with error code 1 in C:\Windows\system32
\build\pyOpenSSL
Storing complete log in C:\Users\Wizek-LT\AppData\Roaming\pip\pip.log

C:\Windows\system32>scrapy
Traceback (most recent call last):
  File "C:\Python27\Scripts\scrapy", line 4, in <module>
    import pkg_resources
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 2603, in <module>
    working_set.require(__requires__)
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 666, in require
    needed = self.resolve(parse_requirements(requirements))
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 565, in resolve
    raise DistributionNotFound(req)  # XXX put more info here
pkg_resources.DistributionNotFound: lxml

4 so close

C:\Users\Wizek-LT>pip install scrapy
Requirement already satisfied (use --upgrade to upgrade): scrapy in c:\python27\
lib\site-packages\scrapy-0.14.4-py2.7.egg
Requirement already satisfied (use --upgrade to upgrade): Twisted>=2.5 in c:\pyt
hon27\lib\site-packages (from scrapy)
Requirement already satisfied (use --upgrade to upgrade): w3lib in c:\python27\l
ib\site-packages (from scrapy)
Requirement already satisfied (use --upgrade to upgrade): pyOpenSSL in c:\python
27\lib\site-packages (from scrapy)
Downloading/unpacking lxml (from scrapy)
  Running setup.py egg_info for package lxml
    Building lxml version 2.3.4.
    Building without Cython.
    ERROR: 'xslt-config' is not recognized as an internal or external command,
    operable program or batch file.

    ** make sure the development packages of libxml2 and libxslt are installed *
*

    Using build configuration of libxslt

    warning: no files found matching 'lxml.etree.c' under directory 'src\lxml'
    warning: no files found matching 'lxml.objectify.c' under directory 'src\lxm
l'
    warning: no files found matching 'lxml.etree.h' under directory 'src\lxml'
    warning: no files found matching 'lxml.etree_api.h' under directory 'src\lxm
l'
    warning: no files found matching 'etree_defs.h' under directory 'src\lxml'
    warning: no files found matching 'pubkey.asc' under directory 'doc'
    warning: no files found matching 'tagpython*.png' under directory 'doc'
    warning: no files found matching 'Makefile' under directory 'doc'
Downloading/unpacking zope.interface (from Twisted>=2.5->scrapy)
  Running setup.py egg_info for package zope.interface

Requirement already satisfied (use --upgrade to upgrade): setuptools in c:\pytho
n27\lib\site-packages (from zope.interface->Twisted>=2.5->scrapy)
Installing collected packages: lxml, zope.interface
  Running setup.py install for lxml
    Building lxml version 2.3.4.
    Building without Cython.
    ERROR: 'xslt-config' is not recognized as an internal or external command,
    operable program or batch file.

    ** make sure the development packages of libxml2 and libxslt are installed *
*

    Using build configuration of libxslt
    building 'lxml.etree' extension
    c:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\BIN\cl.exe /c /nologo
/Ox /MD /W3 /GS- /DNDEBUG -IC:\Python27\include -IC:\Python27\PC /Tcsrc/lxml/lxm
l.etree.c /Fobuild\temp.win32-2.7\Release\src/lxml/lxml.etree.obj -w
    cl : Command line warning D9025 : overriding '/W3' with '/w'
    lxml.etree.c
    c:\users\wizek-lt\build\lxml\src\lxml\etree_defs.h(9) : fatal error C1083: C
annot open include file: 'libxml/xmlversion.h': No such file or directory
    error: command '"c:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\BIN\c
l.exe"' failed with exit status 2
    Complete output from command C:\Python27\python.exe -c "import setuptools;__
file__='C:\\Users\\Wizek-LT\\build\\lxml\\setup.py';exec(compile(open(__file__).
read().replace('\r\n', '\n'), __file__, 'exec'))" install --single-version-exter
nally-managed --record c:\users\wizek-lt\appdata\local\temp\pip-ghy56o-record\in
stall-record.txt:
    Building lxml version 2.3.4.

Building without Cython.

ERROR: 'xslt-config' is not recognized as an internal or external command,

operable program or batch file.



** make sure the development packages of libxml2 and libxslt are installed **



Using build configuration of libxslt

running install

running build

running build_py

copying src\lxml\builder.py -> build\lib.win32-2.7\lxml

copying src\lxml\cssselect.py -> build\lib.win32-2.7\lxml

copying src\lxml\doctestcompare.py -> build\lib.win32-2.7\lxml

copying src\lxml\ElementInclude.py -> build\lib.win32-2.7\lxml

copying src\lxml\pyclasslookup.py -> build\lib.win32-2.7\lxml

copying src\lxml\sax.py -> build\lib.win32-2.7\lxml

copying src\lxml\usedoctest.py -> build\lib.win32-2.7\lxml

copying src\lxml\_elementpath.py -> build\lib.win32-2.7\lxml

copying src\lxml\__init__.py -> build\lib.win32-2.7\lxml

copying src\lxml\html\builder.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\clean.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\defs.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\diff.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\ElementSoup.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\formfill.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\html5parser.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\soupparser.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\usedoctest.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\_dictmixin.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\_diffcommand.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\_html5builder.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\_setmixin.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\html\__init__.py -> build\lib.win32-2.7\lxml\html

copying src\lxml\isoschematron\__init__.py -> build\lib.win32-2.7\lxml\isoschema
tron

copying src\lxml\etreepublic.pxd -> build\lib.win32-2.7\lxml

copying src\lxml\tree.pxd -> build\lib.win32-2.7\lxml

copying src\lxml\etree_defs.h -> build\lib.win32-2.7\lxml

copying src\lxml\isoschematron\resources\rng\iso-schematron.rng -> build\lib.win
32-2.7\lxml\isoschematron\resources\rng

copying src\lxml\isoschematron\resources\xsl\RNG2Schtrn.xsl -> build\lib.win32-2
.7\lxml\isoschematron\resources\xsl

copying src\lxml\isoschematron\resources\xsl\XSD2Schtrn.xsl -> build\lib.win32-2
.7\lxml\isoschematron\resources\xsl

copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_abstract_e
xpand.xsl -> build\lib.win32-2.7\lxml\isoschematron\resources\xsl\iso-schematron
-xslt1

copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_dsdl_inclu
de.xsl -> build\lib.win32-2.7\lxml\isoschematron\resources\xsl\iso-schematron-xs
lt1

copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_schematron
_message.xsl -> build\lib.win32-2.7\lxml\isoschematron\resources\xsl\iso-schemat
ron-xslt1

copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_schematron
_skeleton_for_xslt1.xsl -> build\lib.win32-2.7\lxml\isoschematron\resources\xsl\
iso-schematron-xslt1

copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\iso_svrl_for_x
slt1.xsl -> build\lib.win32-2.7\lxml\isoschematron\resources\xsl\iso-schematron-
xslt1

copying src\lxml\isoschematron\resources\xsl\iso-schematron-xslt1\readme.txt ->
build\lib.win32-2.7\lxml\isoschematron\resources\xsl\iso-schematron-xslt1

running build_ext

building 'lxml.etree' extension

c:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\BIN\cl.exe /c /nologo /Ox
/MD /W3 /GS- /DNDEBUG -IC:\Python27\include -IC:\Python27\PC /Tcsrc/lxml/lxml.et
ree.c /Fobuild\temp.win32-2.7\Release\src/lxml/lxml.etree.obj -w

cl : Command line warning D9025 : overriding '/W3' with '/w'

lxml.etree.c

c:\users\wizek-lt\build\lxml\src\lxml\etree_defs.h(9) : fatal error C1083: Canno
t open include file: 'libxml/xmlversion.h': No such file or directory

error: command '"c:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\BIN\cl.ex
e"' failed with exit status 2

----------------------------------------
Command C:\Python27\python.exe -c "import setuptools;__file__='C:\\Users\\Wizek-
LT\\build\\lxml\\setup.py';exec(compile(open(__file__).read().replace('\r\n', '\
n'), __file__, 'exec'))" install --single-version-externally-managed --record c:
\users\wizek-lt\appdata\local\temp\pip-ghy56o-record\install-record.txt failed w
ith error code 1 in C:\Users\Wizek-LT\build\lxml
Storing complete log in C:\Users\Wizek-LT\AppData\Roaming\pip\pip.log

C:\Users\Wizek-LT>scrapy
Traceback (most recent call last):
  File "C:\Python27\Scripts\scrapy", line 4, in <module>
    import pkg_resources
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 2603, in <module>
    working_set.require(__requires__)
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 666, in require
    needed = self.resolve(parse_requirements(requirements))
  File "C:\Python27\lib\site-packages\pkg_resources.py", line 565, in resolve
    raise DistributionNotFound(req)  # XXX put more info here
pkg_resources.DistributionNotFound: lxml

C:\Users\Wizek-LT>