Created
June 17, 2016 10:44
-
-
Save redapple/a3323f13a83f5630f2003f964d4432c5 to your computer and use it in GitHub Desktop.
Installing scrapy 1.1 with Python 2 on Ubuntu 16:04, installing system dependencies and using pip in user scheme
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# -- Step 1: build the docker image | |
# file "Dockerfile" is in current folder | |
# it adds a "scrapyuser" user with password "scrapypwd" | |
paul@paul:~/dockerfiles/ubuntu16.04.desktop$ sudo docker build -t redapple/scrapy-ubuntu-trusty-user . | |
[sudo] Mot de passe de paul : | |
Sending build context to Docker daemon 2.048 kB | |
Step 1 : FROM ubuntu:16.04 | |
---> 2fa927b5cdd3 | |
Step 2 : RUN apt-get update | |
---> Using cache | |
---> 261691681933 | |
Step 3 : RUN apt-get -y install sudo | |
---> Using cache | |
---> 7d495968f153 | |
Step 4 : RUN useradd -m scrapyuser && echo "scrapyuser:scrapypwd" | chpasswd && adduser scrapyuser sudo | |
---> Running in 04ff2a0bc33d | |
Adding user `scrapyuser' to group `sudo' ... | |
Adding user scrapyuser to group sudo | |
Done. | |
---> eb4e08ad2219 | |
Removing intermediate container 04ff2a0bc33d | |
Step 5 : USER scrapyuser | |
---> Running in 6c04224eb517 | |
---> bc9e74a03e49 | |
Removing intermediate container 6c04224eb517 | |
Step 6 : CMD /bin/bash | |
---> Running in 47e102beb910 | |
---> 23451ef8cef5 | |
Removing intermediate container 47e102beb910 | |
Successfully built 23451ef8cef5 | |
# --- Step 2: run the image | |
# the image has one user "scrapyuser" with password "scrapypwd" | |
paul@paul:~/dockerfiles/ubuntu16.04.desktop$ sudo docker run -t -i redapple/scrapy-ubuntu-trusty-user | |
To run a command as administrator (user "root"), use "sudo <command>". | |
See "man sudo_root" for details. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# adapted from http://stackoverflow.com/questions/25845538/using-sudo-inside-a-docker-container | |
FROM ubuntu:16.04 | |
RUN apt-get update | |
RUN apt-get -y install sudo | |
RUN useradd -m scrapyuser && echo "scrapyuser:scrapypwd" | chpasswd && adduser scrapyuser sudo | |
USER scrapyuser | |
CMD /bin/bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# install the dependencies system-wide (e.g. with "sudo apt-get install") | |
scrapyuser@2b8589177842:/$ sudo apt-get install python3 python-dev python3-dev \ | |
> build-essential libssl-dev libffi-dev \ | |
> libxml2-dev libxslt-dev \ | |
> python-pip | |
[sudo] password for scrapyuser: | |
Reading package lists... Done | |
Building dependency tree | |
Reading state information... Done | |
Note, selecting 'libxslt1-dev' instead of 'libxslt-dev' | |
The following additional packages will be installed: | |
binutils bzip2 ca-certificates cpp cpp-5 dh-python dpkg-dev fakeroot file g++ g++-5 gcc gcc-5 gcc-5-base icu-devtools ifupdown iproute2 isc-dhcp-client isc-dhcp-common libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl libasan2 libatm1 | |
libatomic1 libc-dev-bin libc6-dev libcc1-0 libcilkrts5 libdns-export162 libdpkg-perl libexpat1 libexpat1-dev libfakeroot libffi6 libfile-fcntllock-perl libgcc-5-dev libgdbm3 libgmp10 libgomp1 libicu-dev libicu55 libisc-export160 libisl15 libitm1 liblsan0 libmagic1 | |
libmnl0 libmpc3 libmpdec2 libmpfr4 libmpx0 libperl5.22 libpython-all-dev libpython-dev libpython-stdlib libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib libpython3-dev libpython3-stdlib libpython3.5 libpython3.5-dev libpython3.5-minimal | |
libpython3.5-stdlib libquadmath0 libsqlite3-0 libssl-doc libssl1.0.0 libstdc++-5-dev libstdc++6 libtsan0 libubsan0 libxml2 libxslt1.1 libxtables11 linux-libc-dev make manpages manpages-dev mime-support netbase openssl patch perl perl-modules-5.22 python python-all | |
python-all-dev python-minimal python-pip-whl python-pkg-resources python-setuptools python-wheel python2.7 python2.7-dev python2.7-minimal python3-minimal python3.5 python3.5-dev python3.5-minimal rename sgml-base xml-core xz-utils zlib1g-dev | |
Suggested packages: | |
binutils-doc bzip2-doc cpp-doc gcc-5-locales debian-keyring g++-multilib g++-5-multilib gcc-5-doc libstdc++6-5-dbg gcc-multilib autoconf automake libtool flex bison gdb gcc-doc gcc-5-multilib libgcc1-dbg libgomp1-dbg libitm1-dbg libatomic1-dbg libasan2-dbg | |
liblsan0-dbg libtsan0-dbg libubsan0-dbg libcilkrts5-dbg libmpx0-dbg libquadmath0-dbg ppp rdnssd iproute2-doc resolvconf avahi-autoipd isc-dhcp-client-ddns apparmor glibc-doc icu-doc libstdc++-5-doc pkg-config make-doc man-browser ed diffutils-doc perl-doc | |
libterm-readline-gnu-perl | libterm-readline-perl-perl python-doc python-tk python-setuptools-doc python2.7-doc binfmt-support python3-doc python3-tk python3-venv python3.5-venv python3.5-doc sgml-base-doc debhelper | |
The following NEW packages will be installed: | |
binutils build-essential bzip2 ca-certificates cpp cpp-5 dh-python dpkg-dev fakeroot file g++ g++-5 gcc gcc-5 icu-devtools ifupdown iproute2 isc-dhcp-client isc-dhcp-common libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl libasan2 libatm1 | |
libatomic1 libc-dev-bin libc6-dev libcc1-0 libcilkrts5 libdns-export162 libdpkg-perl libexpat1 libexpat1-dev libfakeroot libffi-dev libffi6 libfile-fcntllock-perl libgcc-5-dev libgdbm3 libgmp10 libgomp1 libicu-dev libicu55 libisc-export160 libisl15 libitm1 liblsan0 | |
libmagic1 libmnl0 libmpc3 libmpdec2 libmpfr4 libmpx0 libperl5.22 libpython-all-dev libpython-dev libpython-stdlib libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib libpython3-dev libpython3-stdlib libpython3.5 libpython3.5-dev | |
libpython3.5-minimal libpython3.5-stdlib libquadmath0 libsqlite3-0 libssl-dev libssl-doc libssl1.0.0 libstdc++-5-dev libtsan0 libubsan0 libxml2 libxml2-dev libxslt1-dev libxslt1.1 libxtables11 linux-libc-dev make manpages manpages-dev mime-support netbase openssl | |
patch perl perl-modules-5.22 python python-all python-all-dev python-dev python-minimal python-pip python-pip-whl python-pkg-resources python-setuptools python-wheel python2.7 python2.7-dev python2.7-minimal python3 python3-dev python3-minimal python3.5 python3.5-dev | |
python3.5-minimal rename sgml-base xml-core xz-utils zlib1g-dev | |
The following packages will be upgraded: | |
gcc-5-base libstdc++6 | |
2 upgraded, 114 newly installed, 0 to remove and 13 not upgraded. | |
Need to get 151 MB of archives. | |
After this operation, 442 MB of additional disk space will be used. | |
Do you want to continue? [Y/n] y | |
Get:1 http://archive.ubuntu.com/ubuntu xenial/main amd64 libatm1 amd64 1:2.5.1-1.5 [24.2 kB] | |
Get:2 http://archive.ubuntu.com/ubuntu xenial/main amd64 libmnl0 amd64 1.0.3-5 [12.0 kB] | |
Get:3 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libssl1.0.0 amd64 1.0.2g-1ubuntu4.1 [1122 kB] | |
Get:4 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython3.5-minimal amd64 3.5.1-10 [521 kB] | |
Get:5 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libexpat1 amd64 2.1.0-7ubuntu0.16.04.1 [71.2 kB] | |
Get:6 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3.5-minimal amd64 3.5.1-10 [1588 kB] | |
Get:7 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-minimal amd64 3.5.1-3 [23.3 kB] | |
Get:8 http://archive.ubuntu.com/ubuntu xenial/main amd64 mime-support all 3.59ubuntu1 [31.0 kB] | |
Get:9 http://archive.ubuntu.com/ubuntu xenial/main amd64 libffi6 amd64 3.2.1-4 [17.8 kB] | |
Get:10 http://archive.ubuntu.com/ubuntu xenial/main amd64 libmpdec2 amd64 2.4.2-1 [82.6 kB] | |
Get:11 http://archive.ubuntu.com/ubuntu xenial/main amd64 libsqlite3-0 amd64 3.11.0-1ubuntu1 [396 kB] | |
Get:12 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython3.5-stdlib amd64 3.5.1-10 [2117 kB] | |
Get:13 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3.5 amd64 3.5.1-10 [159 kB] | |
Get:14 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython3-stdlib amd64 3.5.1-3 [6818 B] | |
Get:15 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 dh-python all 2.20151103ubuntu1.1 [74.1 kB] | |
Get:16 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3 amd64 3.5.1-3 [8710 B] | |
Get:17 http://archive.ubuntu.com/ubuntu xenial/main amd64 libgdbm3 amd64 1.8.3-13.1 [16.9 kB] | |
Get:18 http://archive.ubuntu.com/ubuntu xenial/main amd64 sgml-base all 1.26+nmu4ubuntu1 [12.5 kB] | |
Get:19 http://archive.ubuntu.com/ubuntu xenial/main amd64 perl-modules-5.22 all 5.22.1-9 [2641 kB] | |
Get:20 http://archive.ubuntu.com/ubuntu xenial/main amd64 libperl5.22 amd64 5.22.1-9 [3371 kB] | |
Get:21 http://archive.ubuntu.com/ubuntu xenial/main amd64 perl amd64 5.22.1-9 [237 kB] | |
Get:22 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython2.7-minimal amd64 2.7.11-7ubuntu1 [335 kB] | |
Get:23 http://archive.ubuntu.com/ubuntu xenial/main amd64 python2.7-minimal amd64 2.7.11-7ubuntu1 [1288 kB] | |
Get:24 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-minimal amd64 2.7.11-1 [28.2 kB] | |
Get:25 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython2.7-stdlib amd64 2.7.11-7ubuntu1 [1852 kB] | |
Get:26 http://archive.ubuntu.com/ubuntu xenial/main amd64 python2.7 amd64 2.7.11-7ubuntu1 [220 kB] | |
Get:27 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython-stdlib amd64 2.7.11-1 [7656 B] | |
Get:28 http://archive.ubuntu.com/ubuntu xenial/main amd64 python amd64 2.7.11-1 [137 kB] | |
Get:29 http://archive.ubuntu.com/ubuntu xenial/main amd64 libgmp10 amd64 2:6.1.0+dfsg-2 [240 kB] | |
Get:30 http://archive.ubuntu.com/ubuntu xenial/main amd64 libmpfr4 amd64 3.1.4-1 [191 kB] | |
Get:31 http://archive.ubuntu.com/ubuntu xenial/main amd64 libmpc3 amd64 1.0.3-1 [39.7 kB] | |
Get:32 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 gcc-5-base amd64 5.3.1-14ubuntu2.1 [16.8 kB] | |
Get:33 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libstdc++6 amd64 5.3.1-14ubuntu2.1 [393 kB] | |
Get:34 http://archive.ubuntu.com/ubuntu xenial/main amd64 bzip2 amd64 1.0.6-8 [32.7 kB] | |
Get:35 http://archive.ubuntu.com/ubuntu xenial/main amd64 libmagic1 amd64 1:5.25-2ubuntu1 [216 kB] | |
Get:36 http://archive.ubuntu.com/ubuntu xenial/main amd64 file amd64 1:5.25-2ubuntu1 [21.2 kB] | |
Get:37 http://archive.ubuntu.com/ubuntu xenial/main amd64 iproute2 amd64 4.3.0-1ubuntu3 [522 kB] | |
Get:38 http://archive.ubuntu.com/ubuntu xenial/main amd64 ifupdown amd64 0.8.10ubuntu1 [54.9 kB] | |
Get:39 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libisc-export160 amd64 1:9.10.3.dfsg.P4-8ubuntu1 [152 kB] | |
Get:40 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libdns-export162 amd64 1:9.10.3.dfsg.P4-8ubuntu1 [665 kB] | |
Get:41 http://archive.ubuntu.com/ubuntu xenial/main amd64 isc-dhcp-client amd64 4.3.3-5ubuntu12 [222 kB] | |
Get:42 http://archive.ubuntu.com/ubuntu xenial/main amd64 isc-dhcp-common amd64 4.3.3-5ubuntu12 [104 kB] | |
Get:43 http://archive.ubuntu.com/ubuntu xenial/main amd64 libxtables11 amd64 1.6.0-2ubuntu3 [27.2 kB] | |
Get:44 http://archive.ubuntu.com/ubuntu xenial/main amd64 netbase all 5.3 [12.9 kB] | |
Get:45 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 openssl amd64 1.0.2g-1ubuntu4.1 [491 kB] | |
Get:46 http://archive.ubuntu.com/ubuntu xenial/main amd64 ca-certificates all 20160104ubuntu1 [191 kB] | |
Get:47 http://archive.ubuntu.com/ubuntu xenial/main amd64 libicu55 amd64 55.1-7 [7643 kB] | |
Get:48 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libxml2 amd64 2.9.3+dfsg1-1ubuntu0.1 [696 kB] | |
Get:49 http://archive.ubuntu.com/ubuntu xenial/main amd64 manpages all 4.04-2 [1087 kB] | |
Get:50 http://archive.ubuntu.com/ubuntu xenial/main amd64 xml-core all 0.13+nmu2 [23.3 kB] | |
Get:51 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 binutils amd64 2.26-8ubuntu2.1 [2306 kB] | |
Get:52 http://archive.ubuntu.com/ubuntu xenial/main amd64 libc-dev-bin amd64 2.23-0ubuntu3 [68.7 kB] | |
Get:53 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 linux-libc-dev amd64 4.4.0-24.43 [838 kB] | |
Get:54 http://archive.ubuntu.com/ubuntu xenial/main amd64 libc6-dev amd64 2.23-0ubuntu3 [2084 kB] | |
Get:55 http://archive.ubuntu.com/ubuntu xenial/main amd64 libisl15 amd64 0.16.1-1 [524 kB] | |
Get:56 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 cpp-5 amd64 5.3.1-14ubuntu2.1 [7788 kB] | |
Get:57 http://archive.ubuntu.com/ubuntu xenial/main amd64 cpp amd64 4:5.3.1-1ubuntu1 [27.7 kB] | |
Get:58 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libcc1-0 amd64 5.3.1-14ubuntu2.1 [38.7 kB] | |
Get:59 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libgomp1 amd64 5.3.1-14ubuntu2.1 [55.0 kB] | |
Get:60 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libitm1 amd64 5.3.1-14ubuntu2.1 [27.4 kB] | |
Get:61 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libatomic1 amd64 5.3.1-14ubuntu2.1 [8882 B] | |
Get:62 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libasan2 amd64 5.3.1-14ubuntu2.1 [269 kB] | |
Get:63 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 liblsan0 amd64 5.3.1-14ubuntu2.1 [110 kB] | |
Get:64 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libtsan0 amd64 5.3.1-14ubuntu2.1 [249 kB] | |
Get:65 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libubsan0 amd64 5.3.1-14ubuntu2.1 [100 kB] | |
Get:66 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libcilkrts5 amd64 5.3.1-14ubuntu2.1 [40.1 kB] | |
Get:67 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libmpx0 amd64 5.3.1-14ubuntu2.1 [9752 B] | |
Get:68 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libquadmath0 amd64 5.3.1-14ubuntu2.1 [131 kB] | |
Get:69 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libgcc-5-dev amd64 5.3.1-14ubuntu2.1 [2234 kB] | |
Get:70 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 gcc-5 amd64 5.3.1-14ubuntu2.1 [8548 kB] | |
Get:71 http://archive.ubuntu.com/ubuntu xenial/main amd64 gcc amd64 4:5.3.1-1ubuntu1 [5244 B] | |
Get:72 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libstdc++-5-dev amd64 5.3.1-14ubuntu2.1 [1427 kB] | |
Get:73 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 g++-5 amd64 5.3.1-14ubuntu2.1 [8433 kB] | |
Get:74 http://archive.ubuntu.com/ubuntu xenial/main amd64 g++ amd64 4:5.3.1-1ubuntu1 [1504 B] | |
Get:75 http://archive.ubuntu.com/ubuntu xenial/main amd64 make amd64 4.1-6 [151 kB] | |
Get:76 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libdpkg-perl all 1.18.4ubuntu1.1 [195 kB] | |
Get:77 http://archive.ubuntu.com/ubuntu xenial/main amd64 xz-utils amd64 5.1.1alpha+20120614-2ubuntu2 [78.8 kB] | |
Get:78 http://archive.ubuntu.com/ubuntu xenial/main amd64 patch amd64 2.7.5-1 [90.4 kB] | |
Get:79 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 dpkg-dev all 1.18.4ubuntu1.1 [584 kB] | |
Get:80 http://archive.ubuntu.com/ubuntu xenial/main amd64 build-essential amd64 12.1ubuntu2 [4758 B] | |
Get:81 http://archive.ubuntu.com/ubuntu xenial/main amd64 libfakeroot amd64 1.20.2-1ubuntu1 [25.5 kB] | |
Get:82 http://archive.ubuntu.com/ubuntu xenial/main amd64 fakeroot amd64 1.20.2-1ubuntu1 [61.8 kB] | |
Get:83 http://archive.ubuntu.com/ubuntu xenial/main amd64 icu-devtools amd64 55.1-7 [165 kB] | |
Get:84 http://archive.ubuntu.com/ubuntu xenial/main amd64 libalgorithm-diff-perl all 1.19.03-1 [47.6 kB] | |
Get:85 http://archive.ubuntu.com/ubuntu xenial/main amd64 libalgorithm-diff-xs-perl amd64 0.04-4build1 [11.0 kB] | |
Get:86 http://archive.ubuntu.com/ubuntu xenial/main amd64 libalgorithm-merge-perl all 0.08-3 [12.0 kB] | |
Get:87 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libexpat1-dev amd64 2.1.0-7ubuntu0.16.04.1 [115 kB] | |
Get:88 http://archive.ubuntu.com/ubuntu xenial/main amd64 libfile-fcntllock-perl amd64 0.22-3 [32.0 kB] | |
Get:89 http://archive.ubuntu.com/ubuntu xenial/main amd64 libicu-dev amd64 55.1-7 [8546 kB] | |
Get:90 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython2.7 amd64 2.7.11-7ubuntu1 [1069 kB] | |
Get:91 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython2.7-dev amd64 2.7.11-7ubuntu1 [27.8 MB] | |
Get:92 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython-dev amd64 2.7.11-1 [7728 B] | |
Get:93 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython-all-dev amd64 2.7.11-1 [992 B] | |
Get:94 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython3.5 amd64 3.5.1-10 [1360 kB] | |
Get:95 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython3.5-dev amd64 3.5.1-10 [37.3 MB] | |
Get:96 http://archive.ubuntu.com/ubuntu xenial/main amd64 libpython3-dev amd64 3.5.1-3 [6926 B] | |
Get:97 http://archive.ubuntu.com/ubuntu xenial/main amd64 zlib1g-dev amd64 1:1.2.8.dfsg-2ubuntu4 [168 kB] | |
Get:98 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libssl-dev amd64 1.0.2g-1ubuntu4.1 [1394 kB] | |
Get:99 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libssl-doc all 1.0.2g-1ubuntu4.1 [1078 kB] | |
Get:100 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libxml2-dev amd64 2.9.3+dfsg1-1ubuntu0.1 [743 kB] | |
Get:101 http://archive.ubuntu.com/ubuntu xenial/main amd64 libxslt1.1 amd64 1.1.28-2.1 [145 kB] | |
Get:102 http://archive.ubuntu.com/ubuntu xenial/main amd64 libxslt1-dev amd64 1.1.28-2.1 [406 kB] | |
Get:103 http://archive.ubuntu.com/ubuntu xenial/main amd64 manpages-dev all 4.04-2 [2048 kB] | |
Get:104 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-all amd64 2.7.11-1 [978 B] | |
Get:105 http://archive.ubuntu.com/ubuntu xenial/main amd64 python2.7-dev amd64 2.7.11-7ubuntu1 [280 kB] | |
Get:106 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-dev amd64 2.7.11-1 [1160 B] | |
Get:107 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-all-dev amd64 2.7.11-1 [1000 B] | |
Get:108 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 python-pip-whl all 8.1.1-2ubuntu0.1 [1110 kB] | |
Get:109 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 python-pip all 8.1.1-2ubuntu0.1 [144 kB] | |
Get:110 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-pkg-resources all 20.7.0-1 [108 kB] | |
Get:111 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-setuptools all 20.7.0-1 [169 kB] | |
Get:112 http://archive.ubuntu.com/ubuntu xenial/universe amd64 python-wheel all 0.29.0-1 [48.0 kB] | |
Get:113 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3.5-dev amd64 3.5.1-10 [413 kB] | |
Get:114 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-dev amd64 3.5.1-3 [1186 B] | |
Get:115 http://archive.ubuntu.com/ubuntu xenial/main amd64 rename all 0.20-4 [12.0 kB] | |
Get:116 http://archive.ubuntu.com/ubuntu xenial/main amd64 libffi-dev amd64 3.2.1-4 [161 kB] | |
Fetched 151 MB in 1min 28s (1713 kB/s) | |
debconf: delaying package configuration, since apt-utils is not installed | |
Selecting previously unselected package libatm1:amd64. | |
(Reading database ... 7309 files and directories currently installed.) | |
Preparing to unpack .../libatm1_1%3a2.5.1-1.5_amd64.deb ... | |
Unpacking libatm1:amd64 (1:2.5.1-1.5) ... | |
Selecting previously unselected package libmnl0:amd64. | |
Preparing to unpack .../libmnl0_1.0.3-5_amd64.deb ... | |
Unpacking libmnl0:amd64 (1.0.3-5) ... | |
Selecting previously unselected package libssl1.0.0:amd64. | |
Preparing to unpack .../libssl1.0.0_1.0.2g-1ubuntu4.1_amd64.deb ... | |
Unpacking libssl1.0.0:amd64 (1.0.2g-1ubuntu4.1) ... | |
Selecting previously unselected package libpython3.5-minimal:amd64. | |
Preparing to unpack .../libpython3.5-minimal_3.5.1-10_amd64.deb ... | |
Unpacking libpython3.5-minimal:amd64 (3.5.1-10) ... | |
Selecting previously unselected package libexpat1:amd64. | |
Preparing to unpack .../libexpat1_2.1.0-7ubuntu0.16.04.1_amd64.deb ... | |
Unpacking libexpat1:amd64 (2.1.0-7ubuntu0.16.04.1) ... | |
Selecting previously unselected package python3.5-minimal. | |
Preparing to unpack .../python3.5-minimal_3.5.1-10_amd64.deb ... | |
Unpacking python3.5-minimal (3.5.1-10) ... | |
Selecting previously unselected package python3-minimal. | |
Preparing to unpack .../python3-minimal_3.5.1-3_amd64.deb ... | |
Unpacking python3-minimal (3.5.1-3) ... | |
Selecting previously unselected package mime-support. | |
Preparing to unpack .../mime-support_3.59ubuntu1_all.deb ... | |
Unpacking mime-support (3.59ubuntu1) ... | |
Selecting previously unselected package libffi6:amd64. | |
Preparing to unpack .../libffi6_3.2.1-4_amd64.deb ... | |
Unpacking libffi6:amd64 (3.2.1-4) ... | |
Selecting previously unselected package libmpdec2:amd64. | |
Preparing to unpack .../libmpdec2_2.4.2-1_amd64.deb ... | |
Unpacking libmpdec2:amd64 (2.4.2-1) ... | |
Selecting previously unselected package libsqlite3-0:amd64. | |
Preparing to unpack .../libsqlite3-0_3.11.0-1ubuntu1_amd64.deb ... | |
Unpacking libsqlite3-0:amd64 (3.11.0-1ubuntu1) ... | |
Selecting previously unselected package libpython3.5-stdlib:amd64. | |
Preparing to unpack .../libpython3.5-stdlib_3.5.1-10_amd64.deb ... | |
Unpacking libpython3.5-stdlib:amd64 (3.5.1-10) ... | |
Selecting previously unselected package python3.5. | |
Preparing to unpack .../python3.5_3.5.1-10_amd64.deb ... | |
Unpacking python3.5 (3.5.1-10) ... | |
Selecting previously unselected package libpython3-stdlib:amd64. | |
Preparing to unpack .../libpython3-stdlib_3.5.1-3_amd64.deb ... | |
Unpacking libpython3-stdlib:amd64 (3.5.1-3) ... | |
Selecting previously unselected package dh-python. | |
Preparing to unpack .../dh-python_2.20151103ubuntu1.1_all.deb ... | |
Unpacking dh-python (2.20151103ubuntu1.1) ... | |
Processing triggers for libc-bin (2.23-0ubuntu3) ... | |
Setting up libssl1.0.0:amd64 (1.0.2g-1ubuntu4.1) ... | |
debconf: unable to initialize frontend: Dialog | |
debconf: (No usable dialog-like program is installed, so the dialog based frontend cannot be used. at /usr/share/perl5/Debconf/FrontEnd/Dialog.pm line 76.) | |
debconf: falling back to frontend: Readline | |
debconf: unable to initialize frontend: Readline | |
debconf: (Can't locate Term/ReadLine.pm in @INC (you may need to install the Term::ReadLine module) (@INC contains: /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.22.1 /usr/local/share/perl/5.22.1 /usr/lib/x86_64-linux-gnu/perl5/5.22 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl/5.22 /usr/share/perl/5.22 /usr/local/lib/site_perl /usr/lib/x86_64-linux-gnu/perl-base .) at /usr/share/perl5/Debconf/FrontEnd/Readline.pm line 7.) | |
debconf: falling back to frontend: Teletype | |
Setting up libpython3.5-minimal:amd64 (3.5.1-10) ... | |
Setting up libexpat1:amd64 (2.1.0-7ubuntu0.16.04.1) ... | |
Setting up python3.5-minimal (3.5.1-10) ... | |
Setting up python3-minimal (3.5.1-3) ... | |
Processing triggers for libc-bin (2.23-0ubuntu3) ... | |
Selecting previously unselected package python3. | |
(Reading database ... 8300 files and directories currently installed.) | |
Preparing to unpack .../python3_3.5.1-3_amd64.deb ... | |
Unpacking python3 (3.5.1-3) ... | |
Selecting previously unselected package libgdbm3:amd64. | |
Preparing to unpack .../libgdbm3_1.8.3-13.1_amd64.deb ... | |
Unpacking libgdbm3:amd64 (1.8.3-13.1) ... | |
Selecting previously unselected package sgml-base. | |
Preparing to unpack .../sgml-base_1.26+nmu4ubuntu1_all.deb ... | |
Unpacking sgml-base (1.26+nmu4ubuntu1) ... | |
Selecting previously unselected package perl-modules-5.22. | |
Preparing to unpack .../perl-modules-5.22_5.22.1-9_all.deb ... | |
Unpacking perl-modules-5.22 (5.22.1-9) ... | |
Selecting previously unselected package libperl5.22:amd64. | |
Preparing to unpack .../libperl5.22_5.22.1-9_amd64.deb ... | |
Unpacking libperl5.22:amd64 (5.22.1-9) ... | |
Selecting previously unselected package perl. | |
Preparing to unpack .../perl_5.22.1-9_amd64.deb ... | |
Unpacking perl (5.22.1-9) ... | |
Selecting previously unselected package libpython2.7-minimal:amd64. | |
Preparing to unpack .../libpython2.7-minimal_2.7.11-7ubuntu1_amd64.deb ... | |
Unpacking libpython2.7-minimal:amd64 (2.7.11-7ubuntu1) ... | |
Selecting previously unselected package python2.7-minimal. | |
Preparing to unpack .../python2.7-minimal_2.7.11-7ubuntu1_amd64.deb ... | |
Unpacking python2.7-minimal (2.7.11-7ubuntu1) ... | |
Selecting previously unselected package python-minimal. | |
Preparing to unpack .../python-minimal_2.7.11-1_amd64.deb ... | |
Unpacking python-minimal (2.7.11-1) ... | |
Selecting previously unselected package libpython2.7-stdlib:amd64. | |
Preparing to unpack .../libpython2.7-stdlib_2.7.11-7ubuntu1_amd64.deb ... | |
Unpacking libpython2.7-stdlib:amd64 (2.7.11-7ubuntu1) ... | |
Selecting previously unselected package python2.7. | |
Preparing to unpack .../python2.7_2.7.11-7ubuntu1_amd64.deb ... | |
Unpacking python2.7 (2.7.11-7ubuntu1) ... | |
Selecting previously unselected package libpython-stdlib:amd64. | |
Preparing to unpack .../libpython-stdlib_2.7.11-1_amd64.deb ... | |
Unpacking libpython-stdlib:amd64 (2.7.11-1) ... | |
Setting up libpython2.7-minimal:amd64 (2.7.11-7ubuntu1) ... | |
Setting up python2.7-minimal (2.7.11-7ubuntu1) ... | |
Linking and byte-compiling packages for runtime python2.7... | |
Setting up python-minimal (2.7.11-1) ... | |
Selecting previously unselected package python. | |
(Reading database ... 10865 files and directories currently installed.) | |
Preparing to unpack .../python_2.7.11-1_amd64.deb ... | |
Unpacking python (2.7.11-1) ... | |
Selecting previously unselected package libgmp10:amd64. | |
Preparing to unpack .../libgmp10_2%3a6.1.0+dfsg-2_amd64.deb ... | |
Unpacking libgmp10:amd64 (2:6.1.0+dfsg-2) ... | |
Selecting previously unselected package libmpfr4:amd64. | |
Preparing to unpack .../libmpfr4_3.1.4-1_amd64.deb ... | |
Unpacking libmpfr4:amd64 (3.1.4-1) ... | |
Selecting previously unselected package libmpc3:amd64. | |
Preparing to unpack .../libmpc3_1.0.3-1_amd64.deb ... | |
Unpacking libmpc3:amd64 (1.0.3-1) ... | |
Preparing to unpack .../gcc-5-base_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking gcc-5-base:amd64 (5.3.1-14ubuntu2.1) over (5.3.1-14ubuntu2) ... | |
Processing triggers for libc-bin (2.23-0ubuntu3) ... | |
Setting up gcc-5-base:amd64 (5.3.1-14ubuntu2.1) ... | |
(Reading database ... 10943 files and directories currently installed.) | |
Preparing to unpack .../libstdc++6_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libstdc++6:amd64 (5.3.1-14ubuntu2.1) over (5.3.1-14ubuntu2) ... | |
Processing triggers for libc-bin (2.23-0ubuntu3) ... | |
Setting up libstdc++6:amd64 (5.3.1-14ubuntu2.1) ... | |
Processing triggers for libc-bin (2.23-0ubuntu3) ... | |
Selecting previously unselected package bzip2. | |
(Reading database ... 10943 files and directories currently installed.) | |
Preparing to unpack .../bzip2_1.0.6-8_amd64.deb ... | |
Unpacking bzip2 (1.0.6-8) ... | |
Selecting previously unselected package libmagic1:amd64. | |
Preparing to unpack .../libmagic1_1%3a5.25-2ubuntu1_amd64.deb ... | |
Unpacking libmagic1:amd64 (1:5.25-2ubuntu1) ... | |
Selecting previously unselected package file. | |
Preparing to unpack .../file_1%3a5.25-2ubuntu1_amd64.deb ... | |
Unpacking file (1:5.25-2ubuntu1) ... | |
Selecting previously unselected package iproute2. | |
Preparing to unpack .../iproute2_4.3.0-1ubuntu3_amd64.deb ... | |
Unpacking iproute2 (4.3.0-1ubuntu3) ... | |
Selecting previously unselected package ifupdown. | |
Preparing to unpack .../ifupdown_0.8.10ubuntu1_amd64.deb ... | |
Unpacking ifupdown (0.8.10ubuntu1) ... | |
Selecting previously unselected package libisc-export160. | |
Preparing to unpack .../libisc-export160_1%3a9.10.3.dfsg.P4-8ubuntu1_amd64.deb ... | |
Unpacking libisc-export160 (1:9.10.3.dfsg.P4-8ubuntu1) ... | |
Selecting previously unselected package libdns-export162. | |
Preparing to unpack .../libdns-export162_1%3a9.10.3.dfsg.P4-8ubuntu1_amd64.deb ... | |
Unpacking libdns-export162 (1:9.10.3.dfsg.P4-8ubuntu1) ... | |
Selecting previously unselected package isc-dhcp-client. | |
Preparing to unpack .../isc-dhcp-client_4.3.3-5ubuntu12_amd64.deb ... | |
Unpacking isc-dhcp-client (4.3.3-5ubuntu12) ... | |
Selecting previously unselected package isc-dhcp-common. | |
Preparing to unpack .../isc-dhcp-common_4.3.3-5ubuntu12_amd64.deb ... | |
Unpacking isc-dhcp-common (4.3.3-5ubuntu12) ... | |
Selecting previously unselected package libxtables11:amd64. | |
Preparing to unpack .../libxtables11_1.6.0-2ubuntu3_amd64.deb ... | |
Unpacking libxtables11:amd64 (1.6.0-2ubuntu3) ... | |
Selecting previously unselected package netbase. | |
Preparing to unpack .../archives/netbase_5.3_all.deb ... | |
Unpacking netbase (5.3) ... | |
Selecting previously unselected package openssl. | |
Preparing to unpack .../openssl_1.0.2g-1ubuntu4.1_amd64.deb ... | |
Unpacking openssl (1.0.2g-1ubuntu4.1) ... | |
Selecting previously unselected package ca-certificates. | |
Preparing to unpack .../ca-certificates_20160104ubuntu1_all.deb ... | |
Unpacking ca-certificates (20160104ubuntu1) ... | |
Selecting previously unselected package libicu55:amd64. | |
Preparing to unpack .../libicu55_55.1-7_amd64.deb ... | |
Unpacking libicu55:amd64 (55.1-7) ... | |
Selecting previously unselected package libxml2:amd64. | |
Preparing to unpack .../libxml2_2.9.3+dfsg1-1ubuntu0.1_amd64.deb ... | |
Unpacking libxml2:amd64 (2.9.3+dfsg1-1ubuntu0.1) ... | |
Selecting previously unselected package manpages. | |
Preparing to unpack .../manpages_4.04-2_all.deb ... | |
Unpacking manpages (4.04-2) ... | |
Selecting previously unselected package xml-core. | |
Preparing to unpack .../xml-core_0.13+nmu2_all.deb ... | |
Unpacking xml-core (0.13+nmu2) ... | |
Selecting previously unselected package binutils. | |
Preparing to unpack .../binutils_2.26-8ubuntu2.1_amd64.deb ... | |
Unpacking binutils (2.26-8ubuntu2.1) ... | |
Selecting previously unselected package libc-dev-bin. | |
Preparing to unpack .../libc-dev-bin_2.23-0ubuntu3_amd64.deb ... | |
Unpacking libc-dev-bin (2.23-0ubuntu3) ... | |
Selecting previously unselected package linux-libc-dev:amd64. | |
Preparing to unpack .../linux-libc-dev_4.4.0-24.43_amd64.deb ... | |
Unpacking linux-libc-dev:amd64 (4.4.0-24.43) ... | |
Selecting previously unselected package libc6-dev:amd64. | |
Preparing to unpack .../libc6-dev_2.23-0ubuntu3_amd64.deb ... | |
Unpacking libc6-dev:amd64 (2.23-0ubuntu3) ... | |
Selecting previously unselected package libisl15:amd64. | |
Preparing to unpack .../libisl15_0.16.1-1_amd64.deb ... | |
Unpacking libisl15:amd64 (0.16.1-1) ... | |
Selecting previously unselected package cpp-5. | |
Preparing to unpack .../cpp-5_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking cpp-5 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package cpp. | |
Preparing to unpack .../cpp_4%3a5.3.1-1ubuntu1_amd64.deb ... | |
Unpacking cpp (4:5.3.1-1ubuntu1) ... | |
Selecting previously unselected package libcc1-0:amd64. | |
Preparing to unpack .../libcc1-0_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libcc1-0:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libgomp1:amd64. | |
Preparing to unpack .../libgomp1_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libgomp1:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libitm1:amd64. | |
Preparing to unpack .../libitm1_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libitm1:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libatomic1:amd64. | |
Preparing to unpack .../libatomic1_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libatomic1:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libasan2:amd64. | |
Preparing to unpack .../libasan2_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libasan2:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package liblsan0:amd64. | |
Preparing to unpack .../liblsan0_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking liblsan0:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libtsan0:amd64. | |
Preparing to unpack .../libtsan0_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libtsan0:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libubsan0:amd64. | |
Preparing to unpack .../libubsan0_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libubsan0:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libcilkrts5:amd64. | |
Preparing to unpack .../libcilkrts5_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libcilkrts5:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libmpx0:amd64. | |
Preparing to unpack .../libmpx0_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libmpx0:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libquadmath0:amd64. | |
Preparing to unpack .../libquadmath0_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libquadmath0:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package libgcc-5-dev:amd64. | |
Preparing to unpack .../libgcc-5-dev_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libgcc-5-dev:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package gcc-5. | |
Preparing to unpack .../gcc-5_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking gcc-5 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package gcc. | |
Preparing to unpack .../gcc_4%3a5.3.1-1ubuntu1_amd64.deb ... | |
Unpacking gcc (4:5.3.1-1ubuntu1) ... | |
Selecting previously unselected package libstdc++-5-dev:amd64. | |
Preparing to unpack .../libstdc++-5-dev_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking libstdc++-5-dev:amd64 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package g++-5. | |
Preparing to unpack .../g++-5_5.3.1-14ubuntu2.1_amd64.deb ... | |
Unpacking g++-5 (5.3.1-14ubuntu2.1) ... | |
Selecting previously unselected package g++. | |
Preparing to unpack .../g++_4%3a5.3.1-1ubuntu1_amd64.deb ... | |
Unpacking g++ (4:5.3.1-1ubuntu1) ... | |
Selecting previously unselected package make. | |
Preparing to unpack .../archives/make_4.1-6_amd64.deb ... | |
Unpacking make (4.1-6) ... | |
Selecting previously unselected package libdpkg-perl. | |
Preparing to unpack .../libdpkg-perl_1.18.4ubuntu1.1_all.deb ... | |
Unpacking libdpkg-perl (1.18.4ubuntu1.1) ... | |
Selecting previously unselected package xz-utils. | |
Preparing to unpack .../xz-utils_5.1.1alpha+20120614-2ubuntu2_amd64.deb ... | |
Unpacking xz-utils (5.1.1alpha+20120614-2ubuntu2) ... | |
Selecting previously unselected package patch. | |
Preparing to unpack .../patch_2.7.5-1_amd64.deb ... | |
Unpacking patch (2.7.5-1) ... | |
Selecting previously unselected package dpkg-dev. | |
Preparing to unpack .../dpkg-dev_1.18.4ubuntu1.1_all.deb ... | |
Unpacking dpkg-dev (1.18.4ubuntu1.1) ... | |
Selecting previously unselected package build-essential. | |
Preparing to unpack .../build-essential_12.1ubuntu2_amd64.deb ... | |
Unpacking build-essential (12.1ubuntu2) ... | |
Selecting previously unselected package libfakeroot:amd64. | |
Preparing to unpack .../libfakeroot_1.20.2-1ubuntu1_amd64.deb ... | |
Unpacking libfakeroot:amd64 (1.20.2-1ubuntu1) ... | |
Selecting previously unselected package fakeroot. | |
Preparing to unpack .../fakeroot_1.20.2-1ubuntu1_amd64.deb ... | |
Unpacking fakeroot (1.20.2-1ubuntu1) ... | |
Selecting previously unselected package icu-devtools. | |
Preparing to unpack .../icu-devtools_55.1-7_amd64.deb ... | |
Unpacking icu-devtools (55.1-7) ... | |
Selecting previously unselected package libalgorithm-diff-perl. | |
Preparing to unpack .../libalgorithm-diff-perl_1.19.03-1_all.deb ... | |
Unpacking libalgorithm-diff-perl (1.19.03-1) ... | |
Selecting previously unselected package libalgorithm-diff-xs-perl. | |
Preparing to unpack .../libalgorithm-diff-xs-perl_0.04-4build1_amd64.deb ... | |
Unpacking libalgorithm-diff-xs-perl (0.04-4build1) ... | |
Selecting previously unselected package libalgorithm-merge-perl. | |
Preparing to unpack .../libalgorithm-merge-perl_0.08-3_all.deb ... | |
Unpacking libalgorithm-merge-perl (0.08-3) ... | |
Selecting previously unselected package libexpat1-dev:amd64. | |
Preparing to unpack .../libexpat1-dev_2.1.0-7ubuntu0.16.04.1_amd64.deb ... | |
Unpacking libexpat1-dev:amd64 (2.1.0-7ubuntu0.16.04.1) ... | |
Selecting previously unselected package libfile-fcntllock-perl. | |
Preparing to unpack .../libfile-fcntllock-perl_0.22-3_amd64.deb ... | |
Unpacking libfile-fcntllock-perl (0.22-3) ... | |
Selecting previously unselected package libicu-dev:amd64. | |
Preparing to unpack .../libicu-dev_55.1-7_amd64.deb ... | |
Unpacking libicu-dev:amd64 (55.1-7) ... | |
Selecting previously unselected package libpython2.7:amd64. | |
Preparing to unpack .../libpython2.7_2.7.11-7ubuntu1_amd64.deb ... | |
Unpacking libpython2.7:amd64 (2.7.11-7ubuntu1) ... | |
Selecting previously unselected package libpython2.7-dev:amd64. | |
Preparing to unpack .../libpython2.7-dev_2.7.11-7ubuntu1_amd64.deb ... | |
Unpacking libpython2.7-dev:amd64 (2.7.11-7ubuntu1) ... | |
Selecting previously unselected package libpython-dev:amd64. | |
Preparing to unpack .../libpython-dev_2.7.11-1_amd64.deb ... | |
Unpacking libpython-dev:amd64 (2.7.11-1) ... | |
Selecting previously unselected package libpython-all-dev:amd64. | |
Preparing to unpack .../libpython-all-dev_2.7.11-1_amd64.deb ... | |
Unpacking libpython-all-dev:amd64 (2.7.11-1) ... | |
Selecting previously unselected package libpython3.5:amd64. | |
Preparing to unpack .../libpython3.5_3.5.1-10_amd64.deb ... | |
Unpacking libpython3.5:amd64 (3.5.1-10) ... | |
Selecting previously unselected package libpython3.5-dev:amd64. | |
Preparing to unpack .../libpython3.5-dev_3.5.1-10_amd64.deb ... | |
Unpacking libpython3.5-dev:amd64 (3.5.1-10) ... | |
Selecting previously unselected package libpython3-dev:amd64. | |
Preparing to unpack .../libpython3-dev_3.5.1-3_amd64.deb ... | |
Unpacking libpython3-dev:amd64 (3.5.1-3) ... | |
Selecting previously unselected package zlib1g-dev:amd64. | |
Preparing to unpack .../zlib1g-dev_1%3a1.2.8.dfsg-2ubuntu4_amd64.deb ... | |
Unpacking zlib1g-dev:amd64 (1:1.2.8.dfsg-2ubuntu4) ... | |
Selecting previously unselected package libssl-dev:amd64. | |
Preparing to unpack .../libssl-dev_1.0.2g-1ubuntu4.1_amd64.deb ... | |
Unpacking libssl-dev:amd64 (1.0.2g-1ubuntu4.1) ... | |
Selecting previously unselected package libssl-doc. | |
Preparing to unpack .../libssl-doc_1.0.2g-1ubuntu4.1_all.deb ... | |
Unpacking libssl-doc (1.0.2g-1ubuntu4.1) ... | |
Selecting previously unselected package libxml2-dev:amd64. | |
Preparing to unpack .../libxml2-dev_2.9.3+dfsg1-1ubuntu0.1_amd64.deb ... | |
Unpacking libxml2-dev:amd64 (2.9.3+dfsg1-1ubuntu0.1) ... | |
Selecting previously unselected package libxslt1.1:amd64. | |
Preparing to unpack .../libxslt1.1_1.1.28-2.1_amd64.deb ... | |
Unpacking libxslt1.1:amd64 (1.1.28-2.1) ... | |
Selecting previously unselected package libxslt1-dev:amd64. | |
Preparing to unpack .../libxslt1-dev_1.1.28-2.1_amd64.deb ... | |
Unpacking libxslt1-dev:amd64 (1.1.28-2.1) ... | |
Selecting previously unselected package manpages-dev. | |
Preparing to unpack .../manpages-dev_4.04-2_all.deb ... | |
Unpacking manpages-dev (4.04-2) ... | |
Selecting previously unselected package python-all. | |
Preparing to unpack .../python-all_2.7.11-1_amd64.deb ... | |
Unpacking python-all (2.7.11-1) ... | |
Selecting previously unselected package python2.7-dev. | |
Preparing to unpack .../python2.7-dev_2.7.11-7ubuntu1_amd64.deb ... | |
Unpacking python2.7-dev (2.7.11-7ubuntu1) ... | |
Selecting previously unselected package python-dev. | |
Preparing to unpack .../python-dev_2.7.11-1_amd64.deb ... | |
Unpacking python-dev (2.7.11-1) ... | |
Selecting previously unselected package python-all-dev. | |
Preparing to unpack .../python-all-dev_2.7.11-1_amd64.deb ... | |
Unpacking python-all-dev (2.7.11-1) ... | |
Selecting previously unselected package python-pip-whl. | |
Preparing to unpack .../python-pip-whl_8.1.1-2ubuntu0.1_all.deb ... | |
Unpacking python-pip-whl (8.1.1-2ubuntu0.1) ... | |
Selecting previously unselected package python-pip. | |
Preparing to unpack .../python-pip_8.1.1-2ubuntu0.1_all.deb ... | |
Unpacking python-pip (8.1.1-2ubuntu0.1) ... | |
Selecting previously unselected package python-pkg-resources. | |
Preparing to unpack .../python-pkg-resources_20.7.0-1_all.deb ... | |
Unpacking python-pkg-resources (20.7.0-1) ... | |
Selecting previously unselected package python-setuptools. | |
Preparing to unpack .../python-setuptools_20.7.0-1_all.deb ... | |
Unpacking python-setuptools (20.7.0-1) ... | |
Selecting previously unselected package python-wheel. | |
Preparing to unpack .../python-wheel_0.29.0-1_all.deb ... | |
Unpacking python-wheel (0.29.0-1) ... | |
Selecting previously unselected package python3.5-dev. | |
Preparing to unpack .../python3.5-dev_3.5.1-10_amd64.deb ... | |
Unpacking python3.5-dev (3.5.1-10) ... | |
Selecting previously unselected package python3-dev. | |
Preparing to unpack .../python3-dev_3.5.1-3_amd64.deb ... | |
Unpacking python3-dev (3.5.1-3) ... | |
Selecting previously unselected package rename. | |
Preparing to unpack .../archives/rename_0.20-4_all.deb ... | |
Unpacking rename (0.20-4) ... | |
Selecting previously unselected package libffi-dev:amd64. | |
Preparing to unpack .../libffi-dev_3.2.1-4_amd64.deb ... | |
Unpacking libffi-dev:amd64 (3.2.1-4) ... | |
Processing triggers for libc-bin (2.23-0ubuntu3) ... | |
Processing triggers for systemd (229-4ubuntu6) ... | |
Setting up libatm1:amd64 (1:2.5.1-1.5) ... | |
Setting up libmnl0:amd64 (1.0.3-5) ... | |
Setting up mime-support (3.59ubuntu1) ... | |
Setting up libffi6:amd64 (3.2.1-4) ... | |
Setting up libmpdec2:amd64 (2.4.2-1) ... | |
Setting up libsqlite3-0:amd64 (3.11.0-1ubuntu1) ... | |
Setting up libpython3.5-stdlib:amd64 (3.5.1-10) ... | |
Setting up python3.5 (3.5.1-10) ... | |
Setting up libpython3-stdlib:amd64 (3.5.1-3) ... | |
Setting up libgdbm3:amd64 (1.8.3-13.1) ... | |
Setting up sgml-base (1.26+nmu4ubuntu1) ... | |
Setting up perl-modules-5.22 (5.22.1-9) ... | |
Setting up libperl5.22:amd64 (5.22.1-9) ... | |
Setting up perl (5.22.1-9) ... | |
update-alternatives: using /usr/bin/prename to provide /usr/bin/rename (rename) in auto mode | |
Setting up libpython2.7-stdlib:amd64 (2.7.11-7ubuntu1) ... | |
Setting up python2.7 (2.7.11-7ubuntu1) ... | |
Setting up libpython-stdlib:amd64 (2.7.11-1) ... | |
Setting up python (2.7.11-1) ... | |
Setting up libgmp10:amd64 (2:6.1.0+dfsg-2) ... | |
Setting up libmpfr4:amd64 (3.1.4-1) ... | |
Setting up libmpc3:amd64 (1.0.3-1) ... | |
Setting up bzip2 (1.0.6-8) ... | |
Setting up libmagic1:amd64 (1:5.25-2ubuntu1) ... | |
Setting up file (1:5.25-2ubuntu1) ... | |
Setting up iproute2 (4.3.0-1ubuntu3) ... | |
Setting up ifupdown (0.8.10ubuntu1) ... | |
Creating /etc/network/interfaces. | |
Setting up libisc-export160 (1:9.10.3.dfsg.P4-8ubuntu1) ... | |
Setting up libdns-export162 (1:9.10.3.dfsg.P4-8ubuntu1) ... | |
Setting up isc-dhcp-client (4.3.3-5ubuntu12) ... | |
Setting up isc-dhcp-common (4.3.3-5ubuntu12) ... | |
Setting up libxtables11:amd64 (1.6.0-2ubuntu3) ... | |
Setting up netbase (5.3) ... | |
Setting up openssl (1.0.2g-1ubuntu4.1) ... | |
Setting up ca-certificates (20160104ubuntu1) ... | |
debconf: unable to initialize frontend: Dialog | |
debconf: (No usable dialog-like program is installed, so the dialog based frontend cannot be used. at /usr/share/perl5/Debconf/FrontEnd/Dialog.pm line 76.) | |
debconf: falling back to frontend: Readline | |
Setting up libicu55:amd64 (55.1-7) ... | |
Setting up libxml2:amd64 (2.9.3+dfsg1-1ubuntu0.1) ... | |
Setting up manpages (4.04-2) ... | |
Setting up xml-core (0.13+nmu2) ... | |
Setting up binutils (2.26-8ubuntu2.1) ... | |
Setting up libc-dev-bin (2.23-0ubuntu3) ... | |
Setting up linux-libc-dev:amd64 (4.4.0-24.43) ... | |
Setting up libc6-dev:amd64 (2.23-0ubuntu3) ... | |
Setting up libisl15:amd64 (0.16.1-1) ... | |
Setting up cpp-5 (5.3.1-14ubuntu2.1) ... | |
Setting up cpp (4:5.3.1-1ubuntu1) ... | |
Setting up libcc1-0:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libgomp1:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libitm1:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libatomic1:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libasan2:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up liblsan0:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libtsan0:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libubsan0:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libcilkrts5:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libmpx0:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libquadmath0:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up libgcc-5-dev:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up gcc-5 (5.3.1-14ubuntu2.1) ... | |
Setting up gcc (4:5.3.1-1ubuntu1) ... | |
Setting up libstdc++-5-dev:amd64 (5.3.1-14ubuntu2.1) ... | |
Setting up g++-5 (5.3.1-14ubuntu2.1) ... | |
Setting up g++ (4:5.3.1-1ubuntu1) ... | |
update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode | |
Setting up make (4.1-6) ... | |
Setting up libdpkg-perl (1.18.4ubuntu1.1) ... | |
Setting up xz-utils (5.1.1alpha+20120614-2ubuntu2) ... | |
update-alternatives: using /usr/bin/xz to provide /usr/bin/lzma (lzma) in auto mode | |
Setting up patch (2.7.5-1) ... | |
Setting up dpkg-dev (1.18.4ubuntu1.1) ... | |
Setting up build-essential (12.1ubuntu2) ... | |
Setting up libfakeroot:amd64 (1.20.2-1ubuntu1) ... | |
Setting up fakeroot (1.20.2-1ubuntu1) ... | |
update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode | |
Setting up icu-devtools (55.1-7) ... | |
Setting up libalgorithm-diff-perl (1.19.03-1) ... | |
Setting up libalgorithm-diff-xs-perl (0.04-4build1) ... | |
Setting up libalgorithm-merge-perl (0.08-3) ... | |
Setting up libexpat1-dev:amd64 (2.1.0-7ubuntu0.16.04.1) ... | |
Setting up libfile-fcntllock-perl (0.22-3) ... | |
Setting up libicu-dev:amd64 (55.1-7) ... | |
Setting up libpython2.7:amd64 (2.7.11-7ubuntu1) ... | |
Setting up libpython2.7-dev:amd64 (2.7.11-7ubuntu1) ... | |
Setting up libpython-dev:amd64 (2.7.11-1) ... | |
Setting up libpython-all-dev:amd64 (2.7.11-1) ... | |
Setting up libpython3.5:amd64 (3.5.1-10) ... | |
Setting up libpython3.5-dev:amd64 (3.5.1-10) ... | |
Setting up libpython3-dev:amd64 (3.5.1-3) ... | |
Setting up zlib1g-dev:amd64 (1:1.2.8.dfsg-2ubuntu4) ... | |
Setting up libssl-dev:amd64 (1.0.2g-1ubuntu4.1) ... | |
Setting up libssl-doc (1.0.2g-1ubuntu4.1) ... | |
Setting up libxml2-dev:amd64 (2.9.3+dfsg1-1ubuntu0.1) ... | |
Setting up libxslt1.1:amd64 (1.1.28-2.1) ... | |
Setting up libxslt1-dev:amd64 (1.1.28-2.1) ... | |
Setting up manpages-dev (4.04-2) ... | |
Setting up python-all (2.7.11-1) ... | |
Setting up python2.7-dev (2.7.11-7ubuntu1) ... | |
Setting up python-dev (2.7.11-1) ... | |
Setting up python-all-dev (2.7.11-1) ... | |
Setting up python-pip-whl (8.1.1-2ubuntu0.1) ... | |
Setting up python-pip (8.1.1-2ubuntu0.1) ... | |
Setting up python-pkg-resources (20.7.0-1) ... | |
Setting up python-setuptools (20.7.0-1) ... | |
Setting up python-wheel (0.29.0-1) ... | |
Setting up python3.5-dev (3.5.1-10) ... | |
Setting up rename (0.20-4) ... | |
update-alternatives: using /usr/bin/file-rename to provide /usr/bin/rename (rename) in auto mode | |
Setting up libffi-dev:amd64 (3.2.1-4) ... | |
Setting up python3 (3.5.1-3) ... | |
running python rtupdate hooks for python3.5... | |
running python post-rtupdate hooks for python3.5... | |
Setting up python3-dev (3.5.1-3) ... | |
Setting up dh-python (2.20151103ubuntu1.1) ... | |
Processing triggers for libc-bin (2.23-0ubuntu3) ... | |
Processing triggers for systemd (229-4ubuntu6) ... | |
Processing triggers for ca-certificates (20160104ubuntu1) ... | |
Updating certificates in /etc/ssl/certs... | |
173 added, 0 removed; done. | |
Running hooks in /etc/ca-certificates/update.d... | |
done. | |
Processing triggers for sgml-base (1.26+nmu4ubuntu1) ... | |
# --- step 3: install scrapy using pip, using user scheme, not global, | |
# (to avoid potential permission issues) | |
# https://pip.pypa.io/en/stable/user_guide/#user-installs | |
# https://docs.python.org/3/install/index.html#alternate-installation-the-user-scheme | |
scrapyuser@2b8589177842:/$ pip install --user scrapy | |
Collecting scrapy | |
Downloading Scrapy-1.1.0-py2.py3-none-any.whl (294kB) | |
100% |################################| 296kB 959kB/s | |
Collecting queuelib (from scrapy) | |
Downloading queuelib-1.4.2-py2.py3-none-any.whl | |
Collecting pyOpenSSL (from scrapy) | |
Downloading pyOpenSSL-16.0.0-py2.py3-none-any.whl (45kB) | |
100% |################################| 51kB 2.2MB/s | |
Collecting Twisted>=10.0.0 (from scrapy) | |
Downloading Twisted-16.2.0.tar.bz2 (2.9MB) | |
100% |################################| 2.9MB 307kB/s | |
Collecting six>=1.5.2 (from scrapy) | |
Downloading six-1.10.0-py2.py3-none-any.whl | |
Collecting w3lib>=1.14.2 (from scrapy) | |
Downloading w3lib-1.14.2-py2.py3-none-any.whl | |
Collecting service-identity (from scrapy) | |
Downloading service_identity-16.0.0-py2.py3-none-any.whl | |
Collecting cssselect>=0.9 (from scrapy) | |
Downloading cssselect-0.9.2-py2.py3-none-any.whl | |
Collecting lxml (from scrapy) | |
Downloading lxml-3.6.0.tar.gz (3.7MB) | |
100% |################################| 3.7MB 315kB/s | |
Collecting parsel>=0.9.3 (from scrapy) | |
Downloading parsel-1.0.2-py2.py3-none-any.whl | |
Collecting PyDispatcher>=2.0.5 (from scrapy) | |
Downloading PyDispatcher-2.0.5.tar.gz | |
Collecting cryptography>=1.3 (from pyOpenSSL->scrapy) | |
Downloading cryptography-1.4.tar.gz (399kB) | |
100% |################################| 409kB 951kB/s | |
Collecting zope.interface>=3.6.0 (from Twisted>=10.0.0->scrapy) | |
Downloading zope.interface-4.2.0.tar.gz (146kB) | |
100% |################################| 153kB 1.5MB/s | |
Collecting pyasn1-modules (from service-identity->scrapy) | |
Downloading pyasn1_modules-0.0.8-py2.py3-none-any.whl | |
Collecting pyasn1 (from service-identity->scrapy) | |
Downloading pyasn1-0.1.9-py2.py3-none-any.whl | |
Collecting attrs (from service-identity->scrapy) | |
Downloading attrs-16.0.0-py2.py3-none-any.whl | |
Collecting idna>=2.0 (from cryptography>=1.3->pyOpenSSL->scrapy) | |
Downloading idna-2.1-py2.py3-none-any.whl (54kB) | |
100% |################################| 61kB 1.9MB/s | |
Collecting setuptools>=11.3 (from cryptography>=1.3->pyOpenSSL->scrapy) | |
Downloading setuptools-23.0.0-py2.py3-none-any.whl (435kB) | |
100% |################################| 440kB 801kB/s | |
Collecting enum34 (from cryptography>=1.3->pyOpenSSL->scrapy) | |
Downloading enum34-1.1.6-py2-none-any.whl | |
Collecting ipaddress (from cryptography>=1.3->pyOpenSSL->scrapy) | |
Downloading ipaddress-1.0.16-py27-none-any.whl | |
Collecting cffi>=1.4.1 (from cryptography>=1.3->pyOpenSSL->scrapy) | |
Downloading cffi-1.6.0.tar.gz (397kB) | |
100% |################################| 399kB 928kB/s | |
Collecting pycparser (from cffi>=1.4.1->cryptography>=1.3->pyOpenSSL->scrapy) | |
Downloading pycparser-2.14.tar.gz (223kB) | |
100% |################################| 225kB 1.1MB/s | |
Building wheels for collected packages: Twisted, lxml, PyDispatcher, cryptography, zope.interface, cffi, pycparser | |
Running setup.py bdist_wheel for Twisted ... done | |
Stored in directory: /home/scrapyuser/.cache/pip/wheels/fe/9d/3f/9f7b1c768889796c01929abb7cdfa2a9cdd32bae64eb7aa239 | |
Running setup.py bdist_wheel for lxml ... done | |
Stored in directory: /home/scrapyuser/.cache/pip/wheels/6c/eb/a1/e4ff54c99630e3cc6ec659287c4fd88345cd78199923544412 | |
Running setup.py bdist_wheel for PyDispatcher ... done | |
Stored in directory: /home/scrapyuser/.cache/pip/wheels/86/02/a1/5857c77600a28813aaf0f66d4e4568f50c9f133277a4122411 | |
Running setup.py bdist_wheel for cryptography ... done | |
Stored in directory: /home/scrapyuser/.cache/pip/wheels/f6/6c/21/11ec069285a52d7fa8c735be5fc2edfb8b24012c0f78f93d20 | |
Running setup.py bdist_wheel for zope.interface ... done | |
Stored in directory: /home/scrapyuser/.cache/pip/wheels/20/a2/bc/74fe87cee17134f5219ba01fe82dd8c10998377e0fb910bb22 | |
Running setup.py bdist_wheel for cffi ... done | |
Stored in directory: /home/scrapyuser/.cache/pip/wheels/8f/00/29/553c1b1db38bbeec3fec428ae4e400cd8349ecd99fe86edea1 | |
Running setup.py bdist_wheel for pycparser ... done | |
Stored in directory: /home/scrapyuser/.cache/pip/wheels/9b/f4/2e/d03e949a551719a1ffcb659f2c63d8444f4df12e994ce52112 | |
Successfully built Twisted lxml PyDispatcher cryptography zope.interface cffi pycparser | |
Installing collected packages: queuelib, idna, pyasn1, six, setuptools, enum34, ipaddress, pycparser, cffi, cryptography, pyOpenSSL, zope.interface, Twisted, w3lib, pyasn1-modules, attrs, service-identity, cssselect, lxml, parsel, PyDispatcher, scrapy | |
Successfully installed PyDispatcher Twisted attrs cffi cryptography cssselect enum34 idna ipaddress lxml parsel pyOpenSSL pyasn1 pyasn1-modules pycparser queuelib scrapy service-identity setuptools-20.7.0 six w3lib zope.interface | |
You are using pip version 8.1.1, however version 8.1.2 is available. | |
You should consider upgrading via the 'pip install --upgrade pip' command. | |
# --- step 4: check installation | |
scrapyuser@2b8589177842:/$ which scrapy | |
scrapyuser@2b8589177842:/$ scrapy | |
bash: scrapy: command not found | |
# "scrapy" not found... | |
# check what's installed: | |
scrapyuser@2b8589177842:/$ pip freeze | |
attrs==16.0.0 | |
cffi==1.6.0 | |
cryptography==1.4 | |
cssselect==0.9.2 | |
enum34==1.1.6 | |
idna==2.1 | |
ipaddress==1.0.16 | |
lxml==3.6.0 | |
parsel==1.0.2 | |
pyasn1==0.1.9 | |
pyasn1-modules==0.0.8 | |
pycparser==2.14 | |
PyDispatcher==2.0.5 | |
pyOpenSSL==16.0.0 | |
queuelib==1.4.2 | |
Scrapy==1.1.0 | |
service-identity==16.0.0 | |
six==1.10.0 | |
Twisted==16.2.0 | |
w3lib==1.14.2 | |
zope.interface==4.2.0 | |
You are using pip version 8.1.1, however version 8.1.2 is available. | |
You should consider upgrading via the 'pip install --upgrade pip' command. | |
# scrapy 1.1 is there | |
# --- step 5: alternate way to run scrapy commands | |
# python -m scrapy.cmdline <command> | |
scrapyuser@2b8589177842:/$ python -m scrapy.cmdline | |
Scrapy 1.1.0 - no active project | |
Usage: | |
scrapy <command> [options] [args] | |
Available commands: | |
bench Run quick benchmark test | |
commands | |
fetch Fetch a URL using the Scrapy downloader | |
runspider Run a self-contained spider (without creating a project) | |
settings Get settings values | |
shell Interactive scraping console | |
startproject Create new project | |
version Print Scrapy version | |
view Open URL in browser, as seen by Scrapy | |
[ more ] More commands available when run from project directory | |
Use "scrapy <command> -h" to see more info about a command | |
scrapyuser@2b8589177842:/$ python -m scrapy.cmdline version | |
Scrapy 1.1.0 | |
# verbose version, showing Python 2.7 | |
scrapyuser@2b8589177842:/$ python -m scrapy.cmdline version -v | |
Scrapy : 1.1.0 | |
lxml : 3.6.0.0 | |
libxml2 : 2.9.3 | |
Twisted : 16.2.0 | |
Python : 2.7.11+ (default, Apr 17 2016, 14:00:29) - [GCC 5.3.1 20160413] | |
pyOpenSSL : 16.0.0 (OpenSSL 1.0.2g-fips 1 Mar 2016) | |
Platform : Linux-4.4.0-24-generic-x86_64-with-Ubuntu-16.04-xenial | |
# step 6: launch scrapy shell | |
scrapyuser@2b8589177842:/$ python -m scrapy.cmdline shell http://scrapy.org/ | |
2016-06-17 10:35:52 [scrapy] INFO: Scrapy 1.1.0 started (bot: scrapybot) | |
2016-06-17 10:35:52 [scrapy] INFO: Overridden settings: {'LOGSTATS_INTERVAL': 0, 'DUPEFILTER_CLASS': 'scrapy.dupefilters.BaseDupeFilter'} | |
2016-06-17 10:35:52 [scrapy] INFO: Enabled extensions: | |
['scrapy.extensions.telnet.TelnetConsole', | |
'scrapy.extensions.corestats.CoreStats'] | |
2016-06-17 10:35:52 [scrapy] INFO: Enabled downloader middlewares: | |
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', | |
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', | |
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', | |
'scrapy.downloadermiddlewares.retry.RetryMiddleware', | |
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', | |
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', | |
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', | |
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', | |
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', | |
'scrapy.downloadermiddlewares.chunked.ChunkedTransferMiddleware', | |
'scrapy.downloadermiddlewares.stats.DownloaderStats'] | |
2016-06-17 10:35:52 [scrapy] INFO: Enabled spider middlewares: | |
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', | |
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', | |
'scrapy.spidermiddlewares.referer.RefererMiddleware', | |
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', | |
'scrapy.spidermiddlewares.depth.DepthMiddleware'] | |
2016-06-17 10:35:52 [scrapy] INFO: Enabled item pipelines: | |
[] | |
2016-06-17 10:35:52 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6023 | |
2016-06-17 10:35:52 [scrapy] INFO: Spider opened | |
2016-06-17 10:35:53 [scrapy] DEBUG: Crawled (200) <GET http://scrapy.org/> (referer: None) | |
[s] Available Scrapy objects: | |
[s] crawler <scrapy.crawler.Crawler object at 0x7f6591fceb50> | |
[s] item {} | |
[s] request <GET http://scrapy.org/> | |
[s] response <200 http://scrapy.org/> | |
[s] settings <scrapy.settings.Settings object at 0x7f6591fcea50> | |
[s] spider <DefaultSpider 'default' at 0x7f65917e9b90> | |
[s] Useful shortcuts: | |
[s] shelp() Shell help (print this help) | |
[s] fetch(req_or_url) Fetch request (or URL) and update local objects | |
[s] view(response) View response in a browser | |
>>> |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment