Skip to content

Instantly share code, notes, and snippets.

@tgruben
Created August 14, 2019 22:01
Show Gist options
  • Save tgruben/99cbf82260a8fecdaab76970c3e81a69 to your computer and use it in GitHub Desktop.
Save tgruben/99cbf82260a8fecdaab76970c3e81a69 to your computer and use it in GitHub Desktop.
Script started on 2019-08-14 19:13:19+0000
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ df
Filesystem 1K-blocks Used Available Use% Mounted on
udev 61870868 0 61870868 0% /dev
tmpfs 12376772 892 12375880 1% /run
/dev/sda1 9983232 1655520 8311328 17% /
tmpfs 61883856 0 61883856 0% /dev/shm
tmpfs 5120 0 5120 0% /run/lock
tmpfs 61883856 0 61883856 0% /sys/fs/cgroup
/dev/sda15 106858 3682 103177 4% /boot/efi
/dev/loop0 90624 90624 0 100% /snap/core/7270
/dev/loop1 61312 61312 0 100% /snap/google-cloud-sdk/90
/dev/nvme0n1 385996160 69660 366249316 1% /mnt/disks/data1
tmpfs 12376768 0 12376768 0% /run/user/1000
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ sudo apt-get install default-jdk
Reading package lists... 0% Reading package lists... 100% Reading package lists... Done
Building dependency tree... 0% Building dependency tree... 0% Building dependency tree... 50% Building dependency tree... 50% Building dependency tree
Reading state information... 0% Reading state information... 0% Reading state information... Done
The following packages were automatically installed and are no longer required:
grub-pc-bin libnuma1
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
at-spi2-core ca-certificates-java default-jdk-headless default-jre
default-jre-headless fontconfig-config fonts-dejavu-core fonts-dejavu-extra
java-common libasound2 libasound2-data libatk-bridge2.0-0
libatk-wrapper-java libatk-wrapper-java-jni libatk1.0-0 libatk1.0-data
libatspi2.0-0 libavahi-client3 libavahi-common-data libavahi-common3
libcups2 libdrm-amdgpu1 libdrm-intel1 libdrm-nouveau2 libdrm-radeon1
libfontconfig1 libfontenc1 libgif7 libgl1 libgl1-mesa-dri libglapi-mesa
libglvnd0 libglx-mesa0 libglx0 libice-dev libice6 libjpeg-turbo8 libjpeg8
liblcms2-2 libllvm8 libpciaccess0 libpcsclite1 libpthread-stubs0-dev
libsensors4 libsm-dev libsm6 libx11-dev libx11-doc libx11-xcb1 libxau-dev
libxaw7 libxcb-dri2-0 libxcb-dri3-0 libxcb-glx0 libxcb-present0
libxcb-shape0 libxcb-sync1 libxcb1-dev libxcomposite1 libxdamage1
libxdmcp-dev libxfixes3 libxft2 libxi6 libxinerama1 libxmu6 libxpm4
libxrandr2 libxrender1 libxshmfence1 libxt-dev libxt6 libxtst6 libxv1
libxxf86dga1 libxxf86vm1 openjdk-11-jdk openjdk-11-jdk-headless
openjdk-11-jre openjdk-11-jre-headless x11-common x11-utils
x11proto-core-dev x11proto-dev xorg-sgml-doctools xtrans-dev
Suggested packages:
libasound2-plugins alsa-utils cups-common libice-doc liblcms2-utils pcscd
lm-sensors libsm-doc libxcb-doc libxt-doc openjdk-11-demo openjdk-11-source
visualvm libnss-mdns fonts-ipafont-gothic fonts-ipafont-mincho
fonts-wqy-microhei | fonts-wqy-zenhei fonts-indic mesa-utils
The following NEW packages will be installed:
at-spi2-core ca-certificates-java default-jdk default-jdk-headless
default-jre default-jre-headless fontconfig-config fonts-dejavu-core
fonts-dejavu-extra java-common libasound2 libasound2-data libatk-bridge2.0-0
libatk-wrapper-java libatk-wrapper-java-jni libatk1.0-0 libatk1.0-data
libatspi2.0-0 libavahi-client3 libavahi-common-data libavahi-common3
libcups2 libdrm-amdgpu1 libdrm-intel1 libdrm-nouveau2 libdrm-radeon1
libfontconfig1 libfontenc1 libgif7 libgl1 libgl1-mesa-dri libglapi-mesa
libglvnd0 libglx-mesa0 libglx0 libice-dev libice6 libjpeg-turbo8 libjpeg8
liblcms2-2 libllvm8 libpciaccess0 libpcsclite1 libpthread-stubs0-dev
libsensors4 libsm-dev libsm6 libx11-dev libx11-doc libx11-xcb1 libxau-dev
libxaw7 libxcb-dri2-0 libxcb-dri3-0 libxcb-glx0 libxcb-present0
libxcb-shape0 libxcb-sync1 libxcb1-dev libxcomposite1 libxdamage1
libxdmcp-dev libxfixes3 libxft2 libxi6 libxinerama1 libxmu6 libxpm4
libxrandr2 libxrender1 libxshmfence1 libxt-dev libxt6 libxtst6 libxv1
libxxf86dga1 libxxf86vm1 openjdk-11-jdk openjdk-11-jdk-headless
openjdk-11-jre openjdk-11-jre-headless x11-common x11-utils
x11proto-core-dev x11proto-dev xorg-sgml-doctools xtrans-dev
0 upgraded, 87 newly installed, 0 to remove and 19 not upgraded.
Need to get 261 MB of archives.
After this operation, 644 MB of additional disk space will be used.
Do you want to continue? [Y/n] Y
0% [Working] Get:1 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libjpeg-turbo8 amd64 1.5.2-0ubuntu5.18.04.1 [110 kB]
0% [1 libjpeg-turbo8 13.7 kB/110 kB 12%] 0% [Working] Get:2 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 x11-common all 1:7.7+19ubuntu7.1 [22.5 kB]
0% [2 x11-common 12.3 kB/22.5 kB 54%] 1% [Waiting for headers] Get:3 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libice6 amd64 2:1.0.9-2 [40.2 kB]
1% [3 libice6 17.9 kB/40.2 kB 44%] 1% [Waiting for headers] Get:4 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libsm6 amd64 2:1.2.2-1 [15.8 kB]
1% [4 libsm6 15.8 kB/15.8 kB 100%] 1% [Waiting for headers] Get:5 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 fonts-dejavu-core all 2.37-1 [1041 kB]
1% [5 fonts-dejavu-core 5817 B/1041 kB 1%] 2% [Waiting for headers] Get:6 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 fontconfig-config all 2.12.6-0ubuntu2 [55.8 kB]
2% [6 fontconfig-config 9455 B/55.8 kB 17%] 2% [Waiting for headers] Get:7 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libfontconfig1 amd64 2.12.6-0ubuntu2 [137 kB]
2% [7 libfontconfig1 12.3 kB/137 kB 9%] 2% [Waiting for headers] Get:8 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxrender1 amd64 1:0.9.10-1 [18.7 kB]
2% [8 libxrender1 8896 B/18.7 kB 48%] 2% [Waiting for headers] Get:9 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxft2 amd64 2.3.2-1 [36.1 kB]
2% [9 libxft2 8044 B/36.1 kB 22%] 3% [Waiting for headers] Get:10 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxinerama1 amd64 2:1.1.3-1 [7908 B]
3% [10 libxinerama1 7908 B/7908 B 100%] 3% [Waiting for headers] Get:11 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxxf86dga1 amd64 2:1.1.4-1 [13.7 kB]
3% [11 libxxf86dga1 13.7 kB/13.7 kB 100%] 3% [Waiting for headers] Get:12 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxxf86vm1 amd64 1:1.1.4-1 [10.6 kB]
3% [12 libxxf86vm1 4045 B/10.6 kB 38%] 3% [Waiting for headers] Get:13 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libatspi2.0-0 amd64 2.28.0-1 [59.6 kB]
3% [13 libatspi2.0-0 12.3 kB/59.6 kB 21%] 3% [Waiting for headers] Get:14 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxtst6 amd64 2:1.2.3-1 [12.8 kB]
3% [14 libxtst6 12.8 kB/12.8 kB 100%] 4% [Working] Get:15 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 at-spi2-core amd64 2.28.0-1 [47.9 kB]
4% [15 at-spi2-core 16.5 kB/47.9 kB 34%] 4% [Waiting for headers] Get:16 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 java-common all 0.68ubuntu1~18.04.1 [14.5 kB]
4% [16 java-common 8192 B/14.5 kB 56%] 4% [Working] Get:17 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libavahi-common-data amd64 0.7-3.1ubuntu1.2 [22.1 kB]
4% [17 libavahi-common-data 22.1 kB/22.1 kB 100%] 4% [Waiting for headers] Get:18 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libavahi-common3 amd64 0.7-3.1ubuntu1.2 [21.6 kB]
4% [18 libavahi-common3 20.5 kB/21.6 kB 95%] 5% [Waiting for headers] Get:19 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libavahi-client3 amd64 0.7-3.1ubuntu1.2 [25.2 kB]
5% [19 libavahi-client3 8559 B/25.2 kB 34%] 5% [Waiting for headers] Get:20 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libcups2 amd64 2.2.7-1ubuntu2.6 [211 kB]
5% [20 libcups2 12.3 kB/211 kB 6%] 5% [Waiting for headers] Get:21 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 liblcms2-2 amd64 2.9-1ubuntu0.1 [139 kB]
5% [21 liblcms2-2 10.8 kB/139 kB 8%] 5% [Waiting for headers] Get:22 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libjpeg8 amd64 8c-2ubuntu8 [2194 B]
6% [Working] Get:23 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libasound2-data all 1.1.3-5ubuntu0.2 [36.5 kB]
6% [23 libasound2-data 12.3 kB/36.5 kB 34%] 6% [Waiting for headers] Get:24 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libasound2 amd64 1.1.3-5ubuntu0.2 [359 kB]
6% [24 libasound2 12.3 kB/359 kB 3%] 6% [Waiting for headers] Get:25 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libpcsclite1 amd64 1.8.23-1 [21.3 kB]
6% [25 libpcsclite1 19.4 kB/21.3 kB 91%] 7% [Working] Get:26 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxi6 amd64 2:1.7.9-1 [29.2 kB]
7% [26 libxi6 12.3 kB/29.2 kB 42%] 7% [Waiting for headers] Get:27 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 openjdk-11-jre-headless amd64 11.0.4+11-1ubuntu2~18.04.3 [37.4 MB]
7% [27 openjdk-11-jre-headless 2409 B/37.4 MB 0%] 18% [Waiting for headers] Get:28 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 default-jre-headless amd64 2:1.11-68ubuntu1~18.04.1 [10.9 kB]
Get:29 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 ca-certificates-java all 20180516ubuntu1~18.04.1 [12.2 kB]
19% [29 ca-certificates-java 12.2 kB/12.2 kB 100%] 19% [Working] Get:30 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libglvnd0 amd64 1.0.0-2ubuntu2.3 [47.0 kB]
19% [30 libglvnd0 16.4 kB/47.0 kB 35%] 19% [Working] Get:31 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libglapi-mesa amd64 19.0.8-0ubuntu0~18.04.1 [25.1 kB]
19% [31 libglapi-mesa 25.1 kB/25.1 kB 100%] 19% [Working] Get:32 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libx11-xcb1 amd64 2:1.6.4-3ubuntu0.2 [9376 B]
19% [32 libx11-xcb1 9376 B/9376 B 100%] 20% [Working] Get:33 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-dri2-0 amd64 1.13-2~ubuntu18.04 [6920 B]
20% [33 libxcb-dri2-0 6920 B/6920 B 100%] 20% [Working] Get:34 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-dri3-0 amd64 1.13-2~ubuntu18.04 [6568 B]
20% [34 libxcb-dri3-0 6568 B/6568 B 100%] 20% [Waiting for headers] Get:35 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-glx0 amd64 1.13-2~ubuntu18.04 [22.1 kB]
20% [35 libxcb-glx0 22.1 kB/22.1 kB 100%] 20% [Waiting for headers] Get:36 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-present0 amd64 1.13-2~ubuntu18.04 [5552 B]
21% [Waiting for headers] Get:37 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-sync1 amd64 1.13-2~ubuntu18.04 [8808 B]
21% [37 libxcb-sync1 8808 B/8808 B 100%] 21% [Waiting for headers] Get:38 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxdamage1 amd64 1:1.1.4-3 [6934 B]
21% [38 libxdamage1 6934 B/6934 B 100%] 21% [Waiting for headers] Get:39 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxfixes3 amd64 1:5.0.3-1 [10.8 kB]
21% [39 libxfixes3 10.8 kB/10.8 kB 100%] 21% [Waiting for headers] Get:40 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxshmfence1 amd64 1.3-1 [5028 B]
21% [40 libxshmfence1 5028 B/5028 B 100%] 21% [Waiting for headers] Get:41 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libdrm-amdgpu1 amd64 2.4.97-1ubuntu1~18.04.1 [17.7 kB]
21% [41 libdrm-amdgpu1 10.4 kB/17.7 kB 59%] 22% [Waiting for headers] Get:42 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libpciaccess0 amd64 0.14-1 [17.9 kB]
22% [42 libpciaccess0 8047 B/17.9 kB 45%] 22% [Waiting for headers] Get:43 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libdrm-intel1 amd64 2.4.97-1ubuntu1~18.04.1 [59.9 kB]
22% [43 libdrm-intel1 12.3 kB/59.9 kB 20%] 22% [Waiting for headers] Get:44 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libdrm-nouveau2 amd64 2.4.97-1ubuntu1~18.04.1 [16.5 kB]
22% [44 libdrm-nouveau2 16.5 kB/16.5 kB 100%] 22% [Waiting for headers] Get:45 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libdrm-radeon1 amd64 2.4.97-1ubuntu1~18.04.1 [21.7 kB]
22% [45 libdrm-radeon1 8047 B/21.7 kB 37%] 23% [Waiting for headers] Get:46 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libllvm8 amd64 1:8-3~ubuntu18.04.1 [13.6 MB]
23% [46 libllvm8 5729 B/13.6 MB 0%] 27% [Waiting for headers] Get:47 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libsensors4 amd64 1:3.4.0-4 [28.8 kB]
27% [47 libsensors4 28.8 kB/28.8 kB 100%] 27% [Working] Get:48 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libgl1-mesa-dri amd64 19.0.8-0ubuntu0~18.04.1 [7499 kB]
27% [48 libgl1-mesa-dri 55.0 kB/7499 kB 1%] 30% [Waiting for headers] Get:49 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libglx-mesa0 amd64 19.0.8-0ubuntu0~18.04.1 [141 kB]
30% [49 libglx-mesa0 26.8 kB/141 kB 19%] 30% [Waiting for headers] Get:50 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libglx0 amd64 1.0.0-2ubuntu2.3 [28.1 kB]
30% [50 libglx0 16.1 kB/28.1 kB 57%] 30% [Working] Get:51 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libgl1 amd64 1.0.0-2ubuntu2.3 [86.2 kB]
30% [51 libgl1 53.1 kB/86.2 kB 62%] 31% [Waiting for headers] Get:52 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgif7 amd64 5.1.4-2 [30.6 kB]
31% [52 libgif7 30.6 kB/30.6 kB 100%] 31% [Working] Get:53 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 openjdk-11-jre amd64 11.0.4+11-1ubuntu2~18.04.3 [34.4 kB]
31% [53 openjdk-11-jre 34.4 kB/34.4 kB 100%] 31% [Working] Get:54 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 default-jre amd64 2:1.11-68ubuntu1~18.04.1 [1076 B]
31% [54 default-jre 1076 B/1076 B 100%] 31% [Waiting for headers] Get:55 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 openjdk-11-jdk-headless amd64 11.0.4+11-1ubuntu2~18.04.3 [191 MB]
31% [55 openjdk-11-jdk-headless 2408 B/191 MB 0%] 43% [55 openjdk-11-jdk-headless 36.7 MB/191 MB 19%] 56% [55 openjdk-11-jdk-headless 80.7 MB/191 MB 42%] 69% [55 openjdk-11-jdk-headless 125 MB/191 MB 65%] 83% [55 openjdk-11-jdk-headless 170 MB/191 MB 89%] 90% [55 openjdk-11-jdk-headless 191 MB/191 MB 100%] 90% [55 openjdk-11-jdk-headless 191 MB/191 MB 100%] 90% [55 openjdk-11-jdk-headless 191 MB/191 MB 100%] 90% [Waiting for headers] Get:56 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 default-jdk-headless amd64 2:1.11-68ubuntu1~18.04.1 [1132 B]
90% [Waiting for headers] Get:57 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 openjdk-11-jdk amd64 11.0.4+11-1ubuntu2~18.04.3 [2173 kB]
90% [57 openjdk-11-jdk 65.5 kB/2173 kB 3%] 91% [Waiting for headers] Get:58 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 default-jdk amd64 2:1.11-68ubuntu1~18.04.1 [1092 B]
91% [Waiting for headers] Get:59 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 fonts-dejavu-extra all 2.37-1 [1953 kB]
91% [59 fonts-dejavu-extra 58.4 kB/1953 kB 3%] 92% [Waiting for headers] Get:60 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libatk1.0-data all 2.28.1-1 [2992 B]
92% [Waiting for headers] Get:61 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libatk1.0-0 amd64 2.28.1-1 [43.9 kB]
92% [61 libatk1.0-0 43.9 kB/43.9 kB 100%] 93% [Working] Get:62 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libatk-bridge2.0-0 amd64 2.26.2-1 [57.3 kB]
93% [62 libatk-bridge2.0-0 23.7 kB/57.3 kB 41%] 93% [Waiting for headers] Get:63 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libfontenc1 amd64 1:1.1.3-1 [13.9 kB]
93% [63 libfontenc1 12.3 kB/13.9 kB 88%] 93% [Waiting for headers] Get:64 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxt6 amd64 1:1.1.5-1 [160 kB]
93% [64 libxt6 12.3 kB/160 kB 8%] 93% [Waiting for headers] Get:65 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxmu6 amd64 2:1.1.2-2 [46.0 kB]
93% [65 libxmu6 12.2 kB/46.0 kB 26%] 94% [Waiting for headers] Get:66 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxpm4 amd64 1:3.5.12-1 [34.0 kB]
94% [66 libxpm4 7274 B/34.0 kB 21%] 94% [Waiting for headers] Get:67 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxaw7 amd64 2:1.0.13-1 [173 kB]
94% [67 libxaw7 6634 B/173 kB 4%] 94% [Waiting for headers] Get:68 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-shape0 amd64 1.13-2~ubuntu18.04 [5972 B]
94% [68 libxcb-shape0 5972 B/5972 B 100%] 94% [Waiting for headers] Get:69 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxcomposite1 amd64 1:0.4.4-2 [6988 B]
94% [69 libxcomposite1 6988 B/6988 B 100%] 95% [Waiting for headers] Get:70 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxrandr2 amd64 2:1.5.1-1 [18.1 kB]
95% [70 libxrandr2 12.3 kB/18.1 kB 68%] 95% [Waiting for headers] Get:71 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxv1 amd64 2:1.0.11-1 [10.7 kB]
95% [71 libxv1 10.7 kB/10.7 kB 100%] 95% [Waiting for headers] Get:72 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 x11-utils amd64 7.7+3build1 [196 kB]
95% [72 x11-utils 12.3 kB/196 kB 6%] 95% [Waiting for headers] Get:73 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libatk-wrapper-java all 0.33.3-20ubuntu0.1 [34.7 kB]
95% [73 libatk-wrapper-java 10.9 kB/34.7 kB 31%] 96% [Waiting for headers] Get:74 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libatk-wrapper-java-jni amd64 0.33.3-20ubuntu0.1 [28.3 kB]
96% [74 libatk-wrapper-java-jni 3820 B/28.3 kB 14%] 96% [Waiting for headers] Get:75 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 xorg-sgml-doctools all 1:1.11-1 [12.9 kB]
96% [75 xorg-sgml-doctools 10.9 kB/12.9 kB 84%] 96% [Waiting for headers] Get:76 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 x11proto-dev all 2018.4-4 [251 kB]
96% [76 x11proto-dev 3821 B/251 kB 2%] 96% [Waiting for headers] Get:77 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 x11proto-core-dev all 2018.4-4 [2620 B]
96% [77 x11proto-core-dev 2620 B/2620 B 100%] 97% [Working] Get:78 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libice-dev amd64 2:1.0.9-2 [46.8 kB]
97% [78 libice-dev 14.7 kB/46.8 kB 32%] 97% [Waiting for headers] Get:79 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libpthread-stubs0-dev amd64 0.3-4 [4068 B]
97% [79 libpthread-stubs0-dev 4068 B/4068 B 100%] 97% [Waiting for headers] Get:80 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libsm-dev amd64 2:1.2.2-1 [16.2 kB]
97% [80 libsm-dev 12.3 kB/16.2 kB 76%] 97% [Waiting for headers] Get:81 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxau-dev amd64 1:1.0.8-1 [11.1 kB]
97% [81 libxau-dev 11.1 kB/11.1 kB 100%] 98% [Waiting for headers] Get:82 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxdmcp-dev amd64 1:1.1.2-3 [25.1 kB]
98% [82 libxdmcp-dev 12.3 kB/25.1 kB 49%] 98% [Waiting for headers] Get:83 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 xtrans-dev all 1.3.5-1 [70.5 kB]
98% [83 xtrans-dev 12.3 kB/70.5 kB 17%] 98% [Working] Get:84 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb1-dev amd64 1.13-2~ubuntu18.04 [80.0 kB]
98% [84 libxcb1-dev 12.2 kB/80.0 kB 15%] 98% [Waiting for headers] Get:85 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libx11-dev amd64 2:1.6.4-3ubuntu0.2 [640 kB]
98% [85 libx11-dev 20.3 kB/640 kB 3%] 99% [Waiting for headers] Get:86 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libx11-doc all 2:1.6.4-3ubuntu0.2 [2065 kB]
99% [86 libx11-doc 35.2 kB/2065 kB 2%] 100% [Waiting for headers] Get:87 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxt-dev amd64 1:1.1.5-1 [395 kB]
100% [87 libxt-dev 65.5 kB/395 kB 17%] 100% [Working] Fetched 261 MB in 5s (54.6 MB/s)
Extracting templates from packages: 34% Extracting templates from packages: 68% Extracting templates from packages: 100%
Selecting previously unselected package libjpeg-turbo8:amd64.
(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 67588 files and directories currently installed.)
Preparing to unpack .../00-libjpeg-turbo8_1.5.2-0ubuntu5.18.04.1_amd64.deb ...
Unpacking libjpeg-turbo8:amd64 (1.5.2-0ubuntu5.18.04.1) ...
Selecting previously unselected package x11-common.
Preparing to unpack .../01-x11-common_1%3a7.7+19ubuntu7.1_all.deb ...
dpkg-query: no packages found matching nux-tools
Unpacking x11-common (1:7.7+19ubuntu7.1) ...
Selecting previously unselected package libice6:amd64.
Preparing to unpack .../02-libice6_2%3a1.0.9-2_amd64.deb ...
Unpacking libice6:amd64 (2:1.0.9-2) ...
Selecting previously unselected package libsm6:amd64.
Preparing to unpack .../03-libsm6_2%3a1.2.2-1_amd64.deb ...
Unpacking libsm6:amd64 (2:1.2.2-1) ...
Selecting previously unselected package fonts-dejavu-core.
Preparing to unpack .../04-fonts-dejavu-core_2.37-1_all.deb ...
Unpacking fonts-dejavu-core (2.37-1) ...
Selecting previously unselected package fontconfig-config.
Preparing to unpack .../05-fontconfig-config_2.12.6-0ubuntu2_all.deb ...
Unpacking fontconfig-config (2.12.6-0ubuntu2) ...
Selecting previously unselected package libfontconfig1:amd64.
Preparing to unpack .../06-libfontconfig1_2.12.6-0ubuntu2_amd64.deb ...
Unpacking libfontconfig1:amd64 (2.12.6-0ubuntu2) ...
Selecting previously unselected package libxrender1:amd64.
Preparing to unpack .../07-libxrender1_1%3a0.9.10-1_amd64.deb ...
Unpacking libxrender1:amd64 (1:0.9.10-1) ...
Selecting previously unselected package libxft2:amd64.
Preparing to unpack .../08-libxft2_2.3.2-1_amd64.deb ...
Unpacking libxft2:amd64 (2.3.2-1) ...
Selecting previously unselected package libxinerama1:amd64.
Preparing to unpack .../09-libxinerama1_2%3a1.1.3-1_amd64.deb ...
Unpacking libxinerama1:amd64 (2:1.1.3-1) ...
Selecting previously unselected package libxxf86dga1:amd64.
Preparing to unpack .../10-libxxf86dga1_2%3a1.1.4-1_amd64.deb ...
Unpacking libxxf86dga1:amd64 (2:1.1.4-1) ...
Selecting previously unselected package libxxf86vm1:amd64.
Preparing to unpack .../11-libxxf86vm1_1%3a1.1.4-1_amd64.deb ...
Unpacking libxxf86vm1:amd64 (1:1.1.4-1) ...
Selecting previously unselected package libatspi2.0-0:amd64.
Preparing to unpack .../12-libatspi2.0-0_2.28.0-1_amd64.deb ...
Unpacking libatspi2.0-0:amd64 (2.28.0-1) ...
Selecting previously unselected package libxtst6:amd64.
Preparing to unpack .../13-libxtst6_2%3a1.2.3-1_amd64.deb ...
Unpacking libxtst6:amd64 (2:1.2.3-1) ...
Selecting previously unselected package at-spi2-core.
Preparing to unpack .../14-at-spi2-core_2.28.0-1_amd64.deb ...
Unpacking at-spi2-core (2.28.0-1) ...
Selecting previously unselected package java-common.
Preparing to unpack .../15-java-common_0.68ubuntu1~18.04.1_all.deb ...
Unpacking java-common (0.68ubuntu1~18.04.1) ...
Selecting previously unselected package libavahi-common-data:amd64.
Preparing to unpack .../16-libavahi-common-data_0.7-3.1ubuntu1.2_amd64.deb ...
Unpacking libavahi-common-data:amd64 (0.7-3.1ubuntu1.2) ...
Selecting previously unselected package libavahi-common3:amd64.
Preparing to unpack .../17-libavahi-common3_0.7-3.1ubuntu1.2_amd64.deb ...
Unpacking libavahi-common3:amd64 (0.7-3.1ubuntu1.2) ...
Selecting previously unselected package libavahi-client3:amd64.
Preparing to unpack .../18-libavahi-client3_0.7-3.1ubuntu1.2_amd64.deb ...
Unpacking libavahi-client3:amd64 (0.7-3.1ubuntu1.2) ...
Selecting previously unselected package libcups2:amd64.
Preparing to unpack .../19-libcups2_2.2.7-1ubuntu2.6_amd64.deb ...
Unpacking libcups2:amd64 (2.2.7-1ubuntu2.6) ...
Selecting previously unselected package liblcms2-2:amd64.
Preparing to unpack .../20-liblcms2-2_2.9-1ubuntu0.1_amd64.deb ...
Unpacking liblcms2-2:amd64 (2.9-1ubuntu0.1) ...
Selecting previously unselected package libjpeg8:amd64.
Preparing to unpack .../21-libjpeg8_8c-2ubuntu8_amd64.deb ...
Unpacking libjpeg8:amd64 (8c-2ubuntu8) ...
Selecting previously unselected package libasound2-data.
Preparing to unpack .../22-libasound2-data_1.1.3-5ubuntu0.2_all.deb ...
Unpacking libasound2-data (1.1.3-5ubuntu0.2) ...
Selecting previously unselected package libasound2:amd64.
Preparing to unpack .../23-libasound2_1.1.3-5ubuntu0.2_amd64.deb ...
Unpacking libasound2:amd64 (1.1.3-5ubuntu0.2) ...
Selecting previously unselected package libpcsclite1:amd64.
Preparing to unpack .../24-libpcsclite1_1.8.23-1_amd64.deb ...
Unpacking libpcsclite1:amd64 (1.8.23-1) ...
Selecting previously unselected package libxi6:amd64.
Preparing to unpack .../25-libxi6_2%3a1.7.9-1_amd64.deb ...
Unpacking libxi6:amd64 (2:1.7.9-1) ...
Selecting previously unselected package openjdk-11-jre-headless:amd64.
Preparing to unpack .../26-openjdk-11-jre-headless_11.0.4+11-1ubuntu2~18.04.3_amd64.deb ...
Unpacking openjdk-11-jre-headless:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
Selecting previously unselected package default-jre-headless.
Preparing to unpack .../27-default-jre-headless_2%3a1.11-68ubuntu1~18.04.1_amd64.deb ...
Unpacking default-jre-headless (2:1.11-68ubuntu1~18.04.1) ...
Selecting previously unselected package ca-certificates-java.
Preparing to unpack .../28-ca-certificates-java_20180516ubuntu1~18.04.1_all.deb ...
Unpacking ca-certificates-java (20180516ubuntu1~18.04.1) ...
Selecting previously unselected package libglvnd0:amd64.
Preparing to unpack .../29-libglvnd0_1.0.0-2ubuntu2.3_amd64.deb ...
Unpacking libglvnd0:amd64 (1.0.0-2ubuntu2.3) ...
Selecting previously unselected package libglapi-mesa:amd64.
Preparing to unpack .../30-libglapi-mesa_19.0.8-0ubuntu0~18.04.1_amd64.deb ...
Unpacking libglapi-mesa:amd64 (19.0.8-0ubuntu0~18.04.1) ...
Selecting previously unselected package libx11-xcb1:amd64.
Preparing to unpack .../31-libx11-xcb1_2%3a1.6.4-3ubuntu0.2_amd64.deb ...
Unpacking libx11-xcb1:amd64 (2:1.6.4-3ubuntu0.2) ...
Selecting previously unselected package libxcb-dri2-0:amd64.
Preparing to unpack .../32-libxcb-dri2-0_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb-dri2-0:amd64 (1.13-2~ubuntu18.04) ...
Selecting previously unselected package libxcb-dri3-0:amd64.
Preparing to unpack .../33-libxcb-dri3-0_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb-dri3-0:amd64 (1.13-2~ubuntu18.04) ...
Selecting previously unselected package libxcb-glx0:amd64.
Preparing to unpack .../34-libxcb-glx0_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb-glx0:amd64 (1.13-2~ubuntu18.04) ...
Selecting previously unselected package libxcb-present0:amd64.
Preparing to unpack .../35-libxcb-present0_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb-present0:amd64 (1.13-2~ubuntu18.04) ...
Selecting previously unselected package libxcb-sync1:amd64.
Preparing to unpack .../36-libxcb-sync1_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb-sync1:amd64 (1.13-2~ubuntu18.04) ...
Selecting previously unselected package libxdamage1:amd64.
Preparing to unpack .../37-libxdamage1_1%3a1.1.4-3_amd64.deb ...
Unpacking libxdamage1:amd64 (1:1.1.4-3) ...
Selecting previously unselected package libxfixes3:amd64.
Preparing to unpack .../38-libxfixes3_1%3a5.0.3-1_amd64.deb ...
Unpacking libxfixes3:amd64 (1:5.0.3-1) ...
Selecting previously unselected package libxshmfence1:amd64.
Preparing to unpack .../39-libxshmfence1_1.3-1_amd64.deb ...
Unpacking libxshmfence1:amd64 (1.3-1) ...
Selecting previously unselected package libdrm-amdgpu1:amd64.
Preparing to unpack .../40-libdrm-amdgpu1_2.4.97-1ubuntu1~18.04.1_amd64.deb ...
Unpacking libdrm-amdgpu1:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Selecting previously unselected package libpciaccess0:amd64.
Preparing to unpack .../41-libpciaccess0_0.14-1_amd64.deb ...
Unpacking libpciaccess0:amd64 (0.14-1) ...
Selecting previously unselected package libdrm-intel1:amd64.
Preparing to unpack .../42-libdrm-intel1_2.4.97-1ubuntu1~18.04.1_amd64.deb ...
Unpacking libdrm-intel1:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Selecting previously unselected package libdrm-nouveau2:amd64.
Preparing to unpack .../43-libdrm-nouveau2_2.4.97-1ubuntu1~18.04.1_amd64.deb ...
Unpacking libdrm-nouveau2:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Selecting previously unselected package libdrm-radeon1:amd64.
Preparing to unpack .../44-libdrm-radeon1_2.4.97-1ubuntu1~18.04.1_amd64.deb ...
Unpacking libdrm-radeon1:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Selecting previously unselected package libllvm8:amd64.
Preparing to unpack .../45-libllvm8_1%3a8-3~ubuntu18.04.1_amd64.deb ...
Unpacking libllvm8:amd64 (1:8-3~ubuntu18.04.1) ...
Selecting previously unselected package libsensors4:amd64.
Preparing to unpack .../46-libsensors4_1%3a3.4.0-4_amd64.deb ...
Unpacking libsensors4:amd64 (1:3.4.0-4) ...
Selecting previously unselected package libgl1-mesa-dri:amd64.
Preparing to unpack .../47-libgl1-mesa-dri_19.0.8-0ubuntu0~18.04.1_amd64.deb ...
Unpacking libgl1-mesa-dri:amd64 (19.0.8-0ubuntu0~18.04.1) ...
Selecting previously unselected package libglx-mesa0:amd64.
Preparing to unpack .../48-libglx-mesa0_19.0.8-0ubuntu0~18.04.1_amd64.deb ...
Unpacking libglx-mesa0:amd64 (19.0.8-0ubuntu0~18.04.1) ...
Selecting previously unselected package libglx0:amd64.
Preparing to unpack .../49-libglx0_1.0.0-2ubuntu2.3_amd64.deb ...
Unpacking libglx0:amd64 (1.0.0-2ubuntu2.3) ...
Selecting previously unselected package libgl1:amd64.
Preparing to unpack .../50-libgl1_1.0.0-2ubuntu2.3_amd64.deb ...
Unpacking libgl1:amd64 (1.0.0-2ubuntu2.3) ...
Selecting previously unselected package libgif7:amd64.
Preparing to unpack .../51-libgif7_5.1.4-2_amd64.deb ...
Unpacking libgif7:amd64 (5.1.4-2) ...
Selecting previously unselected package openjdk-11-jre:amd64.
Preparing to unpack .../52-openjdk-11-jre_11.0.4+11-1ubuntu2~18.04.3_amd64.deb ...
Unpacking openjdk-11-jre:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
Selecting previously unselected package default-jre.
Preparing to unpack .../53-default-jre_2%3a1.11-68ubuntu1~18.04.1_amd64.deb ...
Unpacking default-jre (2:1.11-68ubuntu1~18.04.1) ...
Selecting previously unselected package openjdk-11-jdk-headless:amd64.
Preparing to unpack .../54-openjdk-11-jdk-headless_11.0.4+11-1ubuntu2~18.04.3_amd64.deb ...
Unpacking openjdk-11-jdk-headless:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
Selecting previously unselected package default-jdk-headless.
Preparing to unpack .../55-default-jdk-headless_2%3a1.11-68ubuntu1~18.04.1_amd64.deb ...
Unpacking default-jdk-headless (2:1.11-68ubuntu1~18.04.1) ...
Selecting previously unselected package openjdk-11-jdk:amd64.
Preparing to unpack .../56-openjdk-11-jdk_11.0.4+11-1ubuntu2~18.04.3_amd64.deb ...
Unpacking openjdk-11-jdk:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
Selecting previously unselected package default-jdk.
Preparing to unpack .../57-default-jdk_2%3a1.11-68ubuntu1~18.04.1_amd64.deb ...
Unpacking default-jdk (2:1.11-68ubuntu1~18.04.1) ...
Selecting previously unselected package fonts-dejavu-extra.
Preparing to unpack .../58-fonts-dejavu-extra_2.37-1_all.deb ...
Unpacking fonts-dejavu-extra (2.37-1) ...
Selecting previously unselected package libatk1.0-data.
Preparing to unpack .../59-libatk1.0-data_2.28.1-1_all.deb ...
Unpacking libatk1.0-data (2.28.1-1) ...
Selecting previously unselected package libatk1.0-0:amd64.
Preparing to unpack .../60-libatk1.0-0_2.28.1-1_amd64.deb ...
Unpacking libatk1.0-0:amd64 (2.28.1-1) ...
Selecting previously unselected package libatk-bridge2.0-0:amd64.
Preparing to unpack .../61-libatk-bridge2.0-0_2.26.2-1_amd64.deb ...
Unpacking libatk-bridge2.0-0:amd64 (2.26.2-1) ...
Selecting previously unselected package libfontenc1:amd64.
Preparing to unpack .../62-libfontenc1_1%3a1.1.3-1_amd64.deb ...
Unpacking libfontenc1:amd64 (1:1.1.3-1) ...
Selecting previously unselected package libxt6:amd64.
Preparing to unpack .../63-libxt6_1%3a1.1.5-1_amd64.deb ...
Unpacking libxt6:amd64 (1:1.1.5-1) ...
Selecting previously unselected package libxmu6:amd64.
Preparing to unpack .../64-libxmu6_2%3a1.1.2-2_amd64.deb ...
Unpacking libxmu6:amd64 (2:1.1.2-2) ...
Selecting previously unselected package libxpm4:amd64.
Preparing to unpack .../65-libxpm4_1%3a3.5.12-1_amd64.deb ...
Unpacking libxpm4:amd64 (1:3.5.12-1) ...
Selecting previously unselected package libxaw7:amd64.
Preparing to unpack .../66-libxaw7_2%3a1.0.13-1_amd64.deb ...
Unpacking libxaw7:amd64 (2:1.0.13-1) ...
Selecting previously unselected package libxcb-shape0:amd64.
Preparing to unpack .../67-libxcb-shape0_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb-shape0:amd64 (1.13-2~ubuntu18.04) ...
Selecting previously unselected package libxcomposite1:amd64.
Preparing to unpack .../68-libxcomposite1_1%3a0.4.4-2_amd64.deb ...
Unpacking libxcomposite1:amd64 (1:0.4.4-2) ...
Selecting previously unselected package libxrandr2:amd64.
Preparing to unpack .../69-libxrandr2_2%3a1.5.1-1_amd64.deb ...
Unpacking libxrandr2:amd64 (2:1.5.1-1) ...
Selecting previously unselected package libxv1:amd64.
Preparing to unpack .../70-libxv1_2%3a1.0.11-1_amd64.deb ...
Unpacking libxv1:amd64 (2:1.0.11-1) ...
Selecting previously unselected package x11-utils.
Preparing to unpack .../71-x11-utils_7.7+3build1_amd64.deb ...
Unpacking x11-utils (7.7+3build1) ...
Selecting previously unselected package libatk-wrapper-java.
Preparing to unpack .../72-libatk-wrapper-java_0.33.3-20ubuntu0.1_all.deb ...
Unpacking libatk-wrapper-java (0.33.3-20ubuntu0.1) ...
Selecting previously unselected package libatk-wrapper-java-jni:amd64.
Preparing to unpack .../73-libatk-wrapper-java-jni_0.33.3-20ubuntu0.1_amd64.deb ...
Unpacking libatk-wrapper-java-jni:amd64 (0.33.3-20ubuntu0.1) ...
Selecting previously unselected package xorg-sgml-doctools.
Preparing to unpack .../74-xorg-sgml-doctools_1%3a1.11-1_all.deb ...
Unpacking xorg-sgml-doctools (1:1.11-1) ...
Selecting previously unselected package x11proto-dev.
Preparing to unpack .../75-x11proto-dev_2018.4-4_all.deb ...
Unpacking x11proto-dev (2018.4-4) ...
Selecting previously unselected package x11proto-core-dev.
Preparing to unpack .../76-x11proto-core-dev_2018.4-4_all.deb ...
Unpacking x11proto-core-dev (2018.4-4) ...
Selecting previously unselected package libice-dev:amd64.
Preparing to unpack .../77-libice-dev_2%3a1.0.9-2_amd64.deb ...
Unpacking libice-dev:amd64 (2:1.0.9-2) ...
Selecting previously unselected package libpthread-stubs0-dev:amd64.
Preparing to unpack .../78-libpthread-stubs0-dev_0.3-4_amd64.deb ...
Unpacking libpthread-stubs0-dev:amd64 (0.3-4) ...
Selecting previously unselected package libsm-dev:amd64.
Preparing to unpack .../79-libsm-dev_2%3a1.2.2-1_amd64.deb ...
Unpacking libsm-dev:amd64 (2:1.2.2-1) ...
Selecting previously unselected package libxau-dev:amd64.
Preparing to unpack .../80-libxau-dev_1%3a1.0.8-1_amd64.deb ...
Unpacking libxau-dev:amd64 (1:1.0.8-1) ...
Selecting previously unselected package libxdmcp-dev:amd64.
Preparing to unpack .../81-libxdmcp-dev_1%3a1.1.2-3_amd64.deb ...
Unpacking libxdmcp-dev:amd64 (1:1.1.2-3) ...
Selecting previously unselected package xtrans-dev.
Preparing to unpack .../82-xtrans-dev_1.3.5-1_all.deb ...
Unpacking xtrans-dev (1.3.5-1) ...
Selecting previously unselected package libxcb1-dev:amd64.
Preparing to unpack .../83-libxcb1-dev_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb1-dev:amd64 (1.13-2~ubuntu18.04) ...
Selecting previously unselected package libx11-dev:amd64.
Preparing to unpack .../84-libx11-dev_2%3a1.6.4-3ubuntu0.2_amd64.deb ...
Unpacking libx11-dev:amd64 (2:1.6.4-3ubuntu0.2) ...
Selecting previously unselected package libx11-doc.
Preparing to unpack .../85-libx11-doc_2%3a1.6.4-3ubuntu0.2_all.deb ...
Unpacking libx11-doc (2:1.6.4-3ubuntu0.2) ...
Selecting previously unselected package libxt-dev:amd64.
Preparing to unpack .../86-libxt-dev_1%3a1.1.5-1_amd64.deb ...
Unpacking libxt-dev:amd64 (1:1.1.5-1) ...
Setting up libxi6:amd64 (2:1.7.9-1) ...
Setting up libxcb-present0:amd64 (1.13-2~ubuntu18.04) ...
Setting up libglvnd0:amd64 (1.0.0-2ubuntu2.3) ...
Setting up libxinerama1:amd64 (2:1.1.3-1) ...
Setting up libxcb-dri2-0:amd64 (1.13-2~ubuntu18.04) ...
Setting up libxcb-dri3-0:amd64 (1.13-2~ubuntu18.04) ...
Setting up libxcb-glx0:amd64 (1.13-2~ubuntu18.04) ...
Setting up libllvm8:amd64 (1:8-3~ubuntu18.04.1) ...
Setting up libxdamage1:amd64 (1:1.1.4-3) ...
Setting up libxfixes3:amd64 (1:5.0.3-1) ...
Processing triggers for mime-support (3.60ubuntu1) ...
Processing triggers for ureadahead (0.100.0-21) ...
Setting up libdrm-amdgpu1:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Setting up liblcms2-2:amd64 (2.9-1ubuntu0.1) ...
Setting up libpcsclite1:amd64 (1.8.23-1) ...
Setting up libpthread-stubs0-dev:amd64 (0.3-4) ...
Setting up fonts-dejavu-core (2.37-1) ...
Setting up libatspi2.0-0:amd64 (2.28.0-1) ...
Setting up libasound2-data (1.1.3-5ubuntu0.2) ...
Setting up libxshmfence1:amd64 (1.3-1) ...
Setting up xorg-sgml-doctools (1:1.11-1) ...
Setting up java-common (0.68ubuntu1~18.04.1) ...
Setting up libgif7:amd64 (5.1.4-2) ...
Setting up libjpeg-turbo8:amd64 (1.5.2-0ubuntu5.18.04.1) ...
Setting up libglapi-mesa:amd64 (19.0.8-0ubuntu0~18.04.1) ...
Setting up x11proto-dev (2018.4-4) ...
Setting up libasound2:amd64 (1.1.3-5ubuntu0.2) ...
Setting up libxcb-sync1:amd64 (1.13-2~ubuntu18.04) ...
Setting up libatk1.0-data (2.28.1-1) ...
Setting up libx11-xcb1:amd64 (2:1.6.4-3ubuntu0.2) ...
Setting up xtrans-dev (1.3.5-1) ...
Setting up libxdmcp-dev:amd64 (1:1.1.2-3) ...
Setting up libxxf86dga1:amd64 (2:1.1.4-1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Setting up libatk1.0-0:amd64 (2.28.1-1) ...
Processing triggers for systemd (237-3ubuntu10.24) ...
Setting up libatk-bridge2.0-0:amd64 (2.26.2-1) ...
Setting up libfontenc1:amd64 (1:1.1.3-1) ...
Setting up libxcomposite1:amd64 (1:0.4.4-2) ...
Setting up libxpm4:amd64 (1:3.5.12-1) ...
Setting up libx11-doc (2:1.6.4-3ubuntu0.2) ...
Setting up libxcb-shape0:amd64 (1.13-2~ubuntu18.04) ...
Setting up libpciaccess0:amd64 (0.14-1) ...
Setting up libxrender1:amd64 (1:0.9.10-1) ...
Setting up libxv1:amd64 (2:1.0.11-1) ...
Setting up libsensors4:amd64 (1:3.4.0-4) ...
Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
Setting up libdrm-radeon1:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Setting up libxxf86vm1:amd64 (1:1.1.4-1) ...
Setting up libdrm-nouveau2:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Setting up fonts-dejavu-extra (2.37-1) ...
Setting up x11-common (1:7.7+19ubuntu7.1) ...
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
Processing triggers for ca-certificates (20180409) ...
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
Setting up libxrandr2:amd64 (2:1.5.1-1) ...
Setting up libavahi-common-data:amd64 (0.7-3.1ubuntu1.2) ...
Setting up libjpeg8:amd64 (8c-2ubuntu8) ...
Setting up fontconfig-config (2.12.6-0ubuntu2) ...
Setting up x11proto-core-dev (2018.4-4) ...
Setting up libxau-dev:amd64 (1:1.0.8-1) ...
Setting up libxtst6:amd64 (2:1.2.3-1) ...
Setting up libdrm-intel1:amd64 (2.4.97-1ubuntu1~18.04.1) ...
Setting up libice6:amd64 (2:1.0.9-2) ...
Setting up libxcb1-dev:amd64 (1.13-2~ubuntu18.04) ...
Setting up libavahi-common3:amd64 (0.7-3.1ubuntu1.2) ...
Setting up libx11-dev:amd64 (2:1.6.4-3ubuntu0.2) ...
Setting up libfontconfig1:amd64 (2.12.6-0ubuntu2) ...
Setting up libsm6:amd64 (2:1.2.2-1) ...
Setting up at-spi2-core (2.28.0-1) ...
Setting up libgl1-mesa-dri:amd64 (19.0.8-0ubuntu0~18.04.1) ...
Setting up libice-dev:amd64 (2:1.0.9-2) ...
Setting up libxt6:amd64 (1:1.1.5-1) ...
Setting up libavahi-client3:amd64 (0.7-3.1ubuntu1.2) ...
Setting up libxft2:amd64 (2.3.2-1) ...
Setting up libglx-mesa0:amd64 (19.0.8-0ubuntu0~18.04.1) ...
Setting up libcups2:amd64 (2.2.7-1ubuntu2.6) ...
Setting up libsm-dev:amd64 (2:1.2.2-1) ...
Setting up libxmu6:amd64 (2:1.1.2-2) ...
Setting up libglx0:amd64 (1.0.0-2ubuntu2.3) ...
Setting up libxaw7:amd64 (2:1.0.13-1) ...
Setting up libxt-dev:amd64 (1:1.1.5-1) ...
Setting up libgl1:amd64 (1.0.0-2ubuntu2.3) ...
Setting up x11-utils (7.7+3build1) ...
Setting up libatk-wrapper-java (0.33.3-20ubuntu0.1) ...
Setting up libatk-wrapper-java-jni:amd64 (0.33.3-20ubuntu0.1) ...
Setting up openjdk-11-jre-headless:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/rmid to provide /usr/bin/rmid (rmid) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/java to provide /usr/bin/java (java) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/keytool to provide /usr/bin/keytool (keytool) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jjs to provide /usr/bin/jjs (jjs) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/pack200 to provide /usr/bin/pack200 (pack200) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/rmiregistry to provide /usr/bin/rmiregistry (rmiregistry) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/unpack200 to provide /usr/bin/unpack200 (unpack200) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/lib/jexec to provide /usr/bin/jexec (jexec) in auto mode
Setting up openjdk-11-jdk-headless:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jar to provide /usr/bin/jar (jar) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jarsigner to provide /usr/bin/jarsigner (jarsigner) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/javac to provide /usr/bin/javac (javac) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/javadoc to provide /usr/bin/javadoc (javadoc) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/javap to provide /usr/bin/javap (javap) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jcmd to provide /usr/bin/jcmd (jcmd) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jdb to provide /usr/bin/jdb (jdb) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jdeprscan to provide /usr/bin/jdeprscan (jdeprscan) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jdeps to provide /usr/bin/jdeps (jdeps) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jimage to provide /usr/bin/jimage (jimage) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jinfo to provide /usr/bin/jinfo (jinfo) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jlink to provide /usr/bin/jlink (jlink) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jmap to provide /usr/bin/jmap (jmap) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jmod to provide /usr/bin/jmod (jmod) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jps to provide /usr/bin/jps (jps) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jrunscript to provide /usr/bin/jrunscript (jrunscript) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jshell to provide /usr/bin/jshell (jshell) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jstack to provide /usr/bin/jstack (jstack) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jstat to provide /usr/bin/jstat (jstat) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jstatd to provide /usr/bin/jstatd (jstatd) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/rmic to provide /usr/bin/rmic (rmic) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/serialver to provide /usr/bin/serialver (serialver) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jaotc to provide /usr/bin/jaotc (jaotc) in auto mode
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jhsdb to provide /usr/bin/jhsdb (jhsdb) in auto mode
Setting up default-jre-headless (2:1.11-68ubuntu1~18.04.1) ...
Setting up default-jdk-headless (2:1.11-68ubuntu1~18.04.1) ...
Setting up openjdk-11-jre:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
Setting up ca-certificates-java (20180516ubuntu1~18.04.1) ...
head: cannot open '/etc/ssl/certs/java/cacerts' for reading: No such file or directory
Adding debian:Amazon_Root_CA_3.pem
Adding debian:AffirmTrust_Premium.pem
Adding debian:QuoVadis_Root_CA_2.pem
Adding debian:SSL.com_Root_Certification_Authority_RSA.pem
Adding debian:TUBITAK_Kamu_SM_SSL_Kok_Sertifikasi_-_Surum_1.pem
Adding debian:Security_Communication_Root_CA.pem
Adding debian:Buypass_Class_3_Root_CA.pem
Adding debian:ACCVRAIZ1.pem
Adding debian:EC-ACC.pem
Adding debian:GDCA_TrustAUTH_R5_ROOT.pem
Adding debian:E-Tugra_Certification_Authority.pem
Adding debian:Hongkong_Post_Root_CA_1.pem
Adding debian:DigiCert_Assured_ID_Root_G2.pem
Adding debian:QuoVadis_Root_CA_3_G3.pem
Adding debian:Hellenic_Academic_and_Research_Institutions_RootCA_2011.pem
Adding debian:LuxTrust_Global_Root_2.pem
Adding debian:COMODO_RSA_Certification_Authority.pem
Adding debian:AC_RAIZ_FNMT-RCM.pem
Adding debian:CFCA_EV_ROOT.pem
Adding debian:OISTE_WISeKey_Global_Root_GA_CA.pem
Adding debian:TrustCor_RootCert_CA-2.pem
Adding debian:Certigna.pem
Adding debian:TÜRKTRUST_Elektronik_Sertifika_Hizmet_Sağlayıcısı_H5.pem
Adding debian:Deutsche_Telekom_Root_CA_2.pem
Adding debian:COMODO_Certification_Authority.pem
Adding debian:T-TeleSec_GlobalRoot_Class_3.pem
Adding debian:VeriSign_Class_3_Public_Primary_Certification_Authority_-_G5.pem
Adding debian:Starfield_Root_Certificate_Authority_-_G2.pem
Adding debian:GeoTrust_Primary_Certification_Authority_-_G3.pem
Adding debian:SwissSign_Gold_CA_-_G2.pem
Adding debian:USERTrust_RSA_Certification_Authority.pem
Adding debian:DigiCert_Global_Root_CA.pem
Adding debian:GlobalSign_Root_CA_-_R3.pem
Adding debian:SwissSign_Silver_CA_-_G2.pem
Adding debian:DigiCert_High_Assurance_EV_Root_CA.pem
Adding debian:GeoTrust_Global_CA.pem
Adding debian:Entrust.net_Premium_2048_Secure_Server_CA.pem
Adding debian:USERTrust_ECC_Certification_Authority.pem
Adding debian:Certplus_Root_CA_G2.pem
Adding debian:GlobalSign_Root_CA.pem
Adding debian:GlobalSign_ECC_Root_CA_-_R4.pem
Adding debian:TWCA_Global_Root_CA.pem
Adding debian:Go_Daddy_Root_Certificate_Authority_-_G2.pem
Adding debian:Network_Solutions_Certificate_Authority.pem
Adding debian:SSL.com_Root_Certification_Authority_ECC.pem
Adding debian:Certinomis_-_Root_CA.pem
Adding debian:Starfield_Services_Root_Certificate_Authority_-_G2.pem
Adding debian:thawte_Primary_Root_CA.pem
Adding debian:Actalis_Authentication_Root_CA.pem
Adding debian:COMODO_ECC_Certification_Authority.pem
Adding debian:TWCA_Root_Certification_Authority.pem
Adding debian:Autoridad_de_Certificacion_Firmaprofesional_CIF_A62634068.pem
Adding debian:OpenTrust_Root_CA_G1.pem
Adding debian:Visa_eCommerce_Root.pem
Adding debian:D-TRUST_Root_Class_3_CA_2_EV_2009.pem
Adding debian:Security_Communication_RootCA2.pem
Adding debian:thawte_Primary_Root_CA_-_G2.pem
Adding debian:DigiCert_Global_Root_G3.pem
Adding debian:AffirmTrust_Networking.pem
Adding debian:Microsec_e-Szigno_Root_CA_2009.pem
Adding debian:Amazon_Root_CA_1.pem
Adding debian:Hellenic_Academic_and_Research_Institutions_ECC_RootCA_2015.pem
Adding debian:Atos_TrustedRoot_2011.pem
Adding debian:TrustCor_ECA-1.pem
Adding debian:QuoVadis_Root_CA_3.pem
Adding debian:Sonera_Class_2_Root_CA.pem
Adding debian:OpenTrust_Root_CA_G3.pem
Adding debian:Global_Chambersign_Root_-_2008.pem
Adding debian:SZAFIR_ROOT_CA2.pem
Adding debian:Trustis_FPS_Root_CA.pem
Adding debian:certSIGN_ROOT_CA.pem
Adding debian:GlobalSign_ECC_Root_CA_-_R5.pem
Adding debian:DigiCert_Trusted_Root_G4.pem
Adding debian:QuoVadis_Root_CA.pem
Adding debian:VeriSign_Universal_Root_Certification_Authority.pem
Adding debian:XRamp_Global_CA_Root.pem
Adding debian:Cybertrust_Global_Root.pem
Adding debian:Hellenic_Academic_and_Research_Institutions_RootCA_2015.pem
Adding debian:Amazon_Root_CA_4.pem
Adding debian:ISRG_Root_X1.pem
Adding debian:thawte_Primary_Root_CA_-_G3.pem
Adding debian:DigiCert_Assured_ID_Root_CA.pem
Adding debian:GeoTrust_Primary_Certification_Authority_-_G2.pem
Adding debian:SecureSign_RootCA11.pem
Adding debian:D-TRUST_Root_Class_3_CA_2_2009.pem
Adding debian:Certum_Trusted_Network_CA.pem
Adding debian:TrustCor_RootCert_CA-1.pem
Adding debian:Amazon_Root_CA_2.pem
Adding debian:SecureTrust_CA.pem
Adding debian:CA_Disig_Root_R2.pem
Adding debian:AddTrust_External_Root.pem
Adding debian:EE_Certification_Centre_Root_CA.pem
Adding debian:Certum_Trusted_Network_CA_2.pem
Adding debian:QuoVadis_Root_CA_1_G3.pem
Adding debian:Staat_der_Nederlanden_EV_Root_CA.pem
Adding debian:SSL.com_EV_Root_Certification_Authority_RSA_R2.pem
Adding debian:Secure_Global_CA.pem
Adding debian:Taiwan_GRCA.pem
Adding debian:TeliaSonera_Root_CA_v1.pem
Adding debian:AffirmTrust_Premium_ECC.pem
Adding debian:OpenTrust_Root_CA_G2.pem
Adding debian:IdenTrust_Commercial_Root_CA_1.pem
Adding debian:Entrust_Root_Certification_Authority_-_G2.pem
Adding debian:Certplus_Class_2_Primary_CA.pem
Adding debian:Certplus_Root_CA_G1.pem
Adding debian:Izenpe.com.pem
Adding debian:Entrust_Root_Certification_Authority_-_EC1.pem
Adding debian:GeoTrust_Universal_CA.pem
Adding debian:Staat_der_Nederlanden_Root_CA_-_G2.pem
Adding debian:Go_Daddy_Class_2_CA.pem
Adding debian:Comodo_AAA_Services_root.pem
Adding debian:Entrust_Root_Certification_Authority.pem
Adding debian:Staat_der_Nederlanden_Root_CA_-_G3.pem
Adding debian:GlobalSign_Root_CA_-_R2.pem
Adding debian:GeoTrust_Primary_Certification_Authority.pem
Adding debian:OISTE_WISeKey_Global_Root_GB_CA.pem
Adding debian:ePKI_Root_Certification_Authority.pem
Adding debian:NetLock_Arany_=Class_Gold=_Főtanúsítvány.pem
Adding debian:VeriSign_Class_3_Public_Primary_Certification_Authority_-_G4.pem
Adding debian:DigiCert_Assured_ID_Root_G3.pem
Adding debian:Verisign_Class_3_Public_Primary_Certification_Authority_-_G3.pem
Adding debian:Buypass_Class_2_Root_CA.pem
Adding debian:AffirmTrust_Commercial.pem
Adding debian:GeoTrust_Universal_CA_2.pem
Adding debian:DigiCert_Global_Root_G2.pem
Adding debian:SSL.com_EV_Root_Certification_Authority_ECC.pem
Adding debian:Chambers_of_Commerce_Root_-_2008.pem
Adding debian:T-TeleSec_GlobalRoot_Class_2.pem
Adding debian:Starfield_Class_2_CA.pem
Adding debian:QuoVadis_Root_CA_2_G3.pem
Adding debian:Baltimore_CyberTrust_Root.pem
Adding debian:DST_Root_CA_X3.pem
Adding debian:IdenTrust_Public_Sector_Root_CA_1.pem
done.
Setting up default-jre (2:1.11-68ubuntu1~18.04.1) ...
Setting up openjdk-11-jdk:amd64 (11.0.4+11-1ubuntu2~18.04.3) ...
update-alternatives: using /usr/lib/jvm/java-11-openjdk-amd64/bin/jconsole to provide /usr/bin/jconsole (jconsole) in auto mode
Setting up default-jdk (2:1.11-68ubuntu1~18.04.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Processing triggers for ureadahead (0.100.0-21) ...
Processing triggers for systemd (237-3ubuntu10.24) ...
Processing triggers for ca-certificates (20180409) ...
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
done.
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ sudo apt-get install default-jdk
Reading package lists... 0% Reading package lists... 100% Reading package lists... Done
Building dependency tree... 0% Building dependency tree... 0% Building dependency tree... 50% Building dependency tree... 50% Building dependency tree
Reading state information... 0% Reading state information... 0% Reading state information... Done
default-jdk is already the newest version (2:1.11-68ubuntu1~18.04.1).
The following packages were automatically installed and are no longer required:
grub-pc-bin libnuma1
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded.
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ sudo apt-get install default-jdkscala
Reading package lists... 0% Reading package lists... 100% Reading package lists... Done
Building dependency tree... 0% Building dependency tree... 0% Building dependency tree... 50% Building dependency tree... 50% Building dependency tree
Reading state information... 0% Reading state information... 0% Reading state information... Done
The following packages were automatically installed and are no longer required:
grub-pc-bin libnuma1
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
libhawtjni-runtime-java libjansi-java libjansi-native-java libjline2-java scala-library scala-parser-combinators scala-xml
Suggested packages:
scala-doc
The following NEW packages will be installed:
libhawtjni-runtime-java libjansi-java libjansi-native-java libjline2-java scala scala-library scala-parser-combinators
scala-xml
0 upgraded, 8 newly installed, 0 to remove and 19 not upgraded.
Need to get 25.0 MB of archives.
After this operation, 28.6 MB of additional disk space will be used.
Do you want to continue? [Y/n]
0% [Working] Get:1 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/universe amd64 libhawtjni-runtime-java all 1.15-2 [27.1 kB]
0% [1 libhawtjni-runtime-java 12.3 kB/27.1 kB 45%] 3% [Working] Get:2 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/universe amd64 libjansi-native-java all 1.7-1 [19.4 kB]
3% [2 libjansi-native-java 19.4 kB/19.4 kB 100%] 5% [Waiting for headers] Get:3 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/universe amd64 libjansi-java all 1.16-1 [36.2 kB]
5% [3 libjansi-java 9455 B/36.2 kB 26%] 8% [Waiting for headers] Get:4 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/universe amd64 libjline2-java all 2.14.6-1 [150 kB]
8% [4 libjline2-java 10.9 kB/150 kB 7%] 11% [Waiting for headers] Get:5 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 scala-library all 2.11.12-4~18.04 [9589 kB]
11% [5 scala-library 2408 B/9589 kB 0%] 44% [Waiting for headers] Get:6 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/universe amd64 scala-parser-combinators all 1.0.3-3 [355 kB]
44% [6 scala-parser-combinators 65.5 kB/355 kB 18%] 48% [Waiting for headers] Get:7 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/universe amd64 scala-xml all 1.0.3-3 [601 kB]
48% [7 scala-xml 43.5 kB/601 kB 7%] 52% [Waiting for headers] Get:8 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 scala all 2.11.12-4~18.04 [14.2 MB]
52% [8 scala 2410 B/14.2 MB 0%] 100% [Working] Fetched 25.0 MB in 0s (65.0 MB/s)
Selecting previously unselected package libhawtjni-runtime-java.
(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 70421 files and directories currently installed.)
Preparing to unpack .../0-libhawtjni-runtime-java_1.15-2_all.deb ...
Unpacking libhawtjni-runtime-java (1.15-2) ...
Selecting previously unselected package libjansi-native-java.
Preparing to unpack .../1-libjansi-native-java_1.7-1_all.deb ...
Unpacking libjansi-native-java (1.7-1) ...
Selecting previously unselected package libjansi-java.
Preparing to unpack .../2-libjansi-java_1.16-1_all.deb ...
Unpacking libjansi-java (1.16-1) ...
Selecting previously unselected package libjline2-java.
Preparing to unpack .../3-libjline2-java_2.14.6-1_all.deb ...
Unpacking libjline2-java (2.14.6-1) ...
Selecting previously unselected package scala-library.
Preparing to unpack .../4-scala-library_2.11.12-4~18.04_all.deb ...
Unpacking scala-library (2.11.12-4~18.04) ...
Selecting previously unselected package scala-parser-combinators.
Preparing to unpack .../5-scala-parser-combinators_1.0.3-3_all.deb ...
Unpacking scala-parser-combinators (1.0.3-3) ...
Selecting previously unselected package scala-xml.
Preparing to unpack .../6-scala-xml_1.0.3-3_all.deb ...
Unpacking scala-xml (1.0.3-3) ...
Selecting previously unselected package scala.
Preparing to unpack .../7-scala_2.11.12-4~18.04_all.deb ...
Unpacking scala (2.11.12-4~18.04) ...
Setting up scala-parser-combinators (1.0.3-3) ...
Setting up libhawtjni-runtime-java (1.15-2) ...
Setting up scala-library (2.11.12-4~18.04) ...
Setting up scala-xml (1.0.3-3) ...
Setting up libjansi-native-java (1.7-1) ...
Setting up libjansi-java (1.16-1) ...
Setting up libjline2-java (2.14.6-1) ...
Setting up scala (2.11.12-4~18.04) ...
update-alternatives: using /usr/share/scala-2.11/bin/scala to provide /usr/bin/scala (scala) in auto mode
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ ls
14-Aug-19_19-13-19_shell.log
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi fun
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l"fun" [New File]▽ [>c]10;?]11;?~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ 0,0-1All[?25h[?12$p[?25li -- INSERT --0,1All[?25h[?25lt1,2[?25h[?25lh3[?25h[?25li4[?25h[?25ls5[?25h[?25l6[?25h[?25li7[?25h[?25ls8[?25h[?25l9[?25h[?25la10[?25h[?25l1[?25h[?25lt2[?25h[?25le3[?25h[?25ls4[?25h[?25lt5[?25h[?25l^[ 1,14All[?25h[?25l::[?2004h[?25hq[?25l[?25hw[?25l[?25h[?25l[?25h![?25l[?25h [?25l[?2004l[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ tail 14-Aug-19_19-13-19_shell.log
Setting up scala-xml (1.0.3-3) ...
Setting up libjansi-native-java (1.7-1) ...
Setting up libjansi-java (1.16-1) ...
Setting up libjline2-java (2.14.6-1) ...
Setting up scala (2.11.12-4~18.04) ...
update-alternatives: using /usr/share/scala-2.11/bin/scala to provide /usr/bin/scala (scala) in auto mode
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ ls
14-Aug-19_19-13-19_shell.log
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi fun
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l"fun" [New File]▽ [>c]10;?]11;?~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ 0,0-1All[?25h[?12$p[?25li -- INSERT --0,1All[?25h[?25lt1,2[?25h[?25lh3[?25h[?25li4[?25h[?25ls5[?25h[?25l6[?25h[?25li7[?25h[?25ls8[?25h[?25l9[?25h[?25la10[?25h[?25l1[?25h[?25lt2[?25h[?25le3[?25h[?25ls4[?25h[?25lt5[?25h[?25l^[ 1,14All[?25h[?25l::[?2004h[?25hq[?25l[?25hw[?25l[?25h[?25l[?25h![?25l[?25h [?25l[?2004l[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ tail 14-Aug-19_19-13-19_shell.log
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ 2R0;95;0c10;rgb:c7/c7/c711;rgb:00/00/0012;4$y
2R0: command not found
95: command not found
0c10: command not found
bash: rgb:c7/c7/c711: No such file or directory
bash: rgb:00/00/0012: No such file or directory
4: command not found
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ clarear
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ sudo apt-get install default-jdkhiy
Reading package lists... 0% Reading package lists... 100% Reading package lists... Done
Building dependency tree... 0% Building dependency tree... 0% Building dependency tree... 50% Building dependency tree... 50% Building dependency tree
Reading state information... 0% Reading state information... 0% Reading state information... Done
E: Unable to locate package hiy
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ sudo apt-get install hiyˆgit
Reading package lists... 0% Reading package lists... 100% Reading package lists... Done
Building dependency tree... 0% Building dependency tree... 0% Building dependency tree... 50% Building dependency tree... 50% Building dependency tree
Reading state information... 0% Reading state information... 0% Reading state information... Done
git is already the newest version (1:2.17.1-1ubuntu0.4).
git set to manually installed.
The following packages were automatically installed and are no longer required:
grub-pc-bin libnuma1
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded.
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ fg -df -hj
Filesystem Size Used Avail Use% Mounted on
udev 60G 0 60G 0% /dev
tmpfs 12G 892K 12G 1% /run
/dev/sda1 9.6G 2.4G 7.2G 25% /
tmpfs 60G 0 60G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 60G 0 60G 0% /sys/fs/cgroup
/dev/sda15 105M 3.6M 101M 4% /boot/efi
/dev/loop0 89M 89M 0 100% /snap/core/7270
/dev/loop1 60M 60M 0 100% /snap/google-cloud-sdk/90
/dev/nvme0n1 369G 69M 350G 1% /mnt/disks/data1
tmpfs 12G 0 12G 0% /run/user/1000
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ wget https://www.apache.org/dyn/closer.lua/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tg gz
--2019-08-14 19:18:04-- https://www.apache.org/dyn/closer.lua/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
Resolving www.apache.org (www.apache.org)... 40.79.78.1, 95.216.24.32, 2a01:4f9:2a:185f::2
Connecting to www.apache.org (www.apache.org)|40.79.78.1|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘spark-2.4.3-bin-hadoop2.7.tgz’
spark-2.4.3-bin-hadoop2.7.tgz [<=> ] 0 --.-KB/s spark-2.4.3-bin-hadoop2.7.tgz [ <=> ] 34.49K --.-KB/s in 0.03s
2019-08-14 19:18:04 (1.02 MB/s) - ‘spark-2.4.3-bin-hadoop2.7.tgz’ saved [35321]
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ tar -zxvf spark-2.4.3-bin-hadoop2.7.tgz
gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ tar -zxvf spark-2.4.3-bin-hadoop2.7.tgz 
gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ file spark-2.4.3-bin-hadoop2.7.tgz
spark-2.4.3-bin-hadoop2.7.tgz: HTML document, ASCII text, with very long lines
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ rm spark-2.4.3-bin-hadoop2.7.tgz
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ wget http://apache.mirrors.hoobly.com/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
--2019-08-14 19:19:16-- http://apache.mirrors.hoobly.com/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
Resolving apache.mirrors.hoobly.com (apache.mirrors.hoobly.com)... 69.64.41.166
Connecting to apache.mirrors.hoobly.com (apache.mirrors.hoobly.com)|69.64.41.166|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 229988313 (219M) [application/x-gzip]
Saving to: ‘spark-2.4.3-bin-hadoop2.7.tgz’
spark-2.4.3-bin-hadoop2.7.tgz 0%[ ] 0 --.-KB/s spark-2.4.3-bin-hadoop2.7.tgz 4%[=> ] 9.95M 49.8MB/s spark-2.4.3-bin-hadoop2.7.tgz 14%[======> ] 31.76M 79.4MB/s spark-2.4.3-bin-hadoop2.7.tgz 24%[============> ] 53.69M 89.5MB/s spark-2.4.3-bin-hadoop2.7.tgz 34%[=================> ] 75.40M 94.2MB/s spark-2.4.3-bin-hadoop2.7.tgz 44%[======================> ] 97.18M 97.2MB/s spark-2.4.3-bin-hadoop2.7.tgz 54%[============================> ] 119.14M 99.3MB/s spark-2.4.3-bin-hadoop2.7.tgz 64%[=================================> ] 141.06M 101MB/s spark-2.4.3-bin-hadoop2.7.tgz 74%[=======================================> ] 162.70M 102MB/s spark-2.4.3-bin-hadoop2.7.tgz 84%[============================================> ] 184.48M 102MB/s spark-2.4.3-bin-hadoop2.7.tgz 94%[=================================================> ] 206.47M 103MB/s spark-2.4.3-bin-hadoop2.7.tgz 100%[=====================================================>] 219.33M 104MB/s in 2.1s
2019-08-14 19:19:19 (104 MB/s) - ‘spark-2.4.3-bin-hadoop2.7.tgz’ saved [229988313/229988313]
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ ls
14-Aug-19_19-13-19_shell.log spark-2.4.3-bin-hadoop2.7.tgz
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ tar -zxvf spark-2.4.3-bin-hadoop2.7.tgz
spark-2.4.3-bin-hadoop2.7/
spark-2.4.3-bin-hadoop2.7/python/
spark-2.4.3-bin-hadoop2.7/python/setup.cfg
spark-2.4.3-bin-hadoop2.7/python/pyspark/
spark-2.4.3-bin-hadoop2.7/python/pyspark/resultiterable.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/python/
spark-2.4.3-bin-hadoop2.7/python/pyspark/python/pyspark/
spark-2.4.3-bin-hadoop2.7/python/pyspark/python/pyspark/shell.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/heapq3.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/join.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/version.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/rdd.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/java_gateway.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/find_spark_home.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/_globals.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/worker.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/accumulators.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/feature.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/random.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/recommendation.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/fpm.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/classification.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/stat/
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/stat/KernelDensity.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/stat/distribution.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/stat/test.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/stat/_statistics.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/stat/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/util.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/regression.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/clustering.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/linalg/
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/linalg/distributed.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/linalg/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/tree.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/evaluation.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/common.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/mllib/tests.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/util.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/test_broadcast.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/shell.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/feature.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/recommendation.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/fpm.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/classification.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/stat.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/util.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/tuning.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/regression.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/base.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/clustering.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/wrapper.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/pipeline.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/linalg/
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/linalg/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/param/
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/param/_shared_params_code_gen.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/param/shared.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/param/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/evaluation.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/common.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/tests.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/ml/image.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/test_serializers.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/cloudpickle.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/serializers.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/daemon.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/files.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/rddsampler.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/statcounter.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/kafka.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/util.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/kinesis.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/flume.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/context.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/tests.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/dstream.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/streaming/listener.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/taskcontext.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/storagelevel.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/broadcast.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/profiler.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/traceback_utils.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/context.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/status.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/streaming.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/readwriter.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/catalog.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/session.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/column.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/functions.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/dataframe.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/window.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/udf.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/__init__.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/utils.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/group.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/context.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/tests.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/conf.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/sql/types.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/tests.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/conf.py
spark-2.4.3-bin-hadoop2.7/python/pyspark/shuffle.py
spark-2.4.3-bin-hadoop2.7/python/.gitignore
spark-2.4.3-bin-hadoop2.7/python/docs/
spark-2.4.3-bin-hadoop2.7/python/docs/epytext.py
spark-2.4.3-bin-hadoop2.7/python/docs/make2.bat
spark-2.4.3-bin-hadoop2.7/python/docs/pyspark.sql.rst
spark-2.4.3-bin-hadoop2.7/python/docs/make.bat
spark-2.4.3-bin-hadoop2.7/python/docs/index.rst
spark-2.4.3-bin-hadoop2.7/python/docs/_templates/
spark-2.4.3-bin-hadoop2.7/python/docs/_templates/layout.html
spark-2.4.3-bin-hadoop2.7/python/docs/_static/
spark-2.4.3-bin-hadoop2.7/python/docs/_static/pyspark.js
spark-2.4.3-bin-hadoop2.7/python/docs/_static/pyspark.css
spark-2.4.3-bin-hadoop2.7/python/docs/pyspark.ml.rst
spark-2.4.3-bin-hadoop2.7/python/docs/pyspark.streaming.rst
spark-2.4.3-bin-hadoop2.7/python/docs/conf.py
spark-2.4.3-bin-hadoop2.7/python/docs/pyspark.mllib.rst
spark-2.4.3-bin-hadoop2.7/python/docs/pyspark.rst
spark-2.4.3-bin-hadoop2.7/python/docs/Makefile
spark-2.4.3-bin-hadoop2.7/python/test_coverage/
spark-2.4.3-bin-hadoop2.7/python/test_coverage/conf/
spark-2.4.3-bin-hadoop2.7/python/test_coverage/conf/spark-defaults.conf
spark-2.4.3-bin-hadoop2.7/python/test_coverage/sitecustomize.py
spark-2.4.3-bin-hadoop2.7/python/test_coverage/coverage_daemon.py
spark-2.4.3-bin-hadoop2.7/python/run-tests-with-coverage
spark-2.4.3-bin-hadoop2.7/python/pyspark.egg-info/
spark-2.4.3-bin-hadoop2.7/python/pyspark.egg-info/top_level.txt
spark-2.4.3-bin-hadoop2.7/python/pyspark.egg-info/dependency_links.txt
spark-2.4.3-bin-hadoop2.7/python/pyspark.egg-info/requires.txt
spark-2.4.3-bin-hadoop2.7/python/pyspark.egg-info/PKG-INFO
spark-2.4.3-bin-hadoop2.7/python/pyspark.egg-info/SOURCES.txt
spark-2.4.3-bin-hadoop2.7/python/MANIFEST.in
spark-2.4.3-bin-hadoop2.7/python/test_support/
spark-2.4.3-bin-hadoop2.7/python/test_support/userlibrary.py
spark-2.4.3-bin-hadoop2.7/python/test_support/userlib-0.1.zip
spark-2.4.3-bin-hadoop2.7/python/test_support/SimpleHTTPServer.py
spark-2.4.3-bin-hadoop2.7/python/test_support/hello/
spark-2.4.3-bin-hadoop2.7/python/test_support/hello/sub_hello/
spark-2.4.3-bin-hadoop2.7/python/test_support/hello/sub_hello/sub_hello.txt
spark-2.4.3-bin-hadoop2.7/python/test_support/hello/hello.txt
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/people_array.json
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/text-test.txt
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/ages_newlines.csv
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/people.json
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2014/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2014/month=9/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2014/month=9/day=1/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2014/month=9/day=1/part-r-00008.gz.parquet
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2014/month=9/day=1/.part-r-00008.gz.parquet.crc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=26/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=26/part-r-00005.gz.parquet
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=26/.part-r-00005.gz.parquet.crc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25/.part-r-00002.gz.parquet.crc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25/part-r-00002.gz.parquet
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25/part-r-00004.gz.parquet
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25/.part-r-00004.gz.parquet.crc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=9/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=9/day=1/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=9/day=1/.part-r-00007.gz.parquet.crc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/year=2015/month=9/day=1/part-r-00007.gz.parquet
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/_common_metadata
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/_metadata
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/parquet_partitioned/_SUCCESS
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/streaming/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/streaming/text-test.txt
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/ages.csv
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/people1.json
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=0/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=0/c=0/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=0/c=0/part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=0/c=0/.part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc.crc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/_SUCCESS
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=1/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=1/c=1/
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=1/c=1/part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/orc_partitioned/b=1/c=1/.part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc.crc
spark-2.4.3-bin-hadoop2.7/python/test_support/sql/people_array_utf16le.json
spark-2.4.3-bin-hadoop2.7/python/run-tests.py
spark-2.4.3-bin-hadoop2.7/python/run-tests
spark-2.4.3-bin-hadoop2.7/python/.coveragerc
spark-2.4.3-bin-hadoop2.7/python/lib/
spark-2.4.3-bin-hadoop2.7/python/lib/pyspark.zip
spark-2.4.3-bin-hadoop2.7/python/lib/PY4J_LICENSE.txt
spark-2.4.3-bin-hadoop2.7/python/lib/py4j-0.10.7-src.zip
spark-2.4.3-bin-hadoop2.7/python/setup.py
spark-2.4.3-bin-hadoop2.7/python/README.md
spark-2.4.3-bin-hadoop2.7/python/dist/
spark-2.4.3-bin-hadoop2.7/python/pylintrc
spark-2.4.3-bin-hadoop2.7/conf/
spark-2.4.3-bin-hadoop2.7/conf/fairscheduler.xml.template
spark-2.4.3-bin-hadoop2.7/conf/spark-defaults.conf.template
spark-2.4.3-bin-hadoop2.7/conf/docker.properties.template
spark-2.4.3-bin-hadoop2.7/conf/log4j.properties.template
spark-2.4.3-bin-hadoop2.7/conf/metrics.properties.template
spark-2.4.3-bin-hadoop2.7/conf/slaves.template
spark-2.4.3-bin-hadoop2.7/conf/spark-env.sh.template
spark-2.4.3-bin-hadoop2.7/licenses/
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-heapq.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-paranamer.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-graphlib-dot.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-minlog.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-slf4j.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-jquery.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-scopt.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-vis.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-sbt-launch-lib.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-spire.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-matchMedia-polyfill.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-kryo.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-mustache.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-arpack.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-scala.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-javassist.html
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-json-formatter.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-jodd.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-automaton.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-janino.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-dagre-d3.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-sorttable.js.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-py4j.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-d3.min.js.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-respond.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-CC0.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-zstd.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-cloudpickle.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-pmml-model.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-pyrolite.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-netlib.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-AnchorJS.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-modernizr.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-machinist.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-javolution.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-xmlenc.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-join.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-jline.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-antlr.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-jtransforms.html
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-leveldbjni.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-protobuf.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-bootstrap.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-zstd-jni.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-datatables.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-f2j.txt
spark-2.4.3-bin-hadoop2.7/licenses/LICENSE-reflectasm.txt
spark-2.4.3-bin-hadoop2.7/sbin/
spark-2.4.3-bin-hadoop2.7/sbin/start-slave.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-history-server.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-slave.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-mesos-dispatcher.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-all.sh
spark-2.4.3-bin-hadoop2.7/sbin/spark-daemon.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-master.sh
spark-2.4.3-bin-hadoop2.7/sbin/spark-daemons.sh
spark-2.4.3-bin-hadoop2.7/sbin/spark-config.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-slaves.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-mesos-shuffle-service.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-history-server.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-shuffle-service.sh
spark-2.4.3-bin-hadoop2.7/sbin/slaves.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-slaves.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-thriftserver.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-master.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-shuffle-service.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-mesos-dispatcher.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-mesos-shuffle-service.sh
spark-2.4.3-bin-hadoop2.7/sbin/start-thriftserver.sh
spark-2.4.3-bin-hadoop2.7/sbin/stop-all.sh
spark-2.4.3-bin-hadoop2.7/kubernetes/
spark-2.4.3-bin-hadoop2.7/kubernetes/tests/
spark-2.4.3-bin-hadoop2.7/kubernetes/tests/pyfiles.py
spark-2.4.3-bin-hadoop2.7/kubernetes/tests/worker_memory_check.py
spark-2.4.3-bin-hadoop2.7/kubernetes/tests/py_container_checks.py
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/Dockerfile
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/bindings/
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/bindings/python/
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/bindings/python/Dockerfile
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/bindings/R/
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/bindings/R/Dockerfile
spark-2.4.3-bin-hadoop2.7/kubernetes/dockerfiles/spark/entrypoint.sh
spark-2.4.3-bin-hadoop2.7/jars/
spark-2.4.3-bin-hadoop2.7/jars/commons-lang3-3.5.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-kubernetes_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/arrow-format-0.10.0.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-streaming_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-yarn-common-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-mapreduce-client-jobclient-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/json4s-jackson_2.11-3.5.3.jar
spark-2.4.3-bin-hadoop2.7/jars/jersey-container-servlet-2.22.2.jar
spark-2.4.3-bin-hadoop2.7/jars/hive-jdbc-1.2.1.spark2.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-network-common_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/curator-framework-2.7.1.jar
spark-2.4.3-bin-hadoop2.7/jars/pyrolite-4.13.jar
spark-2.4.3-bin-hadoop2.7/jars/bonecp-0.8.0.RELEASE.jar
spark-2.4.3-bin-hadoop2.7/jars/hppc-0.7.2.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-network-shuffle_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/metrics-jvm-3.1.5.jar
spark-2.4.3-bin-hadoop2.7/jars/jersey-guava-2.22.2.jar
spark-2.4.3-bin-hadoop2.7/jars/guice-3.0.jar
spark-2.4.3-bin-hadoop2.7/jars/super-csv-2.2.0.jar
spark-2.4.3-bin-hadoop2.7/jars/jsp-api-2.1.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-net-3.1.jar
spark-2.4.3-bin-hadoop2.7/jars/validation-api-1.1.0.Final.jar
spark-2.4.3-bin-hadoop2.7/jars/json4s-ast_2.11-3.5.3.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-repl_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-sketch_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/javax.inject-1.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-mapreduce-client-shuffle-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/orc-mapreduce-1.5.5-nohive.jar
spark-2.4.3-bin-hadoop2.7/jars/avro-ipc-1.8.2.jar
spark-2.4.3-bin-hadoop2.7/jars/parquet-encoding-1.10.1.jar
spark-2.4.3-bin-hadoop2.7/jars/jersey-container-servlet-core-2.22.2.jar
spark-2.4.3-bin-hadoop2.7/jars/zjsonpatch-0.3.0.jar
spark-2.4.3-bin-hadoop2.7/jars/scala-compiler-2.11.12.jar
spark-2.4.3-bin-hadoop2.7/jars/curator-client-2.7.1.jar
spark-2.4.3-bin-hadoop2.7/jars/jersey-media-jaxb-2.22.2.jar
spark-2.4.3-bin-hadoop2.7/jars/avro-mapred-1.8.2-hadoop2.jar
spark-2.4.3-bin-hadoop2.7/jars/antlr4-runtime-4.7.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-sql_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-module-jaxb-annotations-2.6.7.jar
spark-2.4.3-bin-hadoop2.7/jars/okhttp-3.8.1.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-core_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/leveldbjni-all-1.8.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-mapper-asl-1.9.13.jar
spark-2.4.3-bin-hadoop2.7/jars/ST4-4.0.4.jar
spark-2.4.3-bin-hadoop2.7/jars/eigenbase-properties-1.1.5.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-jaxrs-1.9.13.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-yarn_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-annotations-2.6.7.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-module-paranamer-2.7.9.jar
spark-2.4.3-bin-hadoop2.7/jars/jdo-api-3.0.1.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-launcher_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/jersey-server-2.22.2.jar
spark-2.4.3-bin-hadoop2.7/jars/scala-parser-combinators_2.11-1.1.0.jar
spark-2.4.3-bin-hadoop2.7/jars/arrow-memory-0.10.0.jar
spark-2.4.3-bin-hadoop2.7/jars/hk2-utils-2.4.0-b34.jar
spark-2.4.3-bin-hadoop2.7/jars/joda-time-2.9.3.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-crypto-1.0.0.jar
spark-2.4.3-bin-hadoop2.7/jars/aopalliance-1.0.jar
spark-2.4.3-bin-hadoop2.7/jars/logging-interceptor-3.12.0.jar
spark-2.4.3-bin-hadoop2.7/jars/parquet-common-1.10.1.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-mllib-local_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/log4j-1.2.17.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-pool-1.5.4.jar
spark-2.4.3-bin-hadoop2.7/jars/xz-1.5.jar
spark-2.4.3-bin-hadoop2.7/jars/hk2-locator-2.4.0-b34.jar
spark-2.4.3-bin-hadoop2.7/jars/libthrift-0.9.3.jar
spark-2.4.3-bin-hadoop2.7/jars/chill-java-0.9.3.jar
spark-2.4.3-bin-hadoop2.7/jars/opencsv-2.3.jar
spark-2.4.3-bin-hadoop2.7/jars/lz4-java-1.4.0.jar
spark-2.4.3-bin-hadoop2.7/jars/kubernetes-model-common-4.1.2.jar
spark-2.4.3-bin-hadoop2.7/jars/slf4j-log4j12-1.7.16.jar
spark-2.4.3-bin-hadoop2.7/jars/calcite-core-1.2.0-incubating.jar
spark-2.4.3-bin-hadoop2.7/jars/breeze_2.11-0.13.2.jar
spark-2.4.3-bin-hadoop2.7/jars/parquet-hadoop-bundle-1.6.0.jar
spark-2.4.3-bin-hadoop2.7/jars/javax.inject-2.4.0-b34.jar
spark-2.4.3-bin-hadoop2.7/jars/metrics-json-3.1.5.jar
spark-2.4.3-bin-hadoop2.7/jars/parquet-column-1.10.1.jar
spark-2.4.3-bin-hadoop2.7/jars/aopalliance-repackaged-2.4.0-b34.jar
spark-2.4.3-bin-hadoop2.7/jars/jcl-over-slf4j-1.7.16.jar
spark-2.4.3-bin-hadoop2.7/jars/antlr-runtime-3.4.jar
spark-2.4.3-bin-hadoop2.7/jars/parquet-jackson-1.10.1.jar
spark-2.4.3-bin-hadoop2.7/jars/httpcore-4.4.10.jar
spark-2.4.3-bin-hadoop2.7/jars/metrics-graphite-3.1.5.jar
spark-2.4.3-bin-hadoop2.7/jars/netty-3.9.9.Final.jar
spark-2.4.3-bin-hadoop2.7/jars/guava-14.0.1.jar
spark-2.4.3-bin-hadoop2.7/jars/RoaringBitmap-0.7.45.jar
spark-2.4.3-bin-hadoop2.7/jars/jaxb-api-2.2.2.jar
spark-2.4.3-bin-hadoop2.7/jars/datanucleus-core-3.2.10.jar
spark-2.4.3-bin-hadoop2.7/jars/compress-lzf-1.0.3.jar
spark-2.4.3-bin-hadoop2.7/jars/antlr-2.7.7.jar
spark-2.4.3-bin-hadoop2.7/jars/jersey-common-2.22.2.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-yarn-client-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/parquet-hadoop-1.10.1.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-lang-2.6.jar
spark-2.4.3-bin-hadoop2.7/jars/datanucleus-api-jdo-3.2.6.jar
spark-2.4.3-bin-hadoop2.7/jars/orc-shims-1.5.5.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-digester-1.8.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-annotations-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/jtransforms-2.4.0.jar
spark-2.4.3-bin-hadoop2.7/jars/jodd-core-3.5.2.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-hive_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/snakeyaml-1.15.jar
spark-2.4.3-bin-hadoop2.7/jars/kubernetes-client-4.1.2.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-cli-1.2.jar
spark-2.4.3-bin-hadoop2.7/jars/snappy-java-1.1.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/parquet-format-2.4.0.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-configuration-1.6.jar
spark-2.4.3-bin-hadoop2.7/jars/jpam-1.1.jar
spark-2.4.3-bin-hadoop2.7/jars/kryo-shaded-4.0.2.jar
spark-2.4.3-bin-hadoop2.7/jars/zookeeper-3.4.6.jar
spark-2.4.3-bin-hadoop2.7/jars/javax.ws.rs-api-2.0.1.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-core-asl-1.9.13.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-mapreduce-client-core-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/json4s-scalap_2.11-3.5.3.jar
spark-2.4.3-bin-hadoop2.7/jars/avro-1.8.2.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-yarn-api-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/api-asn1-api-1.0.0-M20.jar
spark-2.4.3-bin-hadoop2.7/jars/paranamer-2.8.jar
spark-2.4.3-bin-hadoop2.7/jars/janino-3.0.9.jar
spark-2.4.3-bin-hadoop2.7/jars/stringtemplate-3.2.1.jar
spark-2.4.3-bin-hadoop2.7/jars/apacheds-i18n-2.0.0-M15.jar
spark-2.4.3-bin-hadoop2.7/jars/apache-log4j-extras-1.2.17.jar
spark-2.4.3-bin-hadoop2.7/jars/xbean-asm6-shaded-4.8.jar
spark-2.4.3-bin-hadoop2.7/jars/curator-recipes-2.7.1.jar
spark-2.4.3-bin-hadoop2.7/jars/oro-2.0.8.jar
spark-2.4.3-bin-hadoop2.7/jars/javax.annotation-api-1.2.jar
spark-2.4.3-bin-hadoop2.7/jars/chill_2.11-0.9.3.jar
spark-2.4.3-bin-hadoop2.7/jars/hive-exec-1.2.1.spark2.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-common-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-dbcp-1.4.jar
spark-2.4.3-bin-hadoop2.7/jars/mesos-1.4.0-shaded-protobuf.jar
spark-2.4.3-bin-hadoop2.7/jars/okio-1.13.0.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-databind-2.6.7.1.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-mesos_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/netty-all-4.1.17.Final.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-compiler-3.0.9.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-math3-3.4.1.jar
spark-2.4.3-bin-hadoop2.7/jars/httpclient-4.5.6.jar
spark-2.4.3-bin-hadoop2.7/jars/jul-to-slf4j-1.7.16.jar
spark-2.4.3-bin-hadoop2.7/jars/stax-api-1.0-2.jar
spark-2.4.3-bin-hadoop2.7/jars/core-1.1.2.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-codec-1.10.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-kvstore_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-catalyst_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/gson-2.2.4.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-tags_2.11-2.4.3-tests.jar
spark-2.4.3-bin-hadoop2.7/jars/zstd-jni-1.3.2-2.jar
spark-2.4.3-bin-hadoop2.7/jars/javolution-5.5.1.jar
spark-2.4.3-bin-hadoop2.7/jars/univocity-parsers-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/apacheds-kerberos-codec-2.0.0-M15.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-yarn-server-common-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/libfb303-0.9.3.jar
spark-2.4.3-bin-hadoop2.7/jars/jersey-client-2.22.2.jar
spark-2.4.3-bin-hadoop2.7/jars/xercesImpl-2.9.1.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-collections-3.2.2.jar
spark-2.4.3-bin-hadoop2.7/jars/machinist_2.11-0.6.1.jar
spark-2.4.3-bin-hadoop2.7/jars/shims-0.7.45.jar
spark-2.4.3-bin-hadoop2.7/jars/htrace-core-3.1.0-incubating.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-graphx_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/jta-1.1.jar
spark-2.4.3-bin-hadoop2.7/jars/osgi-resource-locator-1.0.1.jar
spark-2.4.3-bin-hadoop2.7/jars/datanucleus-rdbms-3.2.9.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-unsafe_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/javassist-3.18.1-GA.jar
spark-2.4.3-bin-hadoop2.7/jars/spire-macros_2.11-0.13.0.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-mllib_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/calcite-linq4j-1.2.0-incubating.jar
spark-2.4.3-bin-hadoop2.7/jars/jline-2.14.6.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-client-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/hive-metastore-1.2.1.spark2.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-yarn-server-web-proxy-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/spire_2.11-0.13.0.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-core-2.6.7.jar
spark-2.4.3-bin-hadoop2.7/jars/api-util-1.0.0-M20.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-httpclient-3.1.jar
spark-2.4.3-bin-hadoop2.7/jars/aircompressor-0.10.jar
spark-2.4.3-bin-hadoop2.7/jars/guice-servlet-3.0.jar
spark-2.4.3-bin-hadoop2.7/jars/scala-xml_2.11-1.0.5.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-mapreduce-client-common-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-beanutils-1.9.3.jar
spark-2.4.3-bin-hadoop2.7/jars/protobuf-java-2.5.0.jar
spark-2.4.3-bin-hadoop2.7/jars/hive-beeline-1.2.1.spark2.jar
spark-2.4.3-bin-hadoop2.7/jars/stream-2.7.0.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-compress-1.8.1.jar
spark-2.4.3-bin-hadoop2.7/jars/macro-compat_2.11-1.1.1.jar
spark-2.4.3-bin-hadoop2.7/jars/activation-1.1.1.jar
spark-2.4.3-bin-hadoop2.7/jars/breeze-macros_2.11-0.13.2.jar
spark-2.4.3-bin-hadoop2.7/jars/derby-10.12.1.1.jar
spark-2.4.3-bin-hadoop2.7/jars/shapeless_2.11-2.3.2.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-tags_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/minlog-1.3.0.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-logging-1.1.3.jar
spark-2.4.3-bin-hadoop2.7/jars/kubernetes-model-4.1.2.jar
spark-2.4.3-bin-hadoop2.7/jars/spark-hive-thriftserver_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/jars/hive-cli-1.2.1.spark2.jar
spark-2.4.3-bin-hadoop2.7/jars/metrics-core-3.1.5.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-module-scala_2.11-2.6.7.1.jar
spark-2.4.3-bin-hadoop2.7/jars/automaton-1.11-8.jar
spark-2.4.3-bin-hadoop2.7/jars/objenesis-2.5.1.jar
spark-2.4.3-bin-hadoop2.7/jars/json4s-core_2.11-3.5.3.jar
spark-2.4.3-bin-hadoop2.7/jars/py4j-0.10.7.jar
spark-2.4.3-bin-hadoop2.7/jars/jetty-6.1.26.jar
spark-2.4.3-bin-hadoop2.7/jars/slf4j-api-1.7.16.jar
spark-2.4.3-bin-hadoop2.7/jars/orc-core-1.5.5-nohive.jar
spark-2.4.3-bin-hadoop2.7/jars/commons-io-2.4.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-xc-1.9.13.jar
spark-2.4.3-bin-hadoop2.7/jars/scala-reflect-2.11.12.jar
spark-2.4.3-bin-hadoop2.7/jars/xmlenc-0.52.jar
spark-2.4.3-bin-hadoop2.7/jars/jetty-util-6.1.26.jar
spark-2.4.3-bin-hadoop2.7/jars/ivy-2.4.0.jar
spark-2.4.3-bin-hadoop2.7/jars/scala-library-2.11.12.jar
spark-2.4.3-bin-hadoop2.7/jars/snappy-0.2.jar
spark-2.4.3-bin-hadoop2.7/jars/jsr305-1.3.9.jar
spark-2.4.3-bin-hadoop2.7/jars/arpack_combined_all-0.1.jar
spark-2.4.3-bin-hadoop2.7/jars/stax-api-1.0.1.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-mapreduce-client-app-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/hk2-api-2.4.0-b34.jar
spark-2.4.3-bin-hadoop2.7/jars/jackson-dataformat-yaml-2.6.7.jar
spark-2.4.3-bin-hadoop2.7/jars/arrow-vector-0.10.0.jar
spark-2.4.3-bin-hadoop2.7/jars/flatbuffers-1.2.0-3f79e055.jar
spark-2.4.3-bin-hadoop2.7/jars/calcite-avatica-1.2.0-incubating.jar
spark-2.4.3-bin-hadoop2.7/jars/generex-1.0.1.jar
spark-2.4.3-bin-hadoop2.7/jars/JavaEWAH-0.3.2.jar
spark-2.4.3-bin-hadoop2.7/jars/javax.servlet-api-3.1.0.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-hdfs-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/jars/hadoop-auth-2.7.3.jar
spark-2.4.3-bin-hadoop2.7/bin/
spark-2.4.3-bin-hadoop2.7/bin/beeline
spark-2.4.3-bin-hadoop2.7/bin/pyspark
spark-2.4.3-bin-hadoop2.7/bin/pyspark.cmd
spark-2.4.3-bin-hadoop2.7/bin/find-spark-home
spark-2.4.3-bin-hadoop2.7/bin/spark-submit2.cmd
spark-2.4.3-bin-hadoop2.7/bin/spark-class.cmd
spark-2.4.3-bin-hadoop2.7/bin/run-example
spark-2.4.3-bin-hadoop2.7/bin/sparkR2.cmd
spark-2.4.3-bin-hadoop2.7/bin/spark-sql2.cmd
spark-2.4.3-bin-hadoop2.7/bin/spark-submit.cmd
spark-2.4.3-bin-hadoop2.7/bin/run-example.cmd
spark-2.4.3-bin-hadoop2.7/bin/sparkR.cmd
spark-2.4.3-bin-hadoop2.7/bin/spark-class2.cmd
spark-2.4.3-bin-hadoop2.7/bin/spark-submit
spark-2.4.3-bin-hadoop2.7/bin/sparkR
spark-2.4.3-bin-hadoop2.7/bin/spark-sql.cmd
spark-2.4.3-bin-hadoop2.7/bin/load-spark-env.cmd
spark-2.4.3-bin-hadoop2.7/bin/pyspark2.cmd
spark-2.4.3-bin-hadoop2.7/bin/docker-image-tool.sh
spark-2.4.3-bin-hadoop2.7/bin/spark-shell
spark-2.4.3-bin-hadoop2.7/bin/find-spark-home.cmd
spark-2.4.3-bin-hadoop2.7/bin/spark-shell.cmd
spark-2.4.3-bin-hadoop2.7/bin/load-spark-env.sh
spark-2.4.3-bin-hadoop2.7/bin/spark-sql
spark-2.4.3-bin-hadoop2.7/bin/spark-shell2.cmd
spark-2.4.3-bin-hadoop2.7/bin/spark-class
spark-2.4.3-bin-hadoop2.7/bin/beeline.cmd
spark-2.4.3-bin-hadoop2.7/RELEASE
spark-2.4.3-bin-hadoop2.7/R/
spark-2.4.3-bin-hadoop2.7/R/lib/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/NAMESPACE
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/DESCRIPTION
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/R/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/R/SparkR.rdb
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/R/SparkR
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/R/SparkR.rdx
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/html/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/html/R.css
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/html/00Index.html
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/help/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/help/AnIndex
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/help/SparkR.rdb
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/help/aliases.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/help/SparkR.rdx
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/help/paths.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/profile/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/profile/general.R
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/profile/shell.R
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/tests/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/tests/testthat/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/tests/testthat/test_basic.R
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/Meta/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/Meta/package.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/Meta/Rd.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/Meta/nsInfo.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/Meta/hsearch.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/Meta/features.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/Meta/links.rds
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/worker/
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/worker/daemon.R
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/worker/worker.R
spark-2.4.3-bin-hadoop2.7/R/lib/SparkR/INDEX
spark-2.4.3-bin-hadoop2.7/R/lib/sparkr.zip
spark-2.4.3-bin-hadoop2.7/yarn/
spark-2.4.3-bin-hadoop2.7/yarn/spark-2.4.3-yarn-shuffle.jar
spark-2.4.3-bin-hadoop2.7/examples/
spark-2.4.3-bin-hadoop2.7/examples/jars/
spark-2.4.3-bin-hadoop2.7/examples/jars/spark-examples_2.11-2.4.3.jar
spark-2.4.3-bin-hadoop2.7/examples/jars/scopt_2.11-3.7.0.jar
spark-2.4.3-bin-hadoop2.7/examples/src/
spark-2.4.3-bin-hadoop2.7/examples/src/main/
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/als.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/pagerank.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/ranking_metrics_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/gradient_boosting_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/decision_tree_classification_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/tf_idf_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/decision_tree_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/k_means_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/streaming_linear_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/random_forest_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/random_forest_classification_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/pca_rowmatrix_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/elementwise_product_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/stratified_sampling_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/multi_class_metrics_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/gradient_boosting_classification_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/fpgrowth_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/binary_classification_metrics_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/sampled_rdds.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/logistic_regression_with_lbfgs_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/kernel_density_estimation_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/logistic_regression.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/hypothesis_testing_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/svm_with_sgd_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/streaming_k_means_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/correlations.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/correlations_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/regression_metrics_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/naive_bayes_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/gaussian_mixture_model.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/hypothesis_testing_kolmogorov_smirnov_test_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/word2vec.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/latent_dirichlet_allocation_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/recommendation_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/linear_regression_with_sgd_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/random_rdd_generation.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/bisecting_k_means_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/summary_statistics_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/word2vec_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/kmeans.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/standard_scaler_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/multi_label_metrics_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/svd_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/normalizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/power_iteration_clustering_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/isotonic_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/mllib/gaussian_mixture_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/parquet_inputformat.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/logistic_regression.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/rformula_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/min_max_scaler_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/min_hash_lsh_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/gradient_boosted_tree_regressor_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/decision_tree_classification_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/logistic_regression_with_elastic_net.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/tf_idf_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/decision_tree_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/vector_slicer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/als_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/cross_validator.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/onehot_encoder_estimator_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/gradient_boosted_tree_classifier_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/generalized_linear_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/random_forest_regressor_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/chisq_selector_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/max_abs_scaler_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/n_gram_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/elementwise_product_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/binarizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/bucketed_random_projection_lsh_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/imputer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/correlation_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/count_vectorizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/multilayer_perceptron_classification.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/stopwords_remover_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/fpgrowth_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/kmeans_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/chi_square_test_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/aft_survival_regression.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/dct_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/dataframe_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/pca_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/pipeline_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/polynomial_expansion_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/tokenizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/estimator_transformer_param_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/naive_bayes_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/string_indexer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/summarizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/bucketizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/vector_assembler_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/sql_transformer.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/feature_hasher_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/vector_indexer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/train_validation_split.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/vector_size_hint_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/one_vs_rest_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/logistic_regression_summary_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/bisecting_k_means_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/multiclass_logistic_regression_with_elastic_net.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/index_to_string_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/linear_regression_with_elastic_net.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/linearsvc.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/word2vec_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/standard_scaler_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/prefixspan_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/lda_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/normalizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/quantile_discretizer_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/random_forest_classifier_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/isotonic_regression_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/ml/gaussian_mixture_example.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/transitive_closure.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/flume_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/queue_stream.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/recoverable_network_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/kafka_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/hdfs_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/direct_kafka_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/stateful_network_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/network_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/sql_network_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/streaming/network_wordjoinsentiments.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/status_api_demo.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/basic.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/arrow.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/streaming/
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/streaming/structured_kafka_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/streaming/structured_network_wordcount_windowed.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/streaming/structured_network_wordcount.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/datasource.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sql/hive.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/kmeans.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/sort.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/pi.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/python/avro_inputformat.py
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/LocalPi.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkTC.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/pythonconverters/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/pythonconverters/AvroConverters.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/HdfsTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkHdfsLR.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/LiveJournalPageRank.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/Analytics.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/ConnectedComponentsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/TriangleCountingExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/SynthBenchmark.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/ComprehensiveExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/SSSPExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/AggregateMessagesExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/PageRankExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkPageRank.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/LocalKMeans.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/BroadcastTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkLR.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/StreamingTestExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/StreamingLinearRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/LatentDirichletAllocationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/StandardScalerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/GaussianMixtureExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/ElementwiseProductExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/LBFGSExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/SampledRDDs.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/GradientBoostedTreesRunner.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/TallSkinnyPCA.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/DecisionTreeRunner.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/GradientBoostingClassificationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/PrefixSpanExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/Correlations.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/SimpleFPGrowth.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/Word2VecExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/RankingMetricsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/NaiveBayesExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/IsotonicRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/LinearRegression.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/MultivariateSummarizer.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/TallSkinnySVD.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/FPGrowthExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/SVMWithSGDExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/RecommendationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/PCAOnSourceVectorExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/MovieLensALS.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/DecisionTreeClassificationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/KMeansExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/PMMLModelExportExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/LogisticRegressionWithLBFGSExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/StratifiedSamplingExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/CosineSimilarity.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/GradientBoostingRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/SummaryStatisticsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/StreamingLogisticRegression.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/RegressionMetricsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/DenseKMeans.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/HypothesisTestingKolmogorovSmirnovTestExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/RandomForestClassificationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/LDAExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/DecisionTreeRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/PCAExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/KernelDensityEstimationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/MulticlassMetricsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/BinaryClassification.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/PowerIterationClusteringExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/SVDExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/StreamingKMeansExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/BisectingKMeansExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/MultiLabelMetricsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/BinaryClassificationMetricsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/RandomRDDGeneration.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/AssociationRulesExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/HypothesisTestingExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/TFIDFExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/LinearRegressionWithSGDExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/PCAOnRowMatrixExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/NormalizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/SparseNaiveBayes.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/ChiSqSelectorExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/CorrelationsExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/RandomForestRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/mllib/AbstractParams.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SkewedGroupByTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkPi.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/OneVsRestExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/DecisionTreeExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/CountVectorizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/ImputerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/StandardScalerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/GaussianMixtureExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/BucketedRandomProjectionLSHExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/ElementwiseProductExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/CorrelationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/ModelSelectionViaCrossValidationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/ModelSelectionViaTrainValidationSplitExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/RandomForestRegressorExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/MultilayerPerceptronClassifierExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/LogisticRegressionWithElasticNetExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/LogisticRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/VectorSizeHintExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/SummarizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/PrefixSpanExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/ALSExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/MinMaxScalerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/Word2VecExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/InteractionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/NaiveBayesExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/IsotonicRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/StringIndexerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/ChiSquareTestExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/FPGrowthExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/DecisionTreeClassificationExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/KMeansExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/StopWordsRemoverExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/FeatureHasherExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/LinearRegressionWithElasticNetExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/LogisticRegressionSummaryExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/IndexToStringExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/GradientBoostedTreeClassifierExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/GradientBoostedTreeRegressorExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/SQLTransformerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/LDAExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/DecisionTreeRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/LinearSVCExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/TfIdfExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/PCAExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/MulticlassLogisticRegressionWithElasticNetExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/GeneralizedLinearRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/MinHashLSHExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/QuantileDiscretizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/DeveloperApiExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/VectorIndexerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/LinearRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/DCTExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/PolynomialExpansionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/OneHotEncoderEstimatorExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/BinarizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/PowerIterationClusteringExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/DataFrameExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/RandomForestExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/MaxAbsScalerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/RFormulaExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/TokenizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/VectorSlicerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/RandomForestClassifierExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/NGramExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/BisectingKMeansExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/PipelineExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/VectorAssemblerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/AFTSurvivalRegressionExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/BucketizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/UnaryTransformerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/GBTExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/NormalizerExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/EstimatorTransformerParamExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ml/ChiSqSelectorExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/CustomReceiver.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/SqlNetworkWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/RawNetworkGrep.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/StatefulNetworkWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/clickstream/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/clickstream/PageViewGenerator.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/clickstream/PageViewStream.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/DirectKafkaWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/HdfsWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/QueueStream.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/StreamingExamples.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/streaming/NetworkWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkKMeans.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/DFSReadWriteTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/ExceptionHandlingTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkALS.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/LogQuery.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/LocalLR.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/SparkSQLExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/hive/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/hive/SparkHiveExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/RDDRelation.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/streaming/
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCountWindowed.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredKafkaWordCount.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredSessionization.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/UserDefinedUntypedAggregation.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/UserDefinedTypedAggregation.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/sql/SQLDataSourceExample.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/MultiBroadcastTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/LocalALS.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/DriverSubmissionTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/LocalFileLR.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SimpleSkewedGroupByTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/GroupByTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/SparkRemoteFileTest.scala
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/JavaSparkPi.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/JavaTC.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/JavaHdfsLR.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/JavaStatusTrackerDemo.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaGradientBoostingClassificationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaHypothesisTestingExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaElementwiseProductExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaGaussianMixtureExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaAssociationRulesExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaDecisionTreeRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaBinaryClassificationMetricsExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaLBFGSExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaPowerIterationClusteringExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaMulticlassClassificationMetricsExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaRankingMetricsExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaRecommendationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaHypothesisTestingKolmogorovSmirnovTestExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaRegressionMetricsExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaSVDExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaRandomForestClassificationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaRandomForestRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaSummaryStatisticsExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaGradientBoostingRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaIsotonicRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaDecisionTreeClassificationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaALS.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaKMeansExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaSVMWithSGDExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaLinearRegressionWithSGDExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaLatentDirichletAllocationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaMultiLabelClassificationMetricsExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaBisectingKMeansExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaStratifiedSamplingExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaSimpleFPGrowth.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaLogisticRegressionWithLBFGSExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaPrefixSpanExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaPCAExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaCorrelationsExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaStreamingTestExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaNaiveBayesExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaChiSqSelectorExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/mllib/JavaKernelDensityEstimationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaBinarizerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaElementwiseProductExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaInteractionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaGaussianMixtureExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaBucketedRandomProjectionLSHExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaLogisticRegressionWithElasticNetExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaBucketizerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaDecisionTreeRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaIndexToStringExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaCorrelationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaMaxAbsScalerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaGradientBoostedTreeClassifierExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaPowerIterationClusteringExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaDocument.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaLogisticRegressionSummaryExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaStandardScalerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaMulticlassLogisticRegressionWithElasticNetExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaChiSquareTestExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaFPGrowthExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaQuantileDiscretizerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaPolynomialExpansionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaTokenizerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaFeatureHasherExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaVectorIndexerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaVectorSlicerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaStringIndexerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaIsotonicRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaMultilayerPerceptronClassifierExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaOneVsRestExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaRFormulaExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaDecisionTreeClassificationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaLDAExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaDCTExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaKMeansExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaModelSelectionViaCrossValidationExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaSummarizerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaRandomForestClassifierExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaImputerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaMinMaxScalerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaEstimatorTransformerParamExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaOneHotEncoderEstimatorExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaSQLTransformerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaLabeledDocument.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaStopWordsRemoverExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaTfIdfExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaMinHashLSHExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaBisectingKMeansExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaLinearRegressionWithElasticNetExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaNGramExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaModelSelectionViaTrainValidationSplitExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaPrefixSpanExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaWord2VecExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaGradientBoostedTreeRegressorExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaAFTSurvivalRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaPCAExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaCountVectorizerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaGeneralizedLinearRegressionExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaVectorSizeHintExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaNaiveBayesExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaNormalizerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaChiSqSelectorExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaVectorAssemblerExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaRandomForestRegressorExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaLinearSVCExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaPipelineExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/ml/JavaALSExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaStatefulNetworkWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaNetworkWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaCustomReceiver.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaDirectKafkaWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaQueueStream.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaSqlNetworkWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecord.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/JavaSparkSQLExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/hive/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/hive/JavaSparkHiveExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/JavaUserDefinedTypedAggregation.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/JavaUserDefinedUntypedAggregation.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/streaming/
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredKafkaWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredNetworkWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredNetworkWordCountWindowed.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredSessionization.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/JavaWordCount.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/JavaLogQuery.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/java/org/apache/spark/examples/JavaPageRank.java
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/RSparkSQLExample.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/glm.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/als.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/kmeans.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/mlp.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/lda.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/ml.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/naiveBayes.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/kstest.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/gbt.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/survreg.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/svmLinear.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/bisectingKmeans.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/gaussianMixture.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/isoreg.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/randomForest.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/decisionTree.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/logit.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/ml/fpm.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/data-manipulation.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/streaming/
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/streaming/structured_network_wordcount.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/r/dataframe.R
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/people.csv
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/users.avro
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/employees.json
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/full_user.avsc
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/people.json
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/people.txt
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/kv1.txt
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/users.parquet
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/users.orc
spark-2.4.3-bin-hadoop2.7/examples/src/main/resources/user.avsc
spark-2.4.3-bin-hadoop2.7/NOTICE
spark-2.4.3-bin-hadoop2.7/data/
spark-2.4.3-bin-hadoop2.7/data/graphx/
spark-2.4.3-bin-hadoop2.7/data/graphx/users.txt
spark-2.4.3-bin-hadoop2.7/data/graphx/followers.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/
spark-2.4.3-bin-hadoop2.7/data/mllib/gmm_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/images/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/multi-channel/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/multi-channel/chr30.4.184.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/multi-channel/grayscale.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/multi-channel/BGRA_alpha_60.png
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/multi-channel/BGRA.png
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/kittens/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/kittens/DP153539.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/kittens/54893.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/kittens/not-image.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/kittens/DP802813.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/kittens/29.5.a_b_EGDP022204.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/origin/license.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/images/license.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=multichannel/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=multichannel/date=2018-02/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=multichannel/date=2018-02/chr30.4.184.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=multichannel/date=2018-02/grayscale.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=multichannel/date=2018-01/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=multichannel/date=2018-01/BGRA_alpha_60.png
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=multichannel/date=2018-01/BGRA.png
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/date=2018-02/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/date=2018-02/DP153539.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/date=2018-02/54893.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/date=2018-02/DP802813.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/date=2018-01/
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/date=2018-01/not-image.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/images/partitioned/cls=kittens/date=2018-01/29.5.a_b_EGDP022204.jpg
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_linear_regression_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_lda_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/kmeans_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_svm_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/streaming_kmeans_data_test.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_kmeans_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_multiclass_classification_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_fpgrowth.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/pic_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/pagerank_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_isotonic_regression_libsvm_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/als/
spark-2.4.3-bin-hadoop2.7/data/mllib/als/test.data
spark-2.4.3-bin-hadoop2.7/data/mllib/als/sample_movielens_ratings.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_lda_libsvm_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_binary_classification_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/ridge-data/
spark-2.4.3-bin-hadoop2.7/data/mllib/ridge-data/lpsa.data
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_movielens_data.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/iris_libsvm.txt
spark-2.4.3-bin-hadoop2.7/data/mllib/sample_libsvm_data.txt
spark-2.4.3-bin-hadoop2.7/data/streaming/
spark-2.4.3-bin-hadoop2.7/data/streaming/AFINN-111.txt
spark-2.4.3-bin-hadoop2.7/README.md
spark-2.4.3-bin-hadoop2.7/LICENSE
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ ls
14-Aug-19_19-13-19_shell.log spark-2.4.3-bin-hadoop2.7 spark-2.4.3-bin-hadoop2.7.tgz
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi .bashrc
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l".bashrc" 120L, 3897C▽ [>c]10;?]11;?# If this is an xterm set the title to user@host:dir
case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
 ;;
*)
 ;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
 test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
 alias ls='ls --color=auto'
#alias dir='dir --color=auto'
 #alias vdir='vdir --color=auto'alias grep='grep --color=auto'
 alias fgrep='fgrep --color=auto'
 alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s**[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
  . ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
 if [ -f /usr/share/bash-completion/bash_completion ]; then
  . /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
  . /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)120,0-1Bot[?25h[?12$p[?25lG [?25h[?25lo 
-- INSERT --121,1Bot
121,1Bot[?25h[?25lexport SPARK_HOME=<path-to-the-root-of-your-spark-installation> [?25h[?25l(eg: /home/dataflair/spark-1.6.1-bin-hadoop2.6/)()13[?25h[?25l^[ 121,112Bot[?25h[?25lh ()1[?25h[?25lh 0[?25h[?25lh 09[?25h[?25lh 8[?25h[?25lh 7[?25h[?25lh 6[?25h[?25lh 5[?25h[?25lh 4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 99 [?25h[?25lh 8[?25h[?25lh 7[?25h[?25lh 6[?25h[?25lh 5[?25h[?25lh 4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 89[?25h[?25lh 8[?25h[?25lh 7[?25h[?25lh 6[?25h[?25l::[?2004h[?25hw[?25l[?25hq[?25l[?25h [?25l[?2004l".bashrc" 121L, 4010C written
[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ cd spark-2.4.3-bin-hadoop2.7/
]0;ubuntu@experiment-33bafd31037788eb: ~/spark-2.4.3-bin-hadoop2.7ubuntu@experiment-33bafd31037788eb:~/spark-2.4.3-bin-hadoop2.7$ pwd
/home/ubuntu/spark-2.4.3-bin-hadoop2.7
]0;ubuntu@experiment-33bafd31037788eb: ~/spark-2.4.3-bin-hadoop2.7ubuntu@experiment-33bafd31037788eb:~/spark-2.4.3-bin-hadoop2.7$ cd ..
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi .bashrc
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l".bashrc" 121L, 4010C▽ [>c]10;?]11;?# If this is an xterm set the title to user@host:dir
case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
 ;;
*)
 ;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
 test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
 alias ls='ls --color=auto'
#alias dir='dir --color=auto'
 #alias vdir='vdir --color=auto'alias grep='grep --color=auto'
 alias fgrep='fgrep --color=auto'
 alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s**[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
  . ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
 if [ -f /usr/share/bash-completion/bash_completion ]; then
  . /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
  . /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export SPARK_HOME=<path-to-the-root-of-your-spark-installation> (eg: /home/dataflair/spark-1.6.1-bin-hadoop2.6/)121,86Bot[?25h[?12$p[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lj [?25h[?25lk 0,0-1[?25h[?25lh [?25h[?25ll [?25h[?25lj 1,86 [?25h[?25l% ()65[?25h[?25lh  ()4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 59[?25h[?25lh 8[?25h[?25lh 7[?25h[?25lh 6[?25h[?25lh 5[?25h[?25lh 4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 49[?25h[?25lh 8[?25h[?25lh 7[?25h[?25lh 6[?25h[?25lh 5[?25h[?25lh 4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 39[?25h[?25lh 8[?25h[?25lh 7[?25h[?25lh 6[?25h[?25lh 5[?25h[?25lh 4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 29[?25h[?25lh 8[?25h[?25lh 7[?25h[?25lh 6[?25h[?25lh 5[?25h[?25lh 4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 19[?25h[?25lD d$ 8[?25h[?25la 
-- INSERT --121,19Bot[?25h[?25l/home/ubuntu/spark-2.4.3-bin-hadoop2.757[?25h[?25l/8[?25h[?25l^[ 121,57Bot[?25h[?25l::[?2004h[?25hw[?25l[?25hq[?25l[?25h [?25l[?2004l".bashrc" 121L, 3955C written
[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ tail .vabashrc
if [ -f /usr/share/bash-completion/bash_completion ]; then
. /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
. /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ which jvaava
/usr/bin/java
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ javaenv
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:
SSH_CONNECTION=70.121.76.136 53080 10.128.0.46 22
LESSCLOSE=/usr/bin/lesspipe %s %s
LANG=C.UTF-8
OLDPWD=/home/ubuntu/spark-2.4.3-bin-hadoop2.7
SSH_AUTH_SOCK=/tmp/ssh-VBleXQV95u/agent.9611
XDG_SESSION_ID=3
USER=ubuntu
PWD=/home/ubuntu
HOME=/home/ubuntu
LC_CTYPE=en_US.UTF-8
LC_TERMINAL=iTerm2
SSH_CLIENT=70.121.76.136 53080 22
LC_TERMINAL_VERSION=3.3.1
XDG_DATA_DIRS=/usr/local/share:/usr/share:/var/lib/snapd/desktop
SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/
SSH_TTY=/dev/pts/0
MAIL=/var/mail/ubuntu
SHELL=/bin/bash
TERM=xterm-256color
SHLVL=2
LOGNAME=ubuntu
XDG_RUNTIME_DIR=/run/user/1000
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
LESSOPEN=| /usr/bin/lesspipe %s
_=/usr/bin/env
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ bi .nvi .bashrc
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l".bashrc" 121L, 3955C▽ [>c]10;?]11;?# If this is an xterm set the title to user@host:dir
case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
 ;;
*)
 ;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
 test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
 alias ls='ls --color=auto'
#alias dir='dir --color=auto'
 #alias vdir='vdir --color=auto'alias grep='grep --color=auto'
 alias fgrep='fgrep --color=auto'
 alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s**[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
  . ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
 if [ -f /usr/share/bash-completion/bash_completion ]; then
  . /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
  . /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/121,57Bot[?25h[?12$p[?25lo 
-- INSERT --122,1Bot
122,1Bot[?25h[?25l^[ 122,0-1Bot[?25h[?25lk 1,1 [?25h[?25lk 0,0-1[?25h[?25li 
-- INSERT --120,1Bot[?25h[?25lexport JAVA_HOME=/usr/lib/jvm/default-java/jre47[?25h[?25l^[ 120,46Bot[?25h[?25l::[?2004h[?25hw[?25l[?25hq[?25l[?25h [?25l[?2004l".bashrc" 122L, 4002C written
[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ tail .bashrc
. /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
. /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/jre
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ ls /usr/loib/jvm/default-java/jmods/jr
bin/ conf/ docs/ include/ jmods/ legal/ lib/ man/ release
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ ls /usr/lib/jvm/default-java/
bin/ conf/ docs/ include/ jmods/ legal/ lib/ man/ release
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ ls /usr/lib/jvm/default-java/^C
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi ~/.bashrc
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l"~/.bashrc" 122L, 4002C▽ [>c]10;?]11;?case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
 ;;
*)
 ;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
 test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
 alias ls='ls --color=auto'
#alias dir='dir --color=auto'
 #alias vdir='vdir --color=auto'alias grep='grep --color=auto'
 alias fgrep='fgrep --color=auto'
 alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s**[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
  . ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
 if [ -f /usr/share/bash-completion/bash_completion ]; then
  . /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
  . /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/jre
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/120,46Bot[?25h[?12$p[?25lh 5[?25h[?25lh 4[?25h[?25lD d$ 3[?25h[?25l::[?2004h[?25hw[?25l[?25hq[?25l[?25h [?25l[?2004l".bashrc" 122L, 3999C written
[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ export JAVA_HOME=/usr/lib/jvm/default-java/
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ export JAVA_HOME=/usr/lib/jvm/default-java/
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi .bashrc
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l".bashrc" 122L, 3999C▽ [>c]10;?]11;?case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
 ;;
*)
 ;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
 test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
 alias ls='ls --color=auto'
#alias dir='dir --color=auto'
 #alias vdir='vdir --color=auto'alias grep='grep --color=auto'
 alias fgrep='fgrep --color=auto'
 alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s**[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
  . ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
 if [ -f /usr/share/bash-completion/bash_completion ]; then
  . /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
  . /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/120,43Bot[?25h[?12$p[?25lj 1[?25h[?25ll 4[?25h[?25ll 5[?25h[?25ll 6[?25h[?25ll 7[?25h[?25ll 8[?25h[?25ll 9[?25h[?25ll 50[?25h[?25ll 1[?25h[?25ll 2[?25h[?25ll 3[?25h[?25ll 4[?25h[?25ll 5[?25h[?25ll 6[?25h[?25ll 7[?25h[?25ll [?25h[?25la 
-- INSERT --121,58Bot[?25h[?25lb9[?25h[?25li60[?25h[?25ln1[?25h[?25l^[ 121,60Bot[?25h[?25lo 
-- INSERT --122,1Bot
122,1Bot[?25h[?25lexport PATH=$PATH:SPARK_HOME29[?25h[?25l^[ 122,28Bot[?25h[?25lh 7[?25h[?25lh 6[?25h[?25lh 5[?25h[?25lh 4[?25h[?25lh 3[?25h[?25lh 2[?25h[?25lh 1[?25h[?25lh 0[?25h[?25lh 19[?25h[?25ll 20[?25h[?25lh 19[?25h[?25li 
-- INSERT --122,19Bot[?25h[?25l$SPARK_HOME20[?25h[?25l^[ 122,19Bot[?25h[?25l::[?2004h[?25hw[?25l[?25hq[?25l[?25h [?25l[?2004l".bashrc" 123L, 4032C written
[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ cat .bashrc
# ~/.bashrc: executed by bash(1) for non-login shells.
# see /usr/share/doc/bash/examples/startup-files (in the package bash-doc)
# for examples
# If not running interactively, don't do anything
case $- in
*i*) ;;
*) return;;
esac
# don't put duplicate lines or lines starting with space in the history.
# See bash(1) for more options
HISTCONTROL=ignoreboth
# append to the history file, don't overwrite it
shopt -s histappend
# for setting history length see HISTSIZE and HISTFILESIZE in bash(1)
HISTSIZE=1000
HISTFILESIZE=2000
# check the window size after each command and, if necessary,
# update the values of LINES and COLUMNS.
shopt -s checkwinsize
# If set, the pattern "**" used in a pathname expansion context will
# match all files and zero or more directories and subdirectories.
#shopt -s globstar
# make less more friendly for non-text input files, see lesspipe(1)
[ -x /usr/bin/lesspipe ] && eval "$(SHELL=/bin/sh lesspipe)"
# set variable identifying the chroot you work in (used in the prompt below)
if [ -z "${debian_chroot:-}" ] && [ -r /etc/debian_chroot ]; then
debian_chroot=$(cat /etc/debian_chroot)
fi
# set a fancy prompt (non-color, unless we know we "want" color)
case "$TERM" in
xterm-color|*-256color) color_prompt=yes;;
esac
# uncomment for a colored prompt, if the terminal has the capability; turned
# off by default to not distract the user: the focus in a terminal window
# should be on the output of commands, not on the prompt
#force_color_prompt=yes
if [ -n "$force_color_prompt" ]; then
if [ -x /usr/bin/tput ] && tput setaf 1 >&/dev/null; then
# We have color support; assume it's compliant with Ecma-48
# (ISO/IEC-6429). (Lack of such support is extremely rare, and such
# a case would tend to support setf rather than setaf.)
color_prompt=yes
else
color_prompt=
fi
fi
if [ "$color_prompt" = yes ]; then
PS1='${debian_chroot:+($debian_chroot)}\[\033[01;32m\]\u@\h\[\033[00m\]:\[\033[01;34m\]\w\[\033[00m\]\$ '
else
PS1='${debian_chroot:+($debian_chroot)}\u@\h:\w\$ '
fi
unset color_prompt force_color_prompt
# If this is an xterm set the title to user@host:dir
case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
;;
*)
;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
alias ls='ls --color=auto'
#alias dir='dir --color=auto'
#alias vdir='vdir --color=auto'
alias grep='grep --color=auto'
alias fgrep='fgrep --color=auto'
alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s*[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
. ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
if [ -f /usr/share/bash-completion/bash_completion ]; then
. /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
. /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/bin
export PATH=$PATH:$SPARK_HOME
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ PATH=$PATH:$SPARK_HOMEePATH=$PATH:$SPARK_HOMExPATH=$PATH:$SPARK_HOMEpPATH=$PATH:$SPARK_HOMEoPATH=$PATH:$SPARK_HOMErPATH=$PATH:$SPARK_HOMEtPATH=$PATH:$SPARK_HOME PATH=$PATH:$SPARK_HOME
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ spark-shell
spark-shell: command not found
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ echo $SPARK_HOME
/home/ubuntu/spark-2.4.3-bin-hadoop2.7/
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ echo $SPARK_HOMEspark-shellecho $SPARK_HOMEspark-shellexport PATH=$PATH:$SPARK_HOME/bin
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ export PATH=$PATH:$SPARK_HOME/bincho $SPARK_HOMEspark-shell
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/ubuntu/spark-2.4.3-bin-hadoop2.7/jars/spark-unsafe_2.11-2.4.3.jar) to method java.nio.Bits.unaligned()
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
19/08/14 19:26:26 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://experiment-33bafd31037788eb.c.pilosa-sandbox.internal:4040
Spark context available as 'sc' (master = local[*], app id = local-1565810792818).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.3
/_/
Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 11.0.4)
Type in expressions to have them evaluated.
Type :help for more information.
scala> :quit
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi .bashrc
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l".bashrc" 123L, 4032C▽ [>c]10;?]11;?xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
 ;;
*)
 ;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
 test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
 alias ls='ls --color=auto'
#alias dir='dir --color=auto'
 #alias vdir='vdir --color=auto'alias grep='grep --color=auto'
 alias fgrep='fgrep --color=auto'
 alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s**[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
  . ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
 if [ -f /usr/share/bash-completion/bash_completion ]; then
  . /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
  . /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/bin
export PATH=$PATH:$SPARK_HOME122,19Bot[?25h[?12$p[?25ll 20[?25h[?25lk 1[?25h[?25ll 1[?25h[?25lj 2[?25h[?25l::[?2004h[?25hw[?25l[?25hq[?25l[?25h [?25l[?2004l".bashrc" 123L, 4032C written
[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ cat .bashrc
# ~/.bashrc: executed by bash(1) for non-login shells.
# see /usr/share/doc/bash/examples/startup-files (in the package bash-doc)
# for examples
# If not running interactively, don't do anything
case $- in
*i*) ;;
*) return;;
esac
# don't put duplicate lines or lines starting with space in the history.
# See bash(1) for more options
HISTCONTROL=ignoreboth
# append to the history file, don't overwrite it
shopt -s histappend
# for setting history length see HISTSIZE and HISTFILESIZE in bash(1)
HISTSIZE=1000
HISTFILESIZE=2000
# check the window size after each command and, if necessary,
# update the values of LINES and COLUMNS.
shopt -s checkwinsize
# If set, the pattern "**" used in a pathname expansion context will
# match all files and zero or more directories and subdirectories.
#shopt -s globstar
# make less more friendly for non-text input files, see lesspipe(1)
[ -x /usr/bin/lesspipe ] && eval "$(SHELL=/bin/sh lesspipe)"
# set variable identifying the chroot you work in (used in the prompt below)
if [ -z "${debian_chroot:-}" ] && [ -r /etc/debian_chroot ]; then
debian_chroot=$(cat /etc/debian_chroot)
fi
# set a fancy prompt (non-color, unless we know we "want" color)
case "$TERM" in
xterm-color|*-256color) color_prompt=yes;;
esac
# uncomment for a colored prompt, if the terminal has the capability; turned
# off by default to not distract the user: the focus in a terminal window
# should be on the output of commands, not on the prompt
#force_color_prompt=yes
if [ -n "$force_color_prompt" ]; then
if [ -x /usr/bin/tput ] && tput setaf 1 >&/dev/null; then
# We have color support; assume it's compliant with Ecma-48
# (ISO/IEC-6429). (Lack of such support is extremely rare, and such
# a case would tend to support setf rather than setaf.)
color_prompt=yes
else
color_prompt=
fi
fi
if [ "$color_prompt" = yes ]; then
PS1='${debian_chroot:+($debian_chroot)}\[\033[01;32m\]\u@\h\[\033[00m\]:\[\033[01;34m\]\w\[\033[00m\]\$ '
else
PS1='${debian_chroot:+($debian_chroot)}\u@\h:\w\$ '
fi
unset color_prompt force_color_prompt
# If this is an xterm set the title to user@host:dir
case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
;;
*)
;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
alias ls='ls --color=auto'
#alias dir='dir --color=auto'
#alias vdir='vdir --color=auto'
alias grep='grep --color=auto'
alias fgrep='fgrep --color=auto'
alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s*[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
. ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
if [ -f /usr/share/bash-completion/bash_completion ]; then
. /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
. /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/bin
export PATH=$PATH:$SPARK_HOME
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ history
1 ls
2 exit
3 script
4 rm typescript
5 ls
6 vi .bashrc
7 exit
8 df
9 sudo apt-get install default-jdk
10 sudo apt-get install scala
11 ls
12 vi fun
13 tail 14-Aug-19_19-13-19_shell.log
14 2R0;95;0c10;rgb:c7/c7/c711;rgb:00/00/0012;4$y
15 clear
16 sudo apt-get install hiy
17 sudo apt-get install git
18 df -h
19 wget https://www.apache.org/dyn/closer.lua/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
20 tar -zxvf spark-2.4.3-bin-hadoop2.7.tgz
21 tar -zxf spark-2.4.3-bin-hadoop2.7.tgz
22 file spark-2.4.3-bin-hadoop2.7.tgz
23 rm spark-2.4.3-bin-hadoop2.7.tgz
24 wget http://apache.mirrors.hoobly.com/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
25 ls
26 tar -zxvf spark-2.4.3-bin-hadoop2.7.tgz
27 ls
28 vi .bashrc
29 cd spark-2.4.3-bin-hadoop2.7/
30 pwd
31 cd ..
32 vi .bashrc
33 tail .bashrc
34 export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/
35 which java
36 env
37 vi .bashrc
38 tail .bashrc
39 vi ~/.bashrc
40 export JAVA_HOME=/usr/lib/jvm/default-java/
41 export JAVA_HOME=/usr/lib/jvm/default-java
42 vi .bashrc
43 cat .bashrc
44 export PATH=$PATH:$SPARK_HOME
45 spark-shell
46 echo $SPARK_HOME
47 export PATH=$PATH:$SPARK_HOME/bin
48 spark-shell
49 vi .bashrc
50 cat .bashrc
51 history
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ vi b..bashrc
[?2004h[?1049h[?1h=[?2004h[?12h[?12l[?25l".bashrc" 123L, 4032C▽ [>c]10;?]11;?xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
 ;;
*)
 ;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
 test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
 alias ls='ls --color=auto'
#alias dir='dir --color=auto'
 #alias vdir='vdir --color=auto'alias grep='grep --color=auto'
 alias fgrep='fgrep --color=auto'
 alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s**[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
  . ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
 if [ -f /usr/share/bash-completion/bash_completion ]; then
  . /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
  . /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/bin
export PATH=$PATH:$SPARK_HOME122,21Bot[?25h[?12$p[?25l::[?2004h[?25hq [?25l[?2004l[?2004l[?1l>[?25h[?1049l]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ spark-shell
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/ubuntu/spark-2.4.3-bin-hadoop2.7/jars/spark-unsafe_2.11-2.4.3.jar) to method java.nio.Bits.unaligned()
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
19/08/14 19:29:58 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://experiment-33bafd31037788eb.c.pilosa-sandbox.internal:4040
Spark context available as 'sc' (master = local[*], app id = local-1565811005410).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.3
/_/
Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 11.0.4)
Type in expressions to have them evaluated.
Type :help for more information.
scala> :quite
quite: no such command. Type :help for help.
scala> :quit
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ cd /mnt/data
bash: cd: /mnt/data: No such file or directory
]0;ubuntu@experiment-33bafd31037788eb: ~ubuntu@experiment-33bafd31037788eb:~$ cd /mnt/datadisks/data1/
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ touch f
touch: cannot touch 'f': Permission denied
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ sudo chown ubuntu.bubbuntu .
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ touchf  f
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ls
f lost+found
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ rm f
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ wget https://s3.amazonaws.com/nyc-tlc/trip+data/yellow_tripdata_2015-01.cs sv
--2019-08-14 19:49:21-- https://s3.amazonaws.com/nyc-tlc/trip+data/yellow_tripdata_2015-01.csv
Resolving s3.amazonaws.com (s3.amazonaws.com)... 52.216.229.77
Connecting to s3.amazonaws.com (s3.amazonaws.com)|52.216.229.77|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1985964692 (1.8G) [application/octet-stream]
Saving to: ‘yellow_tripdata_2015-01.csv’
yellow_tripdata_2015-01.csv 0%[ ] 0 --.-KB/s yellow_tripdata_2015-01.csv 0%[ ] 2.34M 10.6MB/s yellow_tripdata_2015-01.csv 1%[ ] 21.42M 50.9MB/s yellow_tripdata_2015-01.csv 2%[> ] 40.37M 64.0MB/s yellow_tripdata_2015-01.csv 3%[> ] 59.62M 71.8MB/s yellow_tripdata_2015-01.csv 4%[=> ] 78.98M 75.8MB/s yellow_tripdata_2015-01.csv 5%[=> ] 97.99M 78.6MB/s yellow_tripdata_2015-01.csv 6%[==> ] 114.99M 79.0MB/s yellow_tripdata_2015-01.csv 6%[==> ] 128.13M 75.0MB/s yellow_tripdata_2015-01.csv 7%[===> ] 146.62M 76.5MB/s yellow_tripdata_2015-01.csv 8%[===> ] 163.49M 77.1MB/s yellow_tripdata_2015-01.csv 9%[====> ] 183.04M 78.9MB/s yellow_tripdata_2015-01.csv 10%[====> ] 198.58M 78.8MB/s yellow_tripdata_2015-01.csv 11%[=====> ] 216.73M 79.7MB/s yellow_tripdata_2015-01.csv 12%[=====> ] 234.98M 80.3MB/s yellow_tripdata_2015-01.csv 13%[======> ] 254.15M 81.3MB/s eta 20s yellow_tripdata_2015-01.csv 14%[======> ] 270.85M 85.1MB/s eta 20s yellow_tripdata_2015-01.csv 15%[=======> ] 285.42M 85.4MB/s eta 20s yellow_tripdata_2015-01.csv 16%[=======> ] 304.42M 85.6MB/s eta 20s yellow_tripdata_2015-01.csv 17%[========> ] 323.28M 85.1MB/s eta 20s yellow_tripdata_2015-01.csv 18%[========> ] 342.69M 85.4MB/s eta 19s yellow_tripdata_2015-01.csv 19%[=========> ] 361.92M 85.4MB/s eta 19s yellow_tripdata_2015-01.csv 20%[=========> ] 381.22M 85.8MB/s eta 19s yellow_tripdata_2015-01.csv 21%[==========> ] 400.47M 86.4MB/s eta 19s yellow_tripdata_2015-01.csv 22%[==========> ] 418.50M 89.6MB/s eta 19s yellow_tripdata_2015-01.csv 23%[===========> ] 437.48M 90.0MB/s eta 17s yellow_tripdata_2015-01.csv 24%[============> ] 456.16M 90.5MB/s eta 17s yellow_tripdata_2015-01.csv 25%[============> ] 474.81M 90.5MB/s eta 17s yellow_tripdata_2015-01.csv 26%[=============> ] 493.06M 91.1MB/s eta 17s yellow_tripdata_2015-01.csv 26%[=============> ] 506.65M 89.9MB/s eta 17s yellow_tripdata_2015-01.csv 27%[=============> ] 512.00M 85.6MB/s eta 17s yellow_tripdata_2015-01.csv 27%[==============> ] 528.95M 85.1MB/s eta 17s yellow_tripdata_2015-01.csv 28%[==============> ] 547.72M 87.0MB/s eta 17s yellow_tripdata_2015-01.csv 29%[===============> ] 566.29M 87.0MB/s eta 17s yellow_tripdata_2015-01.csv 30%[===============> ] 584.83M 87.1MB/s eta 17s yellow_tripdata_2015-01.csv 31%[================> ] 603.40M 86.7MB/s eta 15s yellow_tripdata_2015-01.csv 32%[================> ] 612.77M 83.3MB/s eta 15s yellow_tripdata_2015-01.csv 33%[================> ] 631.08M 83.3MB/s eta 15s yellow_tripdata_2015-01.csv 34%[=================> ] 648.70M 82.9MB/s eta 15s yellow_tripdata_2015-01.csv 35%[==================> ] 667.07M 82.9MB/s eta 15s yellow_tripdata_2015-01.csv 35%[==================> ] 681.59M 81.2MB/s eta 15s yellow_tripdata_2015-01.csv 36%[==================> ] 700.45M 81.4MB/s eta 15s yellow_tripdata_2015-01.csv 37%[===================> ] 718.43M 81.1MB/s eta 15s yellow_tripdata_2015-01.csv 38%[====================> ] 737.23M 81.0MB/s eta 15s yellow_tripdata_2015-01.csv 39%[====================> ] 748.55M 78.9MB/s eta 15s yellow_tripdata_2015-01.csv 40%[====================> ] 757.92M 77.6MB/s eta 14s yellow_tripdata_2015-01.csv 40%[====================> ] 770.79M 78.5MB/s eta 14s yellow_tripdata_2015-01.csv 41%[=====================> ] 790.20M 80.7MB/s eta 14s yellow_tripdata_2015-01.csv 42%[======================> ] 809.17M 80.6MB/s eta 14s yellow_tripdata_2015-01.csv 43%[======================> ] 828.33M 81.1MB/s eta 14s yellow_tripdata_2015-01.csv 44%[=======================> ] 846.08M 80.5MB/s eta 13s yellow_tripdata_2015-01.csv 45%[=======================> ] 864.37M 80.3MB/s eta 13s yellow_tripdata_2015-01.csv 46%[========================> ] 883.37M 83.8MB/s eta 13s yellow_tripdata_2015-01.csv 47%[========================> ] 902.65M 83.9MB/s eta 13s yellow_tripdata_2015-01.csv 48%[=========================> ] 921.67M 83.9MB/s eta 13s yellow_tripdata_2015-01.csv 49%[=========================> ] 940.87M 84.7MB/s eta 11s yellow_tripdata_2015-01.csv 50%[==========================> ] 959.31M 86.1MB/s eta 11s yellow_tripdata_2015-01.csv 51%[==========================> ] 977.69M 85.7MB/s eta 11s yellow_tripdata_2015-01.csv 52%[===========================> ] 993.99M 84.7MB/s eta 11s yellow_tripdata_2015-01.csv 53%[===========================> ] 1011M 84.1MB/s eta 11s yellow_tripdata_2015-01.csv 54%[============================> ] 1.00G 85.7MB/s eta 10s yellow_tripdata_2015-01.csv 54%[============================> ] 1.02G 84.3MB/s eta 10s yellow_tripdata_2015-01.csv 55%[=============================> ] 1.03G 83.8MB/s eta 10s yellow_tripdata_2015-01.csv 56%[=============================> ] 1.05G 83.1MB/s eta 10s yellow_tripdata_2015-01.csv 57%[=============================> ] 1.06G 79.6MB/s eta 10s yellow_tripdata_2015-01.csv 57%[==============================> ] 1.06G 76.2MB/s eta 10s yellow_tripdata_2015-01.csv 57%[==============================> ] 1.07G 71.2MB/s eta 10s yellow_tripdata_2015-01.csv 58%[==============================> ] 1.07G 66.8MB/s eta 10s yellow_tripdata_2015-01.csv 58%[==============================> ] 1.08G 60.6MB/s eta 10s yellow_tripdata_2015-01.csv 58%[==============================> ] 1.09G 57.2MB/s eta 10s yellow_tripdata_2015-01.csv 58%[==============================> ] 1.09G 52.3MB/s eta 10s yellow_tripdata_2015-01.csv 59%[==============================> ] 1.09G 48.3MB/s eta 10s yellow_tripdata_2015-01.csv 59%[===============================> ] 1.10G 44.8MB/s eta 10s yellow_tripdata_2015-01.csv 59%[===============================> ] 1.10G 40.3MB/s eta 10s yellow_tripdata_2015-01.csv 60%[===============================> ] 1.11G 38.4MB/s eta 10s yellow_tripdata_2015-01.csv 60%[===============================> ] 1.12G 35.4MB/s eta 10s yellow_tripdata_2015-01.csv 60%[===============================> ] 1.12G 34.4MB/s eta 10s yellow_tripdata_2015-01.csv 61%[===============================> ] 1.13G 33.1MB/s eta 10s yellow_tripdata_2015-01.csv 62%[================================> ] 1.15G 34.0MB/s eta 10s yellow_tripdata_2015-01.csv 62%[================================> ] 1.16G 35.4MB/s eta 10s yellow_tripdata_2015-01.csv 63%[=================================> ] 1.17G 34.7MB/s eta 10s yellow_tripdata_2015-01.csv 64%[=================================> ] 1.19G 37.3MB/s eta 10s yellow_tripdata_2015-01.csv 65%[==================================> ] 1.21G 42.1MB/s eta 10s yellow_tripdata_2015-01.csv 66%[==================================> ] 1.22G 45.7MB/s eta 10s yellow_tripdata_2015-01.csv 67%[===================================> ] 1.24G 49.9MB/s eta 10s yellow_tripdata_2015-01.csv 67%[===================================> ] 1.26G 53.9MB/s eta 8s yellow_tripdata_2015-01.csv 68%[====================================> ] 1.27G 57.0MB/s eta 8s yellow_tripdata_2015-01.csv 69%[====================================> ] 1.28G 56.9MB/s eta 8s yellow_tripdata_2015-01.csv 69%[====================================> ] 1.29G 59.6MB/s eta 8s yellow_tripdata_2015-01.csv 70%[====================================> ] 1.29G 58.0MB/s eta 8s yellow_tripdata_2015-01.csv 70%[=====================================> ] 1.30G 58.8MB/s eta 8s yellow_tripdata_2015-01.csv 70%[=====================================> ] 1.31G 58.3MB/s eta 8s yellow_tripdata_2015-01.csv 70%[=====================================> ] 1.31G 57.4MB/s eta 8s yellow_tripdata_2015-01.csv 71%[=====================================> ] 1.32G 55.7MB/s eta 8s yellow_tripdata_2015-01.csv 71%[=====================================> ] 1.32G 52.6MB/s eta 8s yellow_tripdata_2015-01.csv 71%[=====================================> ] 1.33G 48.6MB/s eta 8s yellow_tripdata_2015-01.csv 71%[=====================================> ] 1.33G 44.4MB/s eta 8s yellow_tripdata_2015-01.csv 72%[=====================================> ] 1.33G 42.6MB/s eta 8s yellow_tripdata_2015-01.csv 72%[======================================> ] 1.34G 38.8MB/s eta 8s yellow_tripdata_2015-01.csv 72%[======================================> ] 1.34G 36.0MB/s eta 8s yellow_tripdata_2015-01.csv 73%[======================================> ] 1.35G 30.3MB/s eta 8s yellow_tripdata_2015-01.csv 73%[======================================> ] 1.36G 28.5MB/s eta 8s yellow_tripdata_2015-01.csv 73%[======================================> ] 1.36G 25.3MB/s eta 8s yellow_tripdata_2015-01.csv 73%[======================================> ] 1.37G 23.3MB/s eta 8s yellow_tripdata_2015-01.csv 74%[=======================================> ] 1.37G 22.7MB/s eta 8s yellow_tripdata_2015-01.csv 74%[=======================================> ] 1.38G 22.5MB/s eta 8s yellow_tripdata_2015-01.csv 75%[=======================================> ] 1.39G 24.8MB/s eta 8s yellow_tripdata_2015-01.csv 75%[=======================================> ] 1.40G 25.5MB/s eta 8s yellow_tripdata_2015-01.csv 76%[========================================> ] 1.41G 27.7MB/s eta 8s yellow_tripdata_2015-01.csv 77%[========================================> ] 1.42G 29.6MB/s eta 7s yellow_tripdata_2015-01.csv 77%[========================================> ] 1.43G 29.2MB/s eta 7s yellow_tripdata_2015-01.csv 77%[========================================> ] 1.43G 30.6MB/s eta 7s yellow_tripdata_2015-01.csv 78%[=========================================> ] 1.44G 32.5MB/s eta 7s yellow_tripdata_2015-01.csv 79%[=========================================> ] 1.46G 36.5MB/s eta 7s yellow_tripdata_2015-01.csv 79%[=========================================> ] 1.47G 38.1MB/s eta 6s yellow_tripdata_2015-01.csv 80%[==========================================> ] 1.48G 40.5MB/s eta 6s yellow_tripdata_2015-01.csv 81%[==========================================> ] 1.50G 43.5MB/s eta 6s yellow_tripdata_2015-01.csv 81%[===========================================> ] 1.51G 44.5MB/s eta 6s yellow_tripdata_2015-01.csv 82%[===========================================> ] 1.52G 46.9MB/s eta 6s yellow_tripdata_2015-01.csv 83%[===========================================> ] 1.54G 53.6MB/s eta 5s yellow_tripdata_2015-01.csv 84%[============================================> ] 1.56G 56.6MB/s eta 5s yellow_tripdata_2015-01.csv 84%[============================================> ] 1.57G 59.9MB/s eta 5s yellow_tripdata_2015-01.csv 85%[=============================================> ] 1.59G 61.3MB/s eta 5s yellow_tripdata_2015-01.csv 86%[=============================================> ] 1.61G 63.0MB/s eta 5s yellow_tripdata_2015-01.csv 87%[==============================================> ] 1.62G 65.9MB/s eta 4s yellow_tripdata_2015-01.csv 88%[==============================================> ] 1.63G 66.4MB/s eta 4s yellow_tripdata_2015-01.csv 88%[==============================================> ] 1.64G 66.5MB/s eta 4s yellow_tripdata_2015-01.csv 89%[===============================================> ] 1.66G 69.1MB/s eta 4s yellow_tripdata_2015-01.csv 89%[===============================================> ] 1.66G 67.4MB/s eta 4s yellow_tripdata_2015-01.csv 90%[===============================================> ] 1.67G 65.1MB/s eta 3s yellow_tripdata_2015-01.csv 90%[================================================> ] 1.68G 65.2MB/s eta 3s yellow_tripdata_2015-01.csv 91%[================================================> ] 1.69G 62.4MB/s eta 3s yellow_tripdata_2015-01.csv 92%[================================================> ] 1.71G 64.1MB/s eta 3s yellow_tripdata_2015-01.csv 93%[=================================================> ] 1.72G 63.4MB/s eta 3s yellow_tripdata_2015-01.csv 93%[=================================================> ] 1.73G 62.3MB/s eta 2s yellow_tripdata_2015-01.csv 94%[=================================================> ] 1.74G 61.2MB/s eta 2s yellow_tripdata_2015-01.csv 95%[==================================================> ] 1.76G 61.2MB/s eta 2s yellow_tripdata_2015-01.csv 96%[==================================================> ] 1.78G 62.3MB/s eta 2s yellow_tripdata_2015-01.csv 96%[===================================================> ] 1.79G 58.5MB/s eta 2s yellow_tripdata_2015-01.csv 97%[===================================================> ] 1.80G 53.9MB/s eta 1s yellow_tripdata_2015-01.csv 97%[===================================================> ] 1.81G 52.5MB/s eta 1s yellow_tripdata_2015-01.csv 98%[====================================================> ] 1.82G 53.4MB/s eta 1s yellow_tripdata_2015-01.csv 99%[====================================================> ] 1.84G 56.1MB/s eta 1s yellow_tripdata_2015-01.csv 100%[=====================================================>] 1.85G 57.1MB/s in 30s
2019-08-14 19:49:52 (62.6 MB/s) - ‘yellow_tripdata_2015-01.csv’ saved [1985964692/1985964692]
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ htop
[?1049h(B[?7h[?1h=[?25l[?1000h(B 1 (B[(B||||||||||||||||100.0%(B](B 9 (B[0.0%](B 17 (B[0.0%](B 25 (B[0.0%](B2 (B[0.0%](B 10 (B[0.0%](B 18 (B[0.0%](B 26 (B[0.0%](B3 (B[0.0%](B 11 (B[0.0%](B 19 (B[0.0%](B 27 (B[0.0%](B4 (B[0.0%](B 12 (B[0.0%](B 20 (B[0.0%](B 28 (B[0.0%](B5 (B[0.0%](B 13 (B[0.0%](B 21 (B[0.0%](B 29 (B[0.0%](B6 (B[0.0%](B 14 (B[0.0%](B 22 (B[0.0%](B 30 (B[0.0%](B7 (B[0.0%](B 15 (B[0.0%](B 23 (B[0.0%](B 31 (B[0.0%](B8 (B[0.0%](B 16 (B[0.0%](B 24 (B[0.0%](B 32 (B[0.0%](BMem(B[(B||||(B687M/118G](B Tasks: (B36(B, (B77(B thr; (B1(B runningSwp(B[0K/0K](B Load average: (B0.15 0.04 (B0.01 Uptime: (B00:38:31 (B PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command 16463 ubuntu 20 0 26080 4744 3536 R 177. 0.0 0:00.04 htop(B1 (Broot (B 20 0  220M 9(B216  6(B676 S 0.0 0.0 0:02.51 /sbin/init720 (Broot (B 19  -1 94(B852  8(B856  8(B132 S 0.0 0.0 0:00.26 /lib/systemd/systemd-journald731 (Broot (B 20 0 97(B708  1(B728  1(B552 S 0.0 0.0 0:00.00 /sbin/lvmetad -f735 (Broot (B 20 0 43(B340  4(B520  3(B280 S 0.0 0.0 0:00.69 /lib/systemd/systemd-udevd  1272 (Bsystemd-n (B 20 0 80(B040  5(B292  4(B688 S 0.0 0.0 0:00.06 /lib/systemd/systemd-networkd  1306 (Bsystemd-r (B 20 0 70(B752  6(B120  5(B432 S 0.0 0.0 0:00.07 /lib/systemd/systemd-resolved  1485 (Broot (B 20 0 31(B748  3(B268  2(B972 S 0.0 0.0 0:00.00 /usr/sbin/cron -f  1537 (Broot (B 20 0  157M 1(B672  1(B540 S 0.0 0.0 0:00.00 /usr/bin/lxcfs /var/lib/lxcfs/(B1538 (Broot (B 20 0  157M 1(B672  1(B540 S 0.0 0.0 0:00.00 /usr/bin/lxcfs /var/lib/lxcfs/(B1500 (Broot (B 20 0  157M 1(B672  1(B540 S 0.0 0.0 0:00.00 /usr/bin/lxcfs /var/lib/lxcfs/  1556 (Bsyslog (B 20 0  261M 4(B596  3(B800 S 0.0 0.0 0:00.04 /usr/sbin/rsyslogd -n(B1557 (Bsyslog (B 20 0  261M 4(B596  3(B800 S 0.0 0.0 0:00.00 /usr/sbin/rsyslogd -n(B1559 (Bsyslog (B 20 0  261M 4(B596  3(B800 S 0.0 0.0 0:00.06 /usr/sbin/rsyslogd -n(B1540 (Bsyslog (B 20 0  261M 4(B596  3(B800 S 0.0 0.0 0:00.12 /usr/sbin/rsyslogd -n  1546 (Bmessagebu (B 20 0 50(B044  4(B508  3(B816 S 0.0 0.0 0:00.16 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nop1590 (Bdaemon (B 20 0 28(B332  2(B500  2(B288 S 0.0 0.0 0:00.00 /usr/sbin/atd -f  1660 (Broot (B 20 0  166M 17(B296  9(B484 S 0.0 0.0 0:00.00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-tri(B1631 (Broot (B 20 0  166M 17(B296  9(B484 S 0.0 0.0 0:00.06 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-tri1669 (Broot (B 20 0 70(B644  6(B088  5(B328 S 0.0 0.0 0:00.10 /lib/systemd/systemd-logind  1734 (Broot (B 20 0  281M 6(B992  6(B120 S 0.0 0.0 0:00.06 /usr/lib/accountsservice/accounts-daemon(B1739 (Broot (B 20 0  281M 6(B992  6(B120 S 0.0 0.0 0:00.00 /usr/lib/accountsservice/accounts-daemon(B1722 (Broot (B 20 0  281M 6(B992  6(B120 S 0.0 0.0 0:00.08 /usr/lib/accountsservice/accounts-daemon  1798 (Broot (B 20 0  4(B628 860 792 S 0.0 0.0 0:00.00 /bin/sh /usr/lib/sshguard/sshguard-journalctl -i /run/sshguard.1800 (Broot (B 20 0 81(B640  5(B468  4(B920 S 0.0 0.0 0:00.01 /bin/journalctl -afb -p info -n1 -o cat SYSLOG_FACILITY=4 SYSLO2306 (Broot (B 20 0 16(B364  3(B280  2(B876 S 0.0 0.0 0:00.00 /usr/sbin/sshguard -i /run/sshguard.pid -w /etc/sshguard/whitel(B1801 (Broot (B 20 0 16(B364  3(B280  2(B876 S 0.0 0.0 0:00.00 /usr/sbin/sshguard -i /run/sshguard.pid -w /etc/sshguard/whitel1806 (Broot (B 20 0  4(B628 852 784 S 0.0 0.0 0:00.00 /bin/sh /usr/lib/x86_64-linux-gnu/sshg-fw  1836 (Broot (B 20 0  284M 7(B192  6(B132 S 0.0 0.0 0:00.00 /usr/lib/policykit-1/polkitd --no-debug(B1842 (Broot (B 20 0  284M 7(B192  6(B132 S 0.0 0.0 0:00.00 /usr/lib/policykit-1/polkitd --no-debug(B1821 (Broot (B 20 0  284M 7(B192  6(B132 S 0.0 0.0 0:00.02 /usr/lib/policykit-1/polkitd --no-debug  1913 (Broot (B 20 0  183M 20(B272 12(B328 S 0.0 0.0 0:00.00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgr(B1824 (Broot (B 20 0  183M 20(B272 12(B328 S 0.0 0.0 0:00.09 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgr1853 (Broot (B 20 0 16(B412  2(B332  2(B188 S 0.0 0.0 0:00.00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt1873 (Broot (B 20 0 14(B888  1(B976  1(B848 S 0.0 0.0 0:00.00 /sbin/agetty -o -p -- \u --noclear tty1 linux  2211 (Broot (B 20 0 75(B404 23(B492  9(B084 S 0.0 0.0 0:00.31 /usr/bin/python3 /usr/bin/google_network_daemon  2217 (Broot (B 20 0 75(B204 23(B392  9(B076 S 0.0 0.0 0:00.23 /usr/bin/python3 /usr/bin/google_clock_skew_daemon  2223 (Broot (B 20 0 79(B796 23(B952  9(B436 S 0.0 0.0 0:00.35 /usr/bin/python3 /usr/bin/google_accounts_daemon  2230 (Broot (B 20 0 72(B296  5(B836  5(B108 S 0.0 0.0 0:00.00 /usr/sbin/sshd -D  3038 (Broot (B 20 0 4717M 19(B912 12(B116 S 0.0 0.0 0:00.06 /usr/lib/snapd/snapd(B3039 (Broot (B 20 0 4717M 19(B912 12(B116 S 0.0 0.0 0:00.04 /usr/lib/snapd/snapd(B3040 (Broot (B 20 0 4717M 19(B912 12(B116 S 0.0 0.0 0:00.02 /usr/lib/snapd/snapd(B3041 (Broot (B 20 0 4717M 19(B912 12(B116 S 0.0 0.0 0:00.00 /usr/lib/snapd/snapd (BF1Help (BF2Setup (BF3Search(BF4Filter(BF5Tree (BF6SortBy(BF7Nice -(BF8Nice +(BF9Kill (BF10Quit(BM(B1.3%42 (B 1734 root  281M 6992 6120 S 0.77 /usr/lib/accountsservice/accounts-daemon (B16463 ubuntu 20 0 26(B080  4(B744  3(B536 R (B 0.0 0.0 0:00.04 htop|(B0.764 (B16463 ubuntu26080 4744 3536 R5 htop (B 1734 (Broot (B 281M 6(B992  6(B120 S 7 /usr/lib/accountsservice/accounts-daemon(B|(B5(B6(B[?12l[?25h[?1000l[?1049l [?1l>]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ls
lost+found yellow_tripdata_2015-01.csv
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ head yeaellow_tripdata_2015-01.csv
VendorID,tpep_pickup_datetime,tpep_dropoff_datetime,passenger_count,trip_distance,pickup_longitude,pickup_latitude,RateCodeID,store_and_fwd_flag,dropoff_longitude,dropoff_latitude,payment_type,fare_amount,extra,mta_tax,tip_amount,tolls_amount,improvement_surcharge,total_amount
2,2015-01-15 19:05:39,2015-01-15 19:23:42,1,1.59,-73.993896484375,40.750110626220703,1,N,-73.974784851074219,40.750617980957031,1,12,1,0.5,3.25,0,0.3,17.05
1,2015-01-10 20:33:38,2015-01-10 20:53:28,1,3.30,-74.00164794921875,40.7242431640625,1,N,-73.994415283203125,40.759109497070313,1,14.5,0.5,0.5,2,0,0.3,17.8
1,2015-01-10 20:33:38,2015-01-10 20:43:41,1,1.80,-73.963340759277344,40.802787780761719,1,N,-73.951820373535156,40.824413299560547,2,9.5,0.5,0.5,0,0,0.3,10.8
1,2015-01-10 20:33:39,2015-01-10 20:35:31,1,.50,-74.009086608886719,40.713817596435547,1,N,-74.004325866699219,40.719985961914063,2,3.5,0.5,0.5,0,0,0.3,4.8
1,2015-01-10 20:33:39,2015-01-10 20:52:58,1,3.00,-73.971176147460938,40.762428283691406,1,N,-74.004180908203125,40.742652893066406,2,15,0.5,0.5,0,0,0.3,16.3
1,2015-01-10 20:33:39,2015-01-10 20:53:52,1,9.00,-73.874374389648438,40.7740478515625,1,N,-73.986976623535156,40.758193969726563,1,27,0.5,0.5,6.7,5.33,0.3,40.33
1,2015-01-10 20:33:39,2015-01-10 20:58:31,1,2.20,-73.9832763671875,40.726009368896484,1,N,-73.992469787597656,40.7496337890625,2,14,0.5,0.5,0,0,0.3,15.3
1,2015-01-10 20:33:39,2015-01-10 20:42:20,3,.80,-74.002662658691406,40.734142303466797,1,N,-73.995010375976563,40.726325988769531,1,7,0.5,0.5,1.66,0,0.3,9.96
1,2015-01-10 20:33:39,2015-01-10 21:11:35,3,18.20,-73.783042907714844,40.644355773925781,2,N,-73.987594604492187,40.759357452392578,2,52,0,0.5,0,5.33,0.3,58.13
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ spark-shell
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/ubuntu/spark-2.4.3-bin-hadoop2.7/jars/spark-unsafe_2.11-2.4.3.jar) to method java.nio.Bits.unaligned()
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
19/08/14 19:51:38 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://experiment-33bafd31037788eb.c.pilosa-sandbox.internal:4040
Spark context available as 'sc' (master = local[*], app id = local-1565812305606).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.3
/_/
Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 11.0.4)
Type in expressions to have them evaluated.
Type :help for more information.
scala> var cvsv  = sc.textFile("/mnt/disks/data1/yellow_tripdata_2015-01.csv")
csv: org.apache.spark.rdd.RDD[String] = /mnt/disks/data1/yellow_tripdata_2015-01.csv MapPartitionsRDD[1] at textFile at <console>:24
scala> counts  = :exit
exit: no such command. Type :help for help.
scala> :quit
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ls
lost+found yellow_tripdata_2015-01.csv
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ rm yellow_tripdata_2015-01.csv
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ls
lost+found
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ lsrm yellow_tripdata_2015-01.csv lsspark-shellhead yellow_tripdata_2015-01.csv lshtopwget https://s3.amazonaws.com/nyc-tlc/trip+data/yellow_tripdata_2015-01.csv
--2019-08-14 20:00:03-- https://s3.amazonaws.com/nyc-tlc/trip+data/yellow_tripdata_2015-01.csv
Resolving s3.amazonaws.com (s3.amazonaws.com)... 52.217.39.54
Connecting to s3.amazonaws.com (s3.amazonaws.com)|52.217.39.54|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1985964692 (1.8G) [application/octet-stream]
Saving to: ‘yellow_tripdata_2015-01.csv’
yellow_tripdata_2015-01.csv 0%[ ] 0 --.-KB/s yellow_tripdata_2015-01.csv 0%[ ] 1.93M 9.61MB/s yellow_tripdata_2015-01.csv 1%[> ] 21.37M 53.2MB/s yellow_tripdata_2015-01.csv 2%[==> ] 42.20M 70.1MB/s yellow_tripdata_2015-01.csv 3%[====> ] 62.99M 78.5MB/s yellow_tripdata_2015-01.csv 4%[======> ] 83.70M 83.4MB/s yellow_tripdata_2015-01.csv 5%[========> ] 104.34M 86.7MB/s yellow_tripdata_2015-01.csv 6%[==========> ] 120.68M 85.9MB/s yellow_tripdata_2015-01.csv 7%[===========> ] 133.56M 83.2MB/s yellow_tripdata_2015-01.csv 7%[============> ] 148.65M 82.3MB/s yellow_tripdata_2015-01.csv 8%[==============> ] 163.93M 81.7MB/s yellow_tripdata_2015-01.csv 9%[===============> ] 179.38M 81.2MB/s yellow_tripdata_2015-01.csv 10%[=================> ] 195.01M 81.0MB/s yellow_tripdata_2015-01.csv 11%[==================> ] 210.81M 80.8MB/s yellow_tripdata_2015-01.csv 11%[====================> ] 226.74M 80.7MB/s yellow_tripdata_2015-01.csv 12%[=====================> ] 242.74M 80.7MB/s eta 20s yellow_tripdata_2015-01.csv 13%[=======================> ] 258.67M 84.7MB/s eta 20s yellow_tripdata_2015-01.csv 14%[========================> ] 275.02M 84.6MB/s eta 20s yellow_tripdata_2015-01.csv 14%[=========================> ] 282.52M 79.1MB/s eta 20s yellow_tripdata_2015-01.csv 15%[==========================> ] 298.96M 78.2MB/s eta 20s yellow_tripdata_2015-01.csv 16%[============================> ] 315.11M 77.2MB/s eta 20s yellow_tripdata_2015-01.csv 17%[=============================> ] 331.61M 76.3MB/s eta 20s yellow_tripdata_2015-01.csv 18%[===============================> ] 348.35M 74.3MB/s eta 20s yellow_tripdata_2015-01.csv 19%[================================> ] 365.06M 74.3MB/s eta 20s yellow_tripdata_2015-01.csv 20%[==================================> ] 382.00M 75.8MB/s eta 20s yellow_tripdata_2015-01.csv 20%[===================================> ] 392.48M 73.8MB/s eta 20s yellow_tripdata_2015-01.csv 21%[====================================> ] 402.98M 72.3MB/s eta 20s yellow_tripdata_2015-01.csv 21%[=====================================> ] 412.06M 70.3MB/s eta 20s yellow_tripdata_2015-01.csv 21%[=====================================> ] 416.22M 66.3MB/s eta 20s yellow_tripdata_2015-01.csv 22%[======================================> ] 424.32M 64.0MB/s eta 20s yellow_tripdata_2015-01.csv 22%[======================================> ] 429.89M 59.7MB/s eta 21s yellow_tripdata_2015-01.csv 22%[=======================================> ] 434.95M 57.0MB/s eta 21s yellow_tripdata_2015-01.csv 23%[========================================> ] 443.43M 55.2MB/s eta 21s yellow_tripdata_2015-01.csv 23%[========================================> ] 447.99M 51.8MB/s eta 21s yellow_tripdata_2015-01.csv 24%[==========================================> ] 465.26M 52.5MB/s eta 21s yellow_tripdata_2015-01.csv 25%[===========================================> ] 482.71M 54.7MB/s eta 21s yellow_tripdata_2015-01.csv 26%[=============================================> ] 500.21M 55.3MB/s eta 21s yellow_tripdata_2015-01.csv 27%[===============================================> ] 517.79M 56.0MB/s eta 21s yellow_tripdata_2015-01.csv 28%[================================================> ] 535.40M 55.4MB/s eta 21s yellow_tripdata_2015-01.csv 28%[=================================================> ] 546.33M 54.2MB/s eta 21s yellow_tripdata_2015-01.csv 29%[===================================================> ] 562.29M 53.8MB/s eta 20s yellow_tripdata_2015-01.csv 30%[====================================================> ] 574.44M 52.7MB/s eta 20s yellow_tripdata_2015-01.csv 31%[=====================================================> ] 587.54M 53.6MB/s eta 20s yellow_tripdata_2015-01.csv 31%[=======================================================> ] 605.16M 56.1MB/s eta 20s yellow_tripdata_2015-01.csv 32%[========================================================> ] 622.75M 58.5MB/s eta 20s yellow_tripdata_2015-01.csv 33%[=========================================================> ] 626.95M 53.7MB/s eta 20s yellow_tripdata_2015-01.csv 33%[==========================================================> ] 641.75M 55.4MB/s eta 20s yellow_tripdata_2015-01.csv 34%[===========================================================> ] 654.43M 57.3MB/s eta 20s yellow_tripdata_2015-01.csv 35%[=============================================================> ] 667.26M 59.6MB/s eta 20s yellow_tripdata_2015-01.csv 35%[==============================================================> ] 680.26M 63.1MB/s eta 20s yellow_tripdata_2015-01.csv 36%[===============================================================> ] 693.40M 63.8MB/s eta 18s yellow_tripdata_2015-01.csv 37%[================================================================> ] 706.70M 63.3MB/s eta 18s yellow_tripdata_2015-01.csv 38%[=================================================================> ] 720.13M 61.4MB/s eta 18s yellow_tripdata_2015-01.csv 38%[===================================================================> ] 733.70M 60.8MB/s eta 18s yellow_tripdata_2015-01.csv 39%[====================================================================> ] 747.38M 60.1MB/s eta 18s yellow_tripdata_2015-01.csv 40%[=====================================================================> ] 761.21M 59.6MB/s eta 17s yellow_tripdata_2015-01.csv 40%[=======================================================================> ] 775.15M 59.3MB/s eta 17s yellow_tripdata_2015-01.csv 41%[========================================================================> ] 789.18M 60.3MB/s eta 17s yellow_tripdata_2015-01.csv 42%[=========================================================================> ] 803.29M 60.5MB/s eta 17s yellow_tripdata_2015-01.csv 43%[==========================================================================> ] 817.49M 59.8MB/s eta 17s yellow_tripdata_2015-01.csv 43%[============================================================================> ] 831.82M 59.4MB/s eta 16s yellow_tripdata_2015-01.csv 44%[============================================================================> ] 839.28M 66.0MB/s eta 16s yellow_tripdata_2015-01.csv 45%[==============================================================================> ] 853.02M 65.8MB/s eta 16s yellow_tripdata_2015-01.csv 45%[===============================================================================> ] 867.52M 66.5MB/s eta 16s yellow_tripdata_2015-01.csv 46%[================================================================================> ] 875.61M 64.7MB/s eta 16s yellow_tripdata_2015-01.csv 46%[=================================================================================> ] 890.13M 65.1MB/s eta 15s yellow_tripdata_2015-01.csv 47%[==================================================================================> ] 895.99M 62.8MB/s eta 15s yellow_tripdata_2015-01.csv 48%[===================================================================================> ] 910.59M 63.2MB/s eta 15s yellow_tripdata_2015-01.csv 48%[====================================================================================> ] 925.34M 63.6MB/s eta 15s yellow_tripdata_2015-01.csv 49%[======================================================================================> ] 940.13M 64.1MB/s eta 15s yellow_tripdata_2015-01.csv 50%[=======================================================================================> ] 954.99M 64.4MB/s eta 14s yellow_tripdata_2015-01.csv 51%[=========================================================================================> ] 969.87M 64.6MB/s eta 14s yellow_tripdata_2015-01.csv 51%[==========================================================================================> ] 984.80M 65.1MB/s eta 14s yellow_tripdata_2015-01.csv 52%[===========================================================================================> ] 999.77M 65.4MB/s eta 14s yellow_tripdata_2015-01.csv 53%[=============================================================================================> ] 1015M 65.5MB/s eta 14s yellow_tripdata_2015-01.csv 54%[==============================================================================================> ] 1.00G 65.9MB/s eta 13s yellow_tripdata_2015-01.csv 55%[================================================================================================> ] 1.02G 66.2MB/s eta 13s yellow_tripdata_2015-01.csv 55%[=================================================================================================> ] 1.03G 68.3MB/s eta 13s yellow_tripdata_2015-01.csv 56%[==================================================================================================> ] 1.05G 68.5MB/s eta 13s yellow_tripdata_2015-01.csv 57%[====================================================================================================> ] 1.06G 68.9MB/s eta 13s yellow_tripdata_2015-01.csv 58%[=====================================================================================================> ] 1.08G 69.7MB/s eta 12s yellow_tripdata_2015-01.csv 58%[=====================================================================================================> ] 1.08G 69.2MB/s eta 12s yellow_tripdata_2015-01.csv 58%[======================================================================================================> ] 1.09G 67.7MB/s eta 12s yellow_tripdata_2015-01.csv 59%[=======================================================================================================> ] 1.09G 64.1MB/s eta 12s yellow_tripdata_2015-01.csv 59%[=======================================================================================================> ] 1.10G 60.8MB/s eta 12s yellow_tripdata_2015-01.csv 59%[========================================================================================================> ] 1.10G 57.9MB/s eta 12s yellow_tripdata_2015-01.csv 59%[========================================================================================================> ] 1.11G 54.9MB/s eta 12s yellow_tripdata_2015-01.csv 60%[=========================================================================================================> ] 1.11G 52.1MB/s eta 12s yellow_tripdata_2015-01.csv 60%[=========================================================================================================> ] 1.12G 48.9MB/s eta 12s yellow_tripdata_2015-01.csv 60%[==========================================================================================================> ] 1.12G 44.9MB/s eta 12s yellow_tripdata_2015-01.csv 61%[==========================================================================================================> ] 1.13G 41.8MB/s eta 12s yellow_tripdata_2015-01.csv 61%[============================================================================================================> ] 1.15G 41.5MB/s eta 12s yellow_tripdata_2015-01.csv 62%[=============================================================================================================> ] 1.16G 41.4MB/s eta 12s yellow_tripdata_2015-01.csv 63%[==============================================================================================================> ] 1.17G 39.8MB/s eta 12s yellow_tripdata_2015-01.csv 64%[===============================================================================================================> ] 1.19G 40.3MB/s eta 12s yellow_tripdata_2015-01.csv 64%[=================================================================================================================> ] 1.20G 40.9MB/s eta 11s yellow_tripdata_2015-01.csv 65%[==================================================================================================================> ] 1.22G 42.8MB/s eta 11s yellow_tripdata_2015-01.csv 66%[====================================================================================================================> ] 1.23G 45.4MB/s eta 11s yellow_tripdata_2015-01.csv 67%[=====================================================================================================================> ] 1.25G 47.9MB/s eta 11s yellow_tripdata_2015-01.csv 68%[======================================================================================================================> ] 1.26G 51.4MB/s eta 11s yellow_tripdata_2015-01.csv 68%[========================================================================================================================> ] 1.27G 55.1MB/s eta 9s yellow_tripdata_2015-01.csv 69%[=========================================================================================================================> ] 1.29G 57.3MB/s eta 9s yellow_tripdata_2015-01.csv 70%[==========================================================================================================================> ] 1.30G 60.6MB/s eta 9s yellow_tripdata_2015-01.csv 70%[===========================================================================================================================> ] 1.31G 62.2MB/s eta 9s yellow_tripdata_2015-01.csv 71%[============================================================================================================================> ] 1.32G 62.6MB/s eta 9s yellow_tripdata_2015-01.csv 72%[==============================================================================================================================> ] 1.33G 66.2MB/s eta 8s yellow_tripdata_2015-01.csv 72%[===============================================================================================================================> ] 1.35G 66.3MB/s eta 8s yellow_tripdata_2015-01.csv 73%[================================================================================================================================> ] 1.36G 67.2MB/s eta 8s yellow_tripdata_2015-01.csv 74%[==================================================================================================================================> ] 1.38G 68.1MB/s eta 8s yellow_tripdata_2015-01.csv 75%[===================================================================================================================================> ] 1.39G 66.8MB/s eta 8s yellow_tripdata_2015-01.csv 75%[====================================================================================================================================> ] 1.40G 64.1MB/s eta 7s yellow_tripdata_2015-01.csv 76%[====================================================================================================================================> ] 1.41G 58.6MB/s eta 7s yellow_tripdata_2015-01.csv 76%[=====================================================================================================================================> ] 1.41G 56.2MB/s eta 7s yellow_tripdata_2015-01.csv 76%[======================================================================================================================================> ] 1.42G 55.2MB/s eta 7s yellow_tripdata_2015-01.csv 77%[======================================================================================================================================> ] 1.43G 49.7MB/s eta 7s yellow_tripdata_2015-01.csv 77%[=======================================================================================================================================> ] 1.43G 47.1MB/s eta 7s yellow_tripdata_2015-01.csv 77%[=======================================================================================================================================> ] 1.44G 43.4MB/s eta 7s yellow_tripdata_2015-01.csv 78%[========================================================================================================================================> ] 1.45G 42.5MB/s eta 7s yellow_tripdata_2015-01.csv 78%[=========================================================================================================================================> ] 1.46G 44.5MB/s eta 7s yellow_tripdata_2015-01.csv 79%[===========================================================================================================================================> ] 1.47G 46.8MB/s eta 6s yellow_tripdata_2015-01.csv 80%[============================================================================================================================================> ] 1.49G 47.3MB/s eta 6s yellow_tripdata_2015-01.csv 81%[==============================================================================================================================================> ] 1.50G 46.4MB/s eta 6s yellow_tripdata_2015-01.csv 82%[===============================================================================================================================================> ] 1.52G 47.0MB/s eta 6s yellow_tripdata_2015-01.csv 83%[=================================================================================================================================================> ] 1.54G 47.5MB/s eta 6s yellow_tripdata_2015-01.csv 83%[==================================================================================================================================================> ] 1.55G 47.9MB/s eta 5s yellow_tripdata_2015-01.csv 84%[===================================================================================================================================================> ] 1.57G 49.4MB/s eta 5s yellow_tripdata_2015-01.csv 85%[=====================================================================================================================================================> ] 1.58G 52.3MB/s eta 5s yellow_tripdata_2015-01.csv 86%[======================================================================================================================================================> ] 1.60G 56.1MB/s eta 5s yellow_tripdata_2015-01.csv 87%[========================================================================================================================================================> ] 1.61G 59.5MB/s eta 5s yellow_tripdata_2015-01.csv 87%[=========================================================================================================================================================> ] 1.63G 61.0MB/s eta 4s yellow_tripdata_2015-01.csv 88%[===========================================================================================================================================================> ] 1.64G 65.7MB/s eta 4s yellow_tripdata_2015-01.csv 89%[============================================================================================================================================================> ] 1.66G 71.9MB/s eta 4s yellow_tripdata_2015-01.csv 90%[=============================================================================================================================================================> ] 1.67G 74.1MB/s eta 4s yellow_tripdata_2015-01.csv 90%[===============================================================================================================================================================> ] 1.68G 73.1MB/s eta 4s yellow_tripdata_2015-01.csv 91%[================================================================================================================================================================> ] 1.70G 73.0MB/s eta 3s yellow_tripdata_2015-01.csv 92%[=================================================================================================================================================================> ] 1.71G 72.9MB/s eta 3s yellow_tripdata_2015-01.csv 93%[===================================================================================================================================================================> ] 1.73G 73.2MB/s eta 3s yellow_tripdata_2015-01.csv 94%[====================================================================================================================================================================> ] 1.74G 72.2MB/s eta 3s yellow_tripdata_2015-01.csv 94%[=====================================================================================================================================================================> ] 1.75G 69.6MB/s eta 3s yellow_tripdata_2015-01.csv 94%[=====================================================================================================================================================================> ] 1.75G 65.3MB/s eta 2s yellow_tripdata_2015-01.csv 95%[======================================================================================================================================================================> ] 1.76G 61.7MB/s eta 2s yellow_tripdata_2015-01.csv 95%[======================================================================================================================================================================> ] 1.76G 58.6MB/s eta 2s yellow_tripdata_2015-01.csv 95%[=======================================================================================================================================================================> ] 1.77G 53.9MB/s eta 2s yellow_tripdata_2015-01.csv 95%[=======================================================================================================================================================================> ] 1.77G 51.2MB/s eta 2s yellow_tripdata_2015-01.csv 96%[========================================================================================================================================================================> ] 1.78G 46.4MB/s eta 1s yellow_tripdata_2015-01.csv 96%[========================================================================================================================================================================> ] 1.78G 43.1MB/s eta 1s yellow_tripdata_2015-01.csv 96%[========================================================================================================================================================================> ] 1.79G 39.7MB/s eta 1s yellow_tripdata_2015-01.csv 96%[=========================================================================================================================================================================> ] 1.79G 36.2MB/s eta 1s yellow_tripdata_2015-01.csv 97%[=========================================================================================================================================================================> ] 1.79G 36.3MB/s eta 1s yellow_tripdata_2015-01.csv 97%[==========================================================================================================================================================================> ] 1.80G 34.4MB/s eta 1s yellow_tripdata_2015-01.csv 97%[==========================================================================================================================================================================> ] 1.80G 31.5MB/s eta 1s yellow_tripdata_2015-01.csv 97%[==========================================================================================================================================================================> ] 1.80G 28.7MB/s eta 1s yellow_tripdata_2015-01.csv 97%[===========================================================================================================================================================================> ] 1.81G 23.5MB/s eta 1s yellow_tripdata_2015-01.csv 98%[===========================================================================================================================================================================> ] 1.82G 22.0MB/s eta 1s yellow_tripdata_2015-01.csv 99%[=============================================================================================================================================================================> ] 1.83G 24.3MB/s eta 1s yellow_tripdata_2015-01.csv 99%[==============================================================================================================================================================================> ] 1.85G 26.5MB/s eta 1s yellow_tripdata_2015-01.csv 100%[===============================================================================================================================================================================>] 1.85G 26.8MB/s in 33s
2019-08-14 20:00:37 (57.2 MB/s) - ‘yellow_tripdata_2015-01.csv’ saved [1985964692/1985964692]
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ spark-shell
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/ubuntu/spark-2.4.3-bin-hadoop2.7/jars/spark-unsafe_2.11-2.4.3.jar) to method java.nio.Bits.unaligned()
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
19/08/14 20:00:47 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://experiment-33bafd31037788eb.c.pilosa-sandbox.internal:4040
Spark context available as 'sc' (master = local[*], app id = local-1565812854678).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.3
/_/
Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 11.0.4)
Type in expressions to have them evaluated.
Type :help for more information.
scala> val csv rdd = sc.txtfile("./yellow_tripdata_2015-01.csv")
<console>:24: error: value txtfile is not a member of org.apache.spark.SparkContext
val csvrdd = sc.txtfile("./yellow_tripdata_2015-01.csv")
^
scala> val csvrdd = sc.txtfile("./yellow_tripdata_2015-01.csv")extfile("./yellow_tripdata_2015-01.csv")
<console>:24: error: value textfile is not a member of org.apache.spark.SparkContext
val csvrdd = sc.textfile("./yellow_tripdata_2015-01.csv")
^
scala> val csvrdd = sc.textfile("./yellow_tripdata_2015-01.csv")ile("./yellow_tripdata_2015-01.csv")File("./yellow_tripdata_2015-01.csv")
csvrdd: org.apache.spark.rdd.RDD[String] = ./yellow_tripdata_2015-01.csv MapPartitionsRDD[1] at textFile at <console>:24
scala> csvrdd.tak(e(10).foreach.(println()
java.lang.IllegalArgumentException: Unsupported class file major version 55
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:166)
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:148)
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:136)
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:237)
at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:49)
at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:517)
at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:500)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:134)
at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:134)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:236)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap$$anon$1.foreach(HashMap.scala:134)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:732)
at org.apache.spark.util.FieldAccessFinder$$anon$3.visitMethodInsn(ClosureCleaner.scala:500)
at org.apache.xbean.asm6.ClassReader.readCode(ClassReader.java:2175)
at org.apache.xbean.asm6.ClassReader.readMethod(ClassReader.java:1238)
at org.apache.xbean.asm6.ClassReader.accept(ClassReader.java:631)
at org.apache.xbean.asm6.ClassReader.accept(ClassReader.java:355)
at org.apache.spark.util.ClosureCleaner$$anonfun$org$apache$spark$util$ClosureCleaner$$clean$14.apply(ClosureCleaner.scala:307)
at org.apache.spark.util.ClosureCleaner$$anonfun$org$apache$spark$util$ClosureCleaner$$clean$14.apply(ClosureCleaner.scala:306)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.util.ClosureCleaner$.org$apache$spark$util$ClosureCleaner$$clean(ClosureCleaner.scala:306)
at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:162)
at org.apache.spark.SparkContext.clean(SparkContext.scala:2326)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2100)
at org.apache.spark.rdd.RDD$$anonfun$take$1.apply(RDD.scala:1364)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
at org.apache.spark.rdd.RDD.take(RDD.scala:1337)
... 49 elided
scala> :exquit
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ls
lost+found yellow_tripdata_2015-01.csv
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ head yellow_tripdata_2015-01.csv
VendorID,tpep_pickup_datetime,tpep_dropoff_datetime,passenger_count,trip_distance,pickup_longitude,pickup_latitude,RateCodeID,store_and_fwd_flag,dropoff_longitude,dropoff_latitude,payment_type,fare_amount,extra,mta_tax,tip_amount,tolls_amount,improvement_surcharge,total_amount
2,2015-01-15 19:05:39,2015-01-15 19:23:42,1,1.59,-73.993896484375,40.750110626220703,1,N,-73.974784851074219,40.750617980957031,1,12,1,0.5,3.25,0,0.3,17.05
1,2015-01-10 20:33:38,2015-01-10 20:53:28,1,3.30,-74.00164794921875,40.7242431640625,1,N,-73.994415283203125,40.759109497070313,1,14.5,0.5,0.5,2,0,0.3,17.8
1,2015-01-10 20:33:38,2015-01-10 20:43:41,1,1.80,-73.963340759277344,40.802787780761719,1,N,-73.951820373535156,40.824413299560547,2,9.5,0.5,0.5,0,0,0.3,10.8
1,2015-01-10 20:33:39,2015-01-10 20:35:31,1,.50,-74.009086608886719,40.713817596435547,1,N,-74.004325866699219,40.719985961914063,2,3.5,0.5,0.5,0,0,0.3,4.8
1,2015-01-10 20:33:39,2015-01-10 20:52:58,1,3.00,-73.971176147460938,40.762428283691406,1,N,-74.004180908203125,40.742652893066406,2,15,0.5,0.5,0,0,0.3,16.3
1,2015-01-10 20:33:39,2015-01-10 20:53:52,1,9.00,-73.874374389648438,40.7740478515625,1,N,-73.986976623535156,40.758193969726563,1,27,0.5,0.5,6.7,5.33,0.3,40.33
1,2015-01-10 20:33:39,2015-01-10 20:58:31,1,2.20,-73.9832763671875,40.726009368896484,1,N,-73.992469787597656,40.7496337890625,2,14,0.5,0.5,0,0,0.3,15.3
1,2015-01-10 20:33:39,2015-01-10 20:42:20,3,.80,-74.002662658691406,40.734142303466797,1,N,-73.995010375976563,40.726325988769531,1,7,0.5,0.5,1.66,0,0.3,9.96
1,2015-01-10 20:33:39,2015-01-10 21:11:35,3,18.20,-73.783042907714844,40.644355773925781,2,N,-73.987594604492187,40.759357452392578,2,52,0,0.5,0,5.33,0.3,58.13
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ java/usr/libexec/jocat /~/.~/.bashrc
# ~/.bashrc: executed by bash(1) for non-login shells.
# see /usr/share/doc/bash/examples/startup-files (in the package bash-doc)
# for examples
# If not running interactively, don't do anything
case $- in
*i*) ;;
*) return;;
esac
# don't put duplicate lines or lines starting with space in the history.
# See bash(1) for more options
HISTCONTROL=ignoreboth
# append to the history file, don't overwrite it
shopt -s histappend
# for setting history length see HISTSIZE and HISTFILESIZE in bash(1)
HISTSIZE=1000
HISTFILESIZE=2000
# check the window size after each command and, if necessary,
# update the values of LINES and COLUMNS.
shopt -s checkwinsize
# If set, the pattern "**" used in a pathname expansion context will
# match all files and zero or more directories and subdirectories.
#shopt -s globstar
# make less more friendly for non-text input files, see lesspipe(1)
[ -x /usr/bin/lesspipe ] && eval "$(SHELL=/bin/sh lesspipe)"
# set variable identifying the chroot you work in (used in the prompt below)
if [ -z "${debian_chroot:-}" ] && [ -r /etc/debian_chroot ]; then
debian_chroot=$(cat /etc/debian_chroot)
fi
# set a fancy prompt (non-color, unless we know we "want" color)
case "$TERM" in
xterm-color|*-256color) color_prompt=yes;;
esac
# uncomment for a colored prompt, if the terminal has the capability; turned
# off by default to not distract the user: the focus in a terminal window
# should be on the output of commands, not on the prompt
#force_color_prompt=yes
if [ -n "$force_color_prompt" ]; then
if [ -x /usr/bin/tput ] && tput setaf 1 >&/dev/null; then
# We have color support; assume it's compliant with Ecma-48
# (ISO/IEC-6429). (Lack of such support is extremely rare, and such
# a case would tend to support setf rather than setaf.)
color_prompt=yes
else
color_prompt=
fi
fi
if [ "$color_prompt" = yes ]; then
PS1='${debian_chroot:+($debian_chroot)}\[\033[01;32m\]\u@\h\[\033[00m\]:\[\033[01;34m\]\w\[\033[00m\]\$ '
else
PS1='${debian_chroot:+($debian_chroot)}\u@\h:\w\$ '
fi
unset color_prompt force_color_prompt
# If this is an xterm set the title to user@host:dir
case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
;;
*)
;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
alias ls='ls --color=auto'
#alias dir='dir --color=auto'
#alias vdir='vdir --color=auto'
alias grep='grep --color=auto'
alias fgrep='fgrep --color=auto'
alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s*[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
. ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
if [ -f /usr/share/bash-completion/bash_completion ]; then
. /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
. /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/bin
export PATH=$PATH:$SPARK_HOME
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/jvm/
default-java/ java-1.11.0-openjdk-amd64/ java-11-openjdk-amd64/ openjdk-11/
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/jvm/
default-java/ java-1.11.0-openjdk-amd64/ java-11-openjdk-amd64/ openjdk-11/
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/jvm/ddefault-java/bin/javbaa
java javac javadoc javap
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/jvm/default-java/bin/java
java javac javadoc javap
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/jvm/default-java/bin/java
java javac javadoc javap
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/jvm/default-java/bin/javajajava -rversion
openjdk version "11.0.4" 2019-07-16
OpenJDK Runtime Environment (build 11.0.4+11-post-Ubuntu-1ubuntu218.04.3)
OpenJDK 64-Bit Server VM (build 11.0.4+11-post-Ubuntu-1ubuntu218.04.3, mixed mode, sharing)
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ sudo apt install openjdk-8-jdk
Reading package lists... 0% Reading package lists... 100% Reading package lists... Done
Building dependency tree... 0% Building dependency tree... 0% Building dependency tree... 50% Building dependency tree... 50% Building dependency tree
Reading state information... 0% Reading state information... 0% Reading state information... Done
The following packages were automatically installed and are no longer required:
grub-pc-bin libnuma1
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
adwaita-icon-theme fontconfig gtk-update-icon-cache hicolor-icon-theme humanity-icon-theme libasyncns0 libcairo2 libcroco3 libdatrie1 libflac8 libgail-common libgail18 libgdk-pixbuf2.0-0 libgdk-pixbuf2.0-bin libgdk-pixbuf2.0-common libgraphite2-3 libgtk2.0-0 libgtk2.0-bin
libgtk2.0-common libharfbuzz0b libjbig0 libogg0 libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0 libpixman-1-0 libpulse0 librsvg2-2 librsvg2-common libsndfile1 libthai-data libthai0 libtiff5 libvorbis0a libvorbisenc2 libxcb-render0 libxcb-shm0 libxcursor1 openjdk-8-jdk-headless
openjdk-8-jre openjdk-8-jre-headless ubuntu-mono
Suggested packages:
gvfs pulseaudio librsvg2-bin openjdk-8-demo openjdk-8-source visualvm icedtea-8-plugin libnss-mdns fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei fonts-wqy-zenhei fonts-indic
The following NEW packages will be installed:
adwaita-icon-theme fontconfig gtk-update-icon-cache hicolor-icon-theme humanity-icon-theme libasyncns0 libcairo2 libcroco3 libdatrie1 libflac8 libgail-common libgail18 libgdk-pixbuf2.0-0 libgdk-pixbuf2.0-bin libgdk-pixbuf2.0-common libgraphite2-3 libgtk2.0-0 libgtk2.0-bin
libgtk2.0-common libharfbuzz0b libjbig0 libogg0 libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0 libpixman-1-0 libpulse0 librsvg2-2 librsvg2-common libsndfile1 libthai-data libthai0 libtiff5 libvorbis0a libvorbisenc2 libxcb-render0 libxcb-shm0 libxcursor1 openjdk-8-jdk
openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless ubuntu-mono
0 upgraded, 43 newly installed, 0 to remove and 19 not upgraded.
Need to get 47.4 MB of archives.
After this operation, 192 MB of additional disk space will be used.
Do you want to continue? [Y/n]
 0% [Working] Get:1 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 fontconfig amd64 2.12.6-0ubuntu2 [169 kB]
 0% [1 fontconfig 3758 B/169 kB 2%] 1% [Working] Get:2 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libogg0 amd64 1.3.2-1 [17.2 kB]
 1% [2 libogg0 3669 B/17.2 kB 21%] 1% [Waiting for headers] Get:3 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 hicolor-icon-theme all 0.17-2 [9976 B]
 1% [3 hicolor-icon-theme 3761 B/9976 B 38%] 2% [Waiting for headers] Get:4 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libjbig0 amd64 2.1-3.1build1 [26.7 kB]
 2% [4 libjbig0 3760 B/26.7 kB 14%] 2% [Waiting for headers] Get:5 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libtiff5 amd64 4.0.9-5ubuntu0.2 [153 kB]
 2% [5 libtiff5 3757 B/153 kB 2%] 3% [Waiting for headers] Get:6 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgdk-pixbuf2.0-common all 2.36.11-2 [4536 B]
 3% [6 libgdk-pixbuf2.0-common 2417 B/4536 B 53%] 3% [Waiting for headers] Get:7 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgdk-pixbuf2.0-0 amd64 2.36.11-2 [165 kB]
 3% [7 libgdk-pixbuf2.0-0 2307 B/165 kB 1%] 4% [Waiting for headers] Get:8 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 gtk-update-icon-cache amd64 3.22.30-1ubuntu4 [28.3 kB]
 4% [8 gtk-update-icon-cache 7855 B/28.3 kB 28%] 5% [Waiting for headers] Get:9 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libpixman-1-0 amd64 0.34.0-2 [229 kB]
 5% [9 libpixman-1-0 3758 B/229 kB 2%] 6% [Waiting for headers] Get:10 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-render0 amd64 1.13-2~ubuntu18.04 [14.7 kB]
 6% [10 libxcb-render0 2412 B/14.7 kB 16%] 6% [Waiting for headers] Get:11 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxcb-shm0 amd64 1.13-2~ubuntu18.04 [5600 B]
 6% [11 libxcb-shm0 2413 B/5600 B 43%] 7% [Waiting for headers] Get:12 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libcairo2 amd64 1.15.10-2ubuntu0.1 [580 kB]
 7% [12 libcairo2 7853 B/580 kB 1%] 7% [12 libcairo2 512 kB/580 kB 88%] 8% [Waiting for headers] Get:13 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libcroco3 amd64 0.6.12-2 [81.3 kB]
 8% [13 libcroco3 3759 B/81.3 kB 5%] 9% [Waiting for headers] Get:14 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libthai-data all 0.1.27-2 [133 kB]
 9% [14 libthai-data 3758 B/133 kB 3%] 9% [Waiting for headers] Get:15 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libdatrie1 amd64 0.2.10-7 [17.8 kB]
 9% [15 libdatrie1 3760 B/17.8 kB 21%] 10% [Waiting for headers] Get:16 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libthai0 amd64 0.1.27-2 [18.0 kB]
 10% [16 libthai0 3760 B/18.0 kB 21%] 10% [Waiting for headers] Get:17 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpango-1.0-0 amd64 1.40.14-1ubuntu0.1 [153 kB]
 10% [17 libpango-1.0-0 2413 B/153 kB 2%] 11% [Waiting for headers] Get:18 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgraphite2-3 amd64 1.3.11-2 [78.7 kB]
 11% [18 libgraphite2-3 2414 B/78.7 kB 3%] 12% [Waiting for headers] Get:19 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libharfbuzz0b amd64 1.7.2-1ubuntu1 [232 kB]
 12% [19 libharfbuzz0b 7854 B/232 kB 3%] 12% [Waiting for headers] Get:20 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpangoft2-1.0-0 amd64 1.40.14-1ubuntu0.1 [33.2 kB]
 12% [20 libpangoft2-1.0-0 10.9 kB/33.2 kB 33%] 13% [Waiting for headers] Get:21 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpangocairo-1.0-0 amd64 1.40.14-1ubuntu0.1 [20.8 kB]
 13% [21 libpangocairo-1.0-0 3759 B/20.8 kB 18%] 13% [Waiting for headers] Get:22 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 librsvg2-2 amd64 2.40.20-2 [98.6 kB]
 13% [22 librsvg2-2 6636 B/98.6 kB 7%] 14% [Waiting for headers] Get:23 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 librsvg2-common amd64 2.40.20-2 [5124 B]
 14% [23 librsvg2-common 5124 B/5124 B 100%] 15% [Waiting for headers] Get:24 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 humanity-icon-theme all 0.6.15 [1250 kB]
 15% [24 humanity-icon-theme 10.7 kB/1250 kB 1%] 15% [24 humanity-icon-theme 491 kB/1250 kB 39%] 16% [24 humanity-icon-theme 979 kB/1250 kB 78%] 17% [Waiting for headers] Get:25 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 ubuntu-mono all 16.10+18.04.20181005-0ubuntu1 [149 kB]
 17% [25 ubuntu-mono 7853 B/149 kB 5%] 18% [Waiting for headers] Get:26 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 adwaita-icon-theme all 3.28.0-1ubuntu1 [3306 kB]
 18% [26 adwaita-icon-theme 3756 B/3306 kB 0%] 19% [26 adwaita-icon-theme 700 kB/3306 kB 21%] 20% [26 adwaita-icon-theme 1351 kB/3306 kB 41%] 21% [26 adwaita-icon-theme 2076 kB/3306 kB 63%] 22% [26 adwaita-icon-theme 2730 kB/3306 kB 83%] 997 kB/s 41s 24% [Waiting for headers] 997 kB/s 40s Get:27 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libasyncns0 amd64 0.8-6 [12.1 kB]
 24% [27 libasyncns0 2415 B/12.1 kB 20%] 997 kB/s 40s 24% [Waiting for headers] 997 kB/s 40s Get:28 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libflac8 amd64 1.3.2-1 [213 kB]
 24% [28 libflac8 2414 B/213 kB 1%] 997 kB/s 40s 25% [Waiting for headers] 997 kB/s 40s Get:29 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgtk2.0-common all 2.24.32-1ubuntu1 [125 kB]
 25% [29 libgtk2.0-common 3758 B/125 kB 3%] 997 kB/s 40s 26% [Waiting for headers] 997 kB/s 40s Get:30 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libxcursor1 amd64 1:1.1.15-1 [19.8 kB]
 26% [30 libxcursor1 3671 B/19.8 kB 19%] 997 kB/s 40s 26% [Waiting for headers] 997 kB/s 40s Get:31 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgtk2.0-0 amd64 2.24.32-1ubuntu1 [1769 kB]
 26% [31 libgtk2.0-0 2411 B/1769 kB 0%] 997 kB/s 40s 28% [31 libgtk2.0-0 757 kB/1769 kB 43%] 997 kB/s 39s 29% [31 libgtk2.0-0 1518 kB/1769 kB 86%] 997 kB/s 38s 30% [Waiting for headers] 997 kB/s 38s Get:32 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgail18 amd64 2.24.32-1ubuntu1 [14.2 kB]
 30% [32 libgail18 2309 B/14.2 kB 16%] 997 kB/s 38s 30% [Waiting for headers] 997 kB/s 38s Get:33 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgail-common amd64 2.24.32-1ubuntu1 [112 kB]
 30% [33 libgail-common 3758 B/112 kB 3%] 997 kB/s 38s 31% [Waiting for headers] 997 kB/s 38s Get:34 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgdk-pixbuf2.0-bin amd64 2.36.11-2 [7864 B]
 31% [34 libgdk-pixbuf2.0-bin 2313 B/7864 B 29%] 997 kB/s 38s 31% [Waiting for headers] 997 kB/s 38s Get:35 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libgtk2.0-bin amd64 2.24.32-1ubuntu1 [7536 B]
 31% [35 libgtk2.0-bin 2416 B/7536 B 32%] 997 kB/s 38s 32% [Waiting for headers] 997 kB/s 38s Get:36 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libvorbis0a amd64 1.3.5-4.2 [86.4 kB]
 32% [36 libvorbis0a 2311 B/86.4 kB 3%] 997 kB/s 38s 33% [Waiting for headers] 997 kB/s 38s Get:37 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic/main amd64 libvorbisenc2 amd64 1.3.5-4.2 [70.7 kB]
 33% [37 libvorbisenc2 2414 B/70.7 kB 3%] 997 kB/s 38s 33% [Waiting for headers] 997 kB/s 38s Get:38 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libsndfile1 amd64 1.0.28-4ubuntu0.18.04.1 [170 kB]
 33% [38 libsndfile1 2413 B/170 kB 1%] 997 kB/s 38s 34% [Waiting for headers] 997 kB/s 37s Get:39 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpulse0 amd64 1:11.1-1ubuntu7.2 [265 kB]
 34% [39 libpulse0 3758 B/265 kB 1%] 997 kB/s 37s 35% [Waiting for headers] 997 kB/s 37s Get:40 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 openjdk-8-jre-headless amd64 8u222-b10-1ubuntu1~18.04.1 [27.4 MB]
 35% [40 openjdk-8-jre-headless 2409 B/27.4 MB 0%] 997 kB/s 37s 36% [40 openjdk-8-jre-headless 671 kB/27.4 MB 2%] 997 kB/s 36s 37% [40 openjdk-8-jre-headless 1384 kB/27.4 MB 5%] 997 kB/s 36s 38% [40 openjdk-8-jre-headless 2085 kB/27.4 MB 8%] 997 kB/s 35s 39% [40 openjdk-8-jre-headless 2777 kB/27.4 MB 10%] 997 kB/s 34s 41% [40 openjdk-8-jre-headless 3436 kB/27.4 MB 13%] 997 kB/s 34s 42% [40 openjdk-8-jre-headless 4067 kB/27.4 MB 15%] 997 kB/s 33s 43% [40 openjdk-8-jre-headless 4685 kB/27.4 MB 17%] 1328 kB/s 24s 44% [40 openjdk-8-jre-headless 5303 kB/27.4 MB 19%] 1328 kB/s 24s 45% [40 openjdk-8-jre-headless 5882 kB/27.4 MB 21%] 1328 kB/s 23s 46% [40 openjdk-8-jre-headless 6484 kB/27.4 MB 24%] 1328 kB/s 23s 47% [40 openjdk-8-jre-headless 7065 kB/27.4 MB 26%] 1328 kB/s 22s 48% [40 openjdk-8-jre-headless 7682 kB/27.4 MB 28%] 1328 kB/s 22s 49% [40 openjdk-8-jre-headless 8286 kB/27.4 MB 30%] 1328 kB/s 22s 50% [40 openjdk-8-jre-headless 8872 kB/27.4 MB 32%] 1328 kB/s 21s 51% [40 openjdk-8-jre-headless 9433 kB/27.4 MB 34%] 1328 kB/s 21s 52% [40 openjdk-8-jre-headless 10.0 MB/27.4 MB 37%] 1328 kB/s 20s 53% [40 openjdk-8-jre-headless 10.7 MB/27.4 MB 39%] 1328 kB/s 20s 54% [40 openjdk-8-jre-headless 11.3 MB/27.4 MB 41%] 1328 kB/s 19s 55% [40 openjdk-8-jre-headless 11.9 MB/27.4 MB 43%] 1197 kB/s 21s 56% [40 openjdk-8-jre-headless 12.5 MB/27.4 MB 46%] 1197 kB/s 20s 57% [40 openjdk-8-jre-headless 13.1 MB/27.4 MB 48%] 1197 kB/s 20s 58% [40 openjdk-8-jre-headless 13.7 MB/27.4 MB 50%] 1197 kB/s 19s 59% [40 openjdk-8-jre-headless 14.3 MB/27.4 MB 52%] 1197 kB/s 19s 60% [40 openjdk-8-jre-headless 14.9 MB/27.4 MB 54%] 1197 kB/s 18s 61% [40 openjdk-8-jre-headless 15.5 MB/27.4 MB 57%] 1197 kB/s 18s 62% [40 openjdk-8-jre-headless 16.1 MB/27.4 MB 59%] 1197 kB/s 17s 63% [40 openjdk-8-jre-headless 16.7 MB/27.4 MB 61%] 1197 kB/s 17s 64% [40 openjdk-8-jre-headless 17.3 MB/27.4 MB 63%] 1197 kB/s 16s 65% [40 openjdk-8-jre-headless 17.9 MB/27.4 MB 65%] 1197 kB/s 16s 66% [40 openjdk-8-jre-headless 18.4 MB/27.4 MB 67%] 1197 kB/s 15s 67% [40 openjdk-8-jre-headless 18.9 MB/27.4 MB 69%] 1173 kB/s 15s 68% [40 openjdk-8-jre-headless 19.5 MB/27.4 MB 71%] 1173 kB/s 15s 69% [40 openjdk-8-jre-headless 20.0 MB/27.4 MB 73%] 1173 kB/s 14s 70% [40 openjdk-8-jre-headless 20.6 MB/27.4 MB 75%] 1173 kB/s 14s 71% [40 openjdk-8-jre-headless 21.2 MB/27.4 MB 77%] 1173 kB/s 13s 72% [40 openjdk-8-jre-headless 21.8 MB/27.4 MB 79%] 1173 kB/s 13s 73% [40 openjdk-8-jre-headless 22.3 MB/27.4 MB 82%] 1173 kB/s 12s 74% [40 openjdk-8-jre-headless 23.0 MB/27.4 MB 84%] 1173 kB/s 12s 74% [40 openjdk-8-jre-headless 23.5 MB/27.4 MB 86%] 1173 kB/s 11s 75% [40 openjdk-8-jre-headless 24.0 MB/27.4 MB 88%] 1173 kB/s 11s 76% [40 openjdk-8-jre-headless 24.6 MB/27.4 MB 90%] 1173 kB/s 11s 77% [40 openjdk-8-jre-headless 25.1 MB/27.4 MB 92%] 1173 kB/s 10s 78% [40 openjdk-8-jre-headless 25.6 MB/27.4 MB 94%] 1117 kB/s 10s 79% [40 openjdk-8-jre-headless 26.2 MB/27.4 MB 96%] 1117 kB/s 10s 80% [40 openjdk-8-jre-headless 26.8 MB/27.4 MB 98%] 1117 kB/s 9s 81% [40 openjdk-8-jre-headless 27.4 MB/27.4 MB 100%] 1117 kB/s 9s 82% [Waiting for headers] 1117 kB/s 9s Get:41 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 openjdk-8-jre amd64 8u222-b10-1ubuntu1~18.04.1 [69.3 kB]
 82% [41 openjdk-8-jre 13.7 kB/69.3 kB 20%] 1117 kB/s 9s 82% [Waiting for headers] 1117 kB/s 8s Get:42 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 openjdk-8-jdk-headless amd64 8u222-b10-1ubuntu1~18.04.1 [8267 kB]
 82% [42 openjdk-8-jdk-headless 2411 B/8267 kB 0%] 1117 kB/s 8s 83% [42 openjdk-8-jdk-headless 340 kB/8267 kB 4%] 1117 kB/s 8s 83% [42 openjdk-8-jdk-headless 703 kB/8267 kB 9%] 1117 kB/s 8s 84% [42 openjdk-8-jdk-headless 1065 kB/8267 kB 13%] 1117 kB/s 8s 85% [42 openjdk-8-jdk-headless 1462 kB/8267 kB 18%] 1117 kB/s 7s 85% [42 openjdk-8-jdk-headless 1867 kB/8267 kB 23%] 1117 kB/s 7s 86% [42 openjdk-8-jdk-headless 2261 kB/8267 kB 27%] 1117 kB/s 6s 87% [42 openjdk-8-jdk-headless 2642 kB/8267 kB 32%] 1117 kB/s 6s 87% [42 openjdk-8-jdk-headless 3035 kB/8267 kB 37%] 1117 kB/s 6s 88% [42 openjdk-8-jdk-headless 3440 kB/8267 kB 42%] 864 kB/s 7s 89% [42 openjdk-8-jdk-headless 3854 kB/8267 kB 47%] 864 kB/s 7s 89% [42 openjdk-8-jdk-headless 4259 kB/8267 kB 52%] 864 kB/s 6s 90% [42 openjdk-8-jdk-headless 4677 kB/8267 kB 57%] 864 kB/s 6s 91% [42 openjdk-8-jdk-headless 5071 kB/8267 kB 61%] 864 kB/s 5s 91% [42 openjdk-8-jdk-headless 5427 kB/8267 kB 66%] 864 kB/s 5s 92% [42 openjdk-8-jdk-headless 5804 kB/8267 kB 70%] 864 kB/s 4s 93% [42 openjdk-8-jdk-headless 6181 kB/8267 kB 75%] 864 kB/s 4s 93% [42 openjdk-8-jdk-headless 6525 kB/8267 kB 79%] 864 kB/s 4s 94% [42 openjdk-8-jdk-headless 6897 kB/8267 kB 83%] 864 kB/s 3s 94% [42 openjdk-8-jdk-headless 7286 kB/8267 kB 88%] 864 kB/s 3s 95% [42 openjdk-8-jdk-headless 7647 kB/8267 kB 92%] 864 kB/s 2s 96% [42 openjdk-8-jdk-headless 7983 kB/8267 kB 97%] 756 kB/s 2s 97% [Waiting for headers] 756 kB/s 2s Get:43 http://us-central1.gce.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 openjdk-8-jdk amd64 8u222-b10-1ubuntu1~18.04.1 [1756 kB]
 97% [43 openjdk-8-jdk 16.0 kB/1756 kB 1%] 756 kB/s 2s 98% [43 openjdk-8-jdk 626 kB/1756 kB 36%] 756 kB/s 1s 99% [43 openjdk-8-jdk 1219 kB/1756 kB 69%] 756 kB/s 0s 100% [Working] 756 kB/s 0s Fetched 47.4 MB in 45s (1062 kB/s)
Extracting templates from packages: 69% Extracting templates from packages: 100%
78Selecting previously unselected package fontconfig.
(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 70587 files and directories currently installed.)
Preparing to unpack .../00-fontconfig_2.12.6-0ubuntu2_amd64.deb ...
7Progress: [ 0%] [...........................................................................................................................................................................................................................................................................] 8Unpacking fontconfig (2.12.6-0ubuntu2) ...
7Progress: [ 1%] [###........................................................................................................................................................................................................................................................................] 8Selecting previously unselected package libogg0:amd64.
Preparing to unpack .../01-libogg0_1.3.2-1_amd64.deb ...
Unpacking libogg0:amd64 (1.3.2-1) ...
7Progress: [ 2%] [######.....................................................................................................................................................................................................................................................................] 8Selecting previously unselected package hicolor-icon-theme.
Preparing to unpack .../02-hicolor-icon-theme_0.17-2_all.deb ...
7Progress: [ 3%] [########...................................................................................................................................................................................................................................................................] 8Unpacking hicolor-icon-theme (0.17-2) ...
7Progress: [ 4%] [###########................................................................................................................................................................................................................................................................] 8Selecting previously unselected package libjbig0:amd64.
Preparing to unpack .../03-libjbig0_2.1-3.1build1_amd64.deb ...
Unpacking libjbig0:amd64 (2.1-3.1build1) ...
7Progress: [ 5%] [#############..............................................................................................................................................................................................................................................................] 8Selecting previously unselected package libtiff5:amd64.
Preparing to unpack .../04-libtiff5_4.0.9-5ubuntu0.2_amd64.deb ...
7Progress: [ 6%] [################...........................................................................................................................................................................................................................................................] 8Unpacking libtiff5:amd64 (4.0.9-5ubuntu0.2) ...
Selecting previously unselected package libgdk-pixbuf2.0-common.
Preparing to unpack .../05-libgdk-pixbuf2.0-common_2.36.11-2_all.deb ...
7Progress: [ 7%] [###################........................................................................................................................................................................................................................................................] 8Unpacking libgdk-pixbuf2.0-common (2.36.11-2) ...
7Progress: [ 8%] [######################.....................................................................................................................................................................................................................................................] 8Selecting previously unselected package libgdk-pixbuf2.0-0:amd64.
Preparing to unpack .../06-libgdk-pixbuf2.0-0_2.36.11-2_amd64.deb ...
Unpacking libgdk-pixbuf2.0-0:amd64 (2.36.11-2) ...
7Progress: [ 9%] [########################...................................................................................................................................................................................................................................................] 8Selecting previously unselected package gtk-update-icon-cache.
Preparing to unpack .../07-gtk-update-icon-cache_3.22.30-1ubuntu4_amd64.deb ...
7Progress: [ 10%] [###########################................................................................................................................................................................................................................................................] 8No diversion 'diversion of /usr/sbin/update-icon-caches to /usr/sbin/update-icon-caches.gtk2 by libgtk-3-bin', none removed.
No diversion 'diversion of /usr/share/man/man8/update-icon-caches.8.gz to /usr/share/man/man8/update-icon-caches.gtk2.8.gz by libgtk-3-bin', none removed.
Unpacking gtk-update-icon-cache (3.22.30-1ubuntu4) ...
7Progress: [ 11%] [#############################..............................................................................................................................................................................................................................................] 8Selecting previously unselected package libpixman-1-0:amd64.
Preparing to unpack .../08-libpixman-1-0_0.34.0-2_amd64.deb ...
Unpacking libpixman-1-0:amd64 (0.34.0-2) ...
7Progress: [ 12%] [################################...........................................................................................................................................................................................................................................] 8Selecting previously unselected package libxcb-render0:amd64.
Preparing to unpack .../09-libxcb-render0_1.13-2~ubuntu18.04_amd64.deb ...
Unpacking libxcb-render0:amd64 (1.13-2~ubuntu18.04) ...
7Progress: [ 13%] [###################################........................................................................................................................................................................................................................................] 8Selecting previously unselected package libxcb-shm0:amd64.
Preparing to unpack .../10-libxcb-shm0_1.13-2~ubuntu18.04_amd64.deb ...
7Progress: [ 14%] [######################################.....................................................................................................................................................................................................................................] 8Unpacking libxcb-shm0:amd64 (1.13-2~ubuntu18.04) ...
7Progress: [ 15%] [########################################...................................................................................................................................................................................................................................] 8Selecting previously unselected package libcairo2:amd64.
Preparing to unpack .../11-libcairo2_1.15.10-2ubuntu0.1_amd64.deb ...
Unpacking libcairo2:amd64 (1.15.10-2ubuntu0.1) ...
7Progress: [ 16%] [###########################################................................................................................................................................................................................................................................] 8Selecting previously unselected package libcroco3:amd64.
Preparing to unpack .../12-libcroco3_0.6.12-2_amd64.deb ...
7Progress: [ 17%] [#############################################..............................................................................................................................................................................................................................] 8Unpacking libcroco3:amd64 (0.6.12-2) ...
7Progress: [ 18%] [################################################...........................................................................................................................................................................................................................] 8Selecting previously unselected package libthai-data.
Preparing to unpack .../13-libthai-data_0.1.27-2_all.deb ...
Unpacking libthai-data (0.1.27-2) ...
7Progress: [ 19%] [###################################################........................................................................................................................................................................................................................] 8Selecting previously unselected package libdatrie1:amd64.
Preparing to unpack .../14-libdatrie1_0.2.10-7_amd64.deb ...
Unpacking libdatrie1:amd64 (0.2.10-7) ...
7Progress: [ 20%] [######################################################.....................................................................................................................................................................................................................] 8Selecting previously unselected package libthai0:amd64.
Preparing to unpack .../15-libthai0_0.1.27-2_amd64.deb ...
7Progress: [ 21%] [########################################################...................................................................................................................................................................................................................] 8Unpacking libthai0:amd64 (0.1.27-2) ...
7Progress: [ 22%] [###########################################################................................................................................................................................................................................................................] 8Selecting previously unselected package libpango-1.0-0:amd64.
Preparing to unpack .../16-libpango-1.0-0_1.40.14-1ubuntu0.1_amd64.deb ...
Unpacking libpango-1.0-0:amd64 (1.40.14-1ubuntu0.1) ...
7Progress: [ 23%] [#############################################################..............................................................................................................................................................................................................] 8Selecting previously unselected package libgraphite2-3:amd64.
Preparing to unpack .../17-libgraphite2-3_1.3.11-2_amd64.deb ...
7Progress: [ 24%] [################################################################...........................................................................................................................................................................................................] 8Unpacking libgraphite2-3:amd64 (1.3.11-2) ...
7Progress: [ 25%] [##################################################################.........................................................................................................................................................................................................] 8Selecting previously unselected package libharfbuzz0b:amd64.
Preparing to unpack .../18-libharfbuzz0b_1.7.2-1ubuntu1_amd64.deb ...
Unpacking libharfbuzz0b:amd64 (1.7.2-1ubuntu1) ...
7Progress: [ 26%] [######################################################################.....................................................................................................................................................................................................] 8Selecting previously unselected package libpangoft2-1.0-0:amd64.
Preparing to unpack .../19-libpangoft2-1.0-0_1.40.14-1ubuntu0.1_amd64.deb ...
Unpacking libpangoft2-1.0-0:amd64 (1.40.14-1ubuntu0.1) ...
7Progress: [ 27%] [########################################################################...................................................................................................................................................................................................] 8Selecting previously unselected package libpangocairo-1.0-0:amd64.
Preparing to unpack .../20-libpangocairo-1.0-0_1.40.14-1ubuntu0.1_amd64.deb ...
7Progress: [ 28%] [###########################################################################................................................................................................................................................................................................] 8Unpacking libpangocairo-1.0-0:amd64 (1.40.14-1ubuntu0.1) ...
7Progress: [ 29%] [#############################################################################..............................................................................................................................................................................................] 8Selecting previously unselected package librsvg2-2:amd64.
Preparing to unpack .../21-librsvg2-2_2.40.20-2_amd64.deb ...
Unpacking librsvg2-2:amd64 (2.40.20-2) ...
7Progress: [ 30%] [################################################################################...........................................................................................................................................................................................] 8Selecting previously unselected package librsvg2-common:amd64.
Preparing to unpack .../22-librsvg2-common_2.40.20-2_amd64.deb ...
7Progress: [ 31%] [##################################################################################.........................................................................................................................................................................................] 8Unpacking librsvg2-common:amd64 (2.40.20-2) ...
Selecting previously unselected package humanity-icon-theme.
Preparing to unpack .../23-humanity-icon-theme_0.6.15_all.deb ...
7Progress: [ 32%] [######################################################################################.....................................................................................................................................................................................] 8Unpacking humanity-icon-theme (0.6.15) ...
7Progress: [ 33%] [########################################################################################...................................................................................................................................................................................] 8Selecting previously unselected package ubuntu-mono.
Preparing to unpack .../24-ubuntu-mono_16.10+18.04.20181005-0ubuntu1_all.deb ...
Unpacking ubuntu-mono (16.10+18.04.20181005-0ubuntu1) ...
7Progress: [ 34%] [###########################################################################################................................................................................................................................................................................] 8Selecting previously unselected package adwaita-icon-theme.
Preparing to unpack .../25-adwaita-icon-theme_3.28.0-1ubuntu1_all.deb ...
7Progress: [ 35%] [#############################################################################################..............................................................................................................................................................................] 8Unpacking adwaita-icon-theme (3.28.0-1ubuntu1) ...
7Progress: [ 36%] [################################################################################################...........................................................................................................................................................................] 8Selecting previously unselected package libasyncns0:amd64.
Preparing to unpack .../26-libasyncns0_0.8-6_amd64.deb ...
Unpacking libasyncns0:amd64 (0.8-6) ...
7Progress: [ 37%] [##################################################################################################.........................................................................................................................................................................] 8Selecting previously unselected package libflac8:amd64.
Preparing to unpack .../27-libflac8_1.3.2-1_amd64.deb ...
Unpacking libflac8:amd64 (1.3.2-1) ...
7Progress: [ 38%] [######################################################################################################.....................................................................................................................................................................] 8Selecting previously unselected package libgtk2.0-common.
Preparing to unpack .../28-libgtk2.0-common_2.24.32-1ubuntu1_all.deb ...
7Progress: [ 39%] [#########################################################################################################..................................................................................................................................................................] 8Unpacking libgtk2.0-common (2.24.32-1ubuntu1) ...
7Progress: [ 40%] [###########################################################################################################................................................................................................................................................................] 8Selecting previously unselected package libxcursor1:amd64.
Preparing to unpack .../29-libxcursor1_1%3a1.1.15-1_amd64.deb ...
Unpacking libxcursor1:amd64 (1:1.1.15-1) ...
7Progress: [ 41%] [##############################################################################################################.............................................................................................................................................................] 8Selecting previously unselected package libgtk2.0-0:amd64.
Preparing to unpack .../30-libgtk2.0-0_2.24.32-1ubuntu1_amd64.deb ...
7Progress: [ 42%] [################################################################################################################...........................................................................................................................................................] 8Unpacking libgtk2.0-0:amd64 (2.24.32-1ubuntu1) ...
7Progress: [ 43%] [##################################################################################################################.........................................................................................................................................................] 8Selecting previously unselected package libgail18:amd64.
Preparing to unpack .../31-libgail18_2.24.32-1ubuntu1_amd64.deb ...
Unpacking libgail18:amd64 (2.24.32-1ubuntu1) ...
7Progress: [ 44%] [######################################################################################################################.....................................................................................................................................................] 8Selecting previously unselected package libgail-common:amd64.
Preparing to unpack .../32-libgail-common_2.24.32-1ubuntu1_amd64.deb ...
Unpacking libgail-common:amd64 (2.24.32-1ubuntu1) ...
7Progress: [ 45%] [#########################################################################################################################..................................................................................................................................................] 8Selecting previously unselected package libgdk-pixbuf2.0-bin.
Preparing to unpack .../33-libgdk-pixbuf2.0-bin_2.36.11-2_amd64.deb ...
7Progress: [ 46%] [###########################################################################################################################................................................................................................................................................] 8Unpacking libgdk-pixbuf2.0-bin (2.36.11-2) ...
7Progress: [ 47%] [##############################################################################################################################.............................................................................................................................................] 8Selecting previously unselected package libgtk2.0-bin.
Preparing to unpack .../34-libgtk2.0-bin_2.24.32-1ubuntu1_amd64.deb ...
Unpacking libgtk2.0-bin (2.24.32-1ubuntu1) ...
7Progress: [ 48%] [################################################################################################################################...........................................................................................................................................] 8Selecting previously unselected package libvorbis0a:amd64.
Preparing to unpack .../35-libvorbis0a_1.3.5-4.2_amd64.deb ...
7Progress: [ 49%] [###################################################################################################################################........................................................................................................................................] 8Unpacking libvorbis0a:amd64 (1.3.5-4.2) ...
7Progress: [ 50%] [#####################################################################################################################################......................................................................................................................................] 8Selecting previously unselected package libvorbisenc2:amd64.
Preparing to unpack .../36-libvorbisenc2_1.3.5-4.2_amd64.deb ...
Unpacking libvorbisenc2:amd64 (1.3.5-4.2) ...
7Progress: [ 51%] [#########################################################################################################################################..................................................................................................................................] 8Selecting previously unselected package libsndfile1:amd64.
Preparing to unpack .../37-libsndfile1_1.0.28-4ubuntu0.18.04.1_amd64.deb ...
Unpacking libsndfile1:amd64 (1.0.28-4ubuntu0.18.04.1) ...
7Progress: [ 52%] [###########################################################################################################################################................................................................................................................................] 8Selecting previously unselected package libpulse0:amd64.
Preparing to unpack .../38-libpulse0_1%3a11.1-1ubuntu7.2_amd64.deb ...
7Progress: [ 53%] [##############################################################################################################################################.............................................................................................................................] 8Unpacking libpulse0:amd64 (1:11.1-1ubuntu7.2) ...
7Progress: [ 54%] [################################################################################################################################################...........................................................................................................................] 8Selecting previously unselected package openjdk-8-jre-headless:amd64.
Preparing to unpack .../39-openjdk-8-jre-headless_8u222-b10-1ubuntu1~18.04.1_amd64.deb ...
Unpacking openjdk-8-jre-headless:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
7Progress: [ 55%] [###################################################################################################################################################........................................................................................................................] 8Selecting previously unselected package openjdk-8-jre:amd64.
Preparing to unpack .../40-openjdk-8-jre_8u222-b10-1ubuntu1~18.04.1_amd64.deb ...
7Progress: [ 56%] [#####################################################################################################################################################......................................................................................................................] 8Unpacking openjdk-8-jre:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
Selecting previously unselected package openjdk-8-jdk-headless:amd64.
Preparing to unpack .../41-openjdk-8-jdk-headless_8u222-b10-1ubuntu1~18.04.1_amd64.deb ...
7Progress: [ 57%] [#########################################################################################################################################################..................................................................................................................] 8Unpacking openjdk-8-jdk-headless:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
7Progress: [ 58%] [###########################################################################################################################################################................................................................................................................] 8Selecting previously unselected package openjdk-8-jdk:amd64.
Preparing to unpack .../42-openjdk-8-jdk_8u222-b10-1ubuntu1~18.04.1_amd64.deb ...
Unpacking openjdk-8-jdk:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
7Progress: [ 59%] [##############################################################################################################################################################.............................................................................................................] 8Setting up libgtk2.0-common (2.24.32-1ubuntu1) ...
7Progress: [ 60%] [################################################################################################################################################################...........................................................................................................] 8Setting up libxcb-render0:amd64 (1.13-2~ubuntu18.04) ...
7Progress: [ 61%] [###################################################################################################################################################################........................................................................................................] 8Setting up libasyncns0:amd64 (0.8-6) ...
7Progress: [ 62%] [#####################################################################################################################################################################......................................................................................................] 8Processing triggers for mime-support (3.60ubuntu1) ...
Setting up libjbig0:amd64 (2.1-3.1build1) ...
7Progress: [ 63%] [#########################################################################################################################################################################..................................................................................................] 8Setting up libgdk-pixbuf2.0-common (2.36.11-2) ...
7Progress: [ 64%] [###########################################################################################################################################################################................................................................................................] 8Setting up libdatrie1:amd64 (0.2.10-7) ...
7Progress: [ 65%] [##############################################################################################################################################################################.............................................................................................] 8Setting up libtiff5:amd64 (4.0.9-5ubuntu0.2) ...
7Progress: [ 66%] [################################################################################################################################################################################...........................................................................................] 8Setting up libgraphite2-3:amd64 (1.3.11-2) ...
7Progress: [ 67%] [###################################################################################################################################################################################........................................................................................] 8Setting up libcroco3:amd64 (0.6.12-2) ...
7Progress: [ 68%] [#####################################################################################################################################################################################......................................................................................] 8Setting up libogg0:amd64 (1.3.2-1) ...
Setting up libpixman-1-0:amd64 (0.34.0-2) ...
7Progress: [ 69%] [#########################################################################################################################################################################################..................................................................................] 8Setting up libxcursor1:amd64 (1:1.1.15-1) ...
7Progress: [ 70%] [###########################################################################################################################################################################################................................................................................] 8Processing triggers for libc-bin (2.27-3ubuntu1) ...
Setting up libxcb-shm0:amd64 (1.13-2~ubuntu18.04) ...
7Progress: [ 71%] [##############################################################################################################################################################################################.............................................................................] 8Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
Setting up libthai-data (0.1.27-2) ...
7Progress: [ 72%] [################################################################################################################################################################################################...........................................................................] 8Setting up libvorbis0a:amd64 (1.3.5-4.2) ...
7Progress: [ 73%] [###################################################################################################################################################################################################........................................................................] 8Setting up hicolor-icon-theme (0.17-2) ...
7Progress: [ 74%] [#####################################################################################################################################################################################################......................................................................] 8Setting up fontconfig (2.12.6-0ubuntu2) ...
7Progress: [ 75%] [########################################################################################################################################################################################################...................................................................] 8Regenerating fonts cache... done.
Setting up openjdk-8-jre-headless:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode
7Progress: [ 76%] [###########################################################################################################################################################################################################................................................................] 8Setting up libcairo2:amd64 (1.15.10-2ubuntu0.1) ...
7Progress: [ 77%] [##############################################################################################################################################################################################################.............................................................] 8Setting up openjdk-8-jdk-headless:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode
7Progress: [ 78%] [################################################################################################################################################################################################################...........................................................] 8Setting up libgdk-pixbuf2.0-0:amd64 (2.36.11-2) ...
7Progress: [ 79%] [###################################################################################################################################################################################################################........................................................] 8Setting up libflac8:amd64 (1.3.2-1) ...
7Progress: [ 80%] [#####################################################################################################################################################################################################################......................................................] 8Setting up libgdk-pixbuf2.0-bin (2.36.11-2) ...
7Progress: [ 81%] [########################################################################################################################################################################################################################...................................................] 8Setting up libharfbuzz0b:amd64 (1.7.2-1ubuntu1) ...
Setting up libthai0:amd64 (0.1.27-2) ...
7Progress: [ 82%] [############################################################################################################################################################################################################################...............................................] 8Setting up gtk-update-icon-cache (3.22.30-1ubuntu4) ...
7Progress: [ 83%] [##############################################################################################################################################################################################################################.............................................] 8Setting up libpango-1.0-0:amd64 (1.40.14-1ubuntu0.1) ...
7Progress: [ 84%] [################################################################################################################################################################################################################################...........................................] 8Setting up libvorbisenc2:amd64 (1.3.5-4.2) ...
7Progress: [ 85%] [###################################################################################################################################################################################################################################........................................] 8Setting up libpangoft2-1.0-0:amd64 (1.40.14-1ubuntu0.1) ...
7Progress: [ 86%] [#####################################################################################################################################################################################################################################......................................] 8Setting up libsndfile1:amd64 (1.0.28-4ubuntu0.18.04.1) ...
7Progress: [ 87%] [########################################################################################################################################################################################################################################...................................] 8Setting up libpangocairo-1.0-0:amd64 (1.40.14-1ubuntu0.1) ...
7Progress: [ 88%] [############################################################################################################################################################################################################################################...............................] 8Setting up libpulse0:amd64 (1:11.1-1ubuntu7.2) ...
7Progress: [ 89%] [##############################################################################################################################################################################################################################################.............................] 8Setting up librsvg2-2:amd64 (2.40.20-2) ...
7Progress: [ 90%] [#################################################################################################################################################################################################################################################..........................] 8Setting up librsvg2-common:amd64 (2.40.20-2) ...
7Progress: [ 91%] [###################################################################################################################################################################################################################################################........................] 8Setting up adwaita-icon-theme (3.28.0-1ubuntu1) ...
update-alternatives: using /usr/share/icons/Adwaita/cursor.theme to provide /usr/share/icons/default/index.theme (x-cursor-theme) in auto mode
Setting up libgtk2.0-0:amd64 (2.24.32-1ubuntu1) ...
7Progress: [ 92%] [######################################################################################################################################################################################################################################################.....................] 8Setting up libgail18:amd64 (2.24.32-1ubuntu1) ...
7Progress: [ 93%] [########################################################################################################################################################################################################################################################...................] 8Setting up libgail-common:amd64 (2.24.32-1ubuntu1) ...
7Progress: [ 94%] [###########################################################################################################################################################################################################################################################................] 8Setting up humanity-icon-theme (0.6.15) ...
Setting up openjdk-8-jre:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
7Progress: [ 95%] [##############################################################################################################################################################################################################################################################.............] 8update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode
Setting up libgtk2.0-bin (2.24.32-1ubuntu1) ...
7Progress: [ 96%] [#################################################################################################################################################################################################################################################################..........] 8Setting up openjdk-8-jdk:amd64 (8u222-b10-1ubuntu1~18.04.1) ...
7Progress: [ 97%] [###################################################################################################################################################################################################################################################################........] 8update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode
Setting up ubuntu-mono (16.10+18.04.20181005-0ubuntu1) ...
7Progress: [ 98%] [######################################################################################################################################################################################################################################################################.....] 8Processing triggers for libc-bin (2.27-3ubuntu1) ...
Processing triggers for libgdk-pixbuf2.0-0:amd64 (2.36.11-2) ...
7Progress: [ 99%] [########################################################################################################################################################################################################################################################################...] 8
78]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ sudo update-alternatives --config java
There are 2 choices for the alternative java (providing /usr/bin/java).
Selection Path Priority Status
------------------------------------------------------------
* 0 /usr/lib/jvm/java-11-openjdk-amd64/bin/java 1111 auto mode
1 /usr/lib/jvm/java-11-openjdk-amd64/bin/java 1111 manual mode
2 /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java 1081 manual mode
Press <enter> to keep the current choice[*], or type selection number: 2
update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java to provide /usr/bin/java (java) in manual mode
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ java
Usage: java [-options] class [args...]
(to execute a class)
or java [-options] -jar jarfile [args...]
(to execute a jar file)
where options include:
-d32 use a 32-bit data model if available
-d64 use a 64-bit data model if available
-server to select the "server" VM
-zero to select the "zero" VM
-dcevm to select the "dcevm" VM
The default VM is server,
because you are running on a server-class machine.
-cp <class search path of directories and zip/jar files>
-classpath <class search path of directories and zip/jar files>
A : separated list of directories, JAR archives,
and ZIP archives to search for class files.
-D<name>=<value>
set a system property
-verbose:[class|gc|jni]
enable verbose output
-version print product version and exit
-version:<value>
Warning: this feature is deprecated and will be removed
in a future release.
require the specified version to run
-showversion print product version and continue
-jre-restrict-search | -no-jre-restrict-search
Warning: this feature is deprecated and will be removed
in a future release.
include/exclude user private JREs in the version search
-? -help print this help message
-X print help on non-standard options
-ea[:<packagename>...|:<classname>]
-enableassertions[:<packagename>...|:<classname>]
enable assertions with specified granularity
-da[:<packagename>...|:<classname>]
-disableassertions[:<packagename>...|:<classname>]
disable assertions with specified granularity
-esa | -enablesystemassertions
enable system assertions
-dsa | -disablesystemassertions
disable system assertions
-agentlib:<libname>[=<options>]
load native agent library <libname>, e.g. -agentlib:hprof
see also, -agentlib:jdwp=help and -agentlib:hprof=help
-agentpath:<pathname>[=<options>]
load native agent library by full pathname
-javaagent:<jarpath>[=<options>]
load Java programming language agent, see java.lang.instrument
-splash:<imagepath>
show splash screen with specified image
See http://www.oracle.com/technetwork/java/javase/documentation/index.html for more details.
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ jav -va √ersion-version
openjdk version "1.8.0_222"
OpenJDK Runtime Environment (build 1.8.0_222-8u222-b10-1ubuntu1~18.04.1-b10)
OpenJDK 64-Bit Server VM (build 25.222-b10, mixed mode)
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ echo $SHJAHAVJAVA_HOME
/usr/lib/jvm/default-java
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ echo $JAVA_HOMEjava -versionsudo update-alternatives --config javaapt install openjdk-8-jdkjava -versioncat ~/.bashrc [19@head yellow_tripdata_2015-01.csvlsspark-shell
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/ubuntu/spark-2.4.3-bin-hadoop2.7/jars/spark-unsafe_2.11-2.4.3.jar) to method java.nio.Bits.unaligned()
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
19/08/14 20:09:03 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://experiment-33bafd31037788eb.c.pilosa-sandbox.internal:4040
Spark context available as 'sc' (master = local[*], app id = local-1565813349645).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.3
/_/
Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 11.0.4)
Type in expressions to have them evaluated.
Type :help for more information.
scala> :quitcsvrdd.take(10).foreach(println)val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv")
csvrdd: org.apache.spark.rdd.RDD[String] = ./yellow_tripdata_2015-01.csv MapPartitionsRDD[1] at textFile at <console>:24
scala> val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv"):quitcsvrdd.take(10).foreach(println)val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv")csvrdd.take(10).foreach(println)
java.lang.IllegalArgumentException: Unsupported class file major version 55
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:166)
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:148)
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:136)
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:237)
at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:49)
at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:517)
at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:500)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:134)
at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:134)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:236)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap$$anon$1.foreach(HashMap.scala:134)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:732)
at org.apache.spark.util.FieldAccessFinder$$anon$3.visitMethodInsn(ClosureCleaner.scala:500)
at org.apache.xbean.asm6.ClassReader.readCode(ClassReader.java:2175)
at org.apache.xbean.asm6.ClassReader.readMethod(ClassReader.java:1238)
at org.apache.xbean.asm6.ClassReader.accept(ClassReader.java:631)
at org.apache.xbean.asm6.ClassReader.accept(ClassReader.java:355)
at org.apache.spark.util.ClosureCleaner$$anonfun$org$apache$spark$util$ClosureCleaner$$clean$14.apply(ClosureCleaner.scala:307)
at org.apache.spark.util.ClosureCleaner$$anonfun$org$apache$spark$util$ClosureCleaner$$clean$14.apply(ClosureCleaner.scala:306)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.util.ClosureCleaner$.org$apache$spark$util$ClosureCleaner$$clean(ClosureCleaner.scala:306)
at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:162)
at org.apache.spark.SparkContext.clean(SparkContext.scala:2326)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2100)
at org.apache.spark.rdd.RDD$$anonfun$take$1.apply(RDD.scala:1364)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
at org.apache.spark.rdd.RDD.take(RDD.scala:1337)
... 49 elided
scala> :quite
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ (/usr/libexec/java_home -v 1.8
bash: /usr/libexec/java_home: No such file or directory
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/
X11/ chrony/ dpkg/ gnupg/ jvm/ lxcfs/ openssh/ python3.6/ software-properties/ tar/
accountsservice/ cloud-init/ dracut/ gnupg2/ kernel/ lxd/ os-prober/ python3.7/ sshguard/ tc/
apt/ cnf-update-db eject/ gold-ld/ klibc/ man-db/ os-probes/ rsyslog/ ssl/ tmpfiles.d/
at-spi2-core/ command-not-found environment.d/ groff/ language-selector/ mime/ pm-utils/ sasl2/ sudo/ ubuntu-release-upgrader/
bfd-plugins/ compat-ld/ file/ grub/ linux/ modules-load.d/ policykit-1/ sftp-server sysctl.d/ update-notifier/
binfmt.d/ dbus-1.0/ gcc/ initcpio/ linux-boot-probes/ networkd-dispatcher/ python2.7/ shim/ systemd/ valgrind/
byobu/ debug/ git-core/ initramfs-tools/ locale/ open-vm-tools/ python3/ snapd/ sysusers.d/ x86_64-linux-gnu/
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/
X11/ chrony/ dpkg/ gnupg/ jvm/ lxcfs/ openssh/ python3.6/ software-properties/ tar/
accountsservice/ cloud-init/ dracut/ gnupg2/ kernel/ lxd/ os-prober/ python3.7/ sshguard/ tc/
apt/ cnf-update-db eject/ gold-ld/ klibc/ man-db/ os-probes/ rsyslog/ ssl/ tmpfiles.d/
at-spi2-core/ command-not-found environment.d/ groff/ language-selector/ mime/ pm-utils/ sasl2/ sudo/ ubuntu-release-upgrader/
bfd-plugins/ compat-ld/ file/ grub/ linux/ modules-load.d/ policykit-1/ sftp-server sysctl.d/ update-notifier/
binfmt.d/ dbus-1.0/ gcc/ initcpio/ linux-boot-probes/ networkd-dispatcher/ python2.7/ shim/ systemd/ valgrind/
byobu/ debug/ git-core/ initramfs-tools/ locale/ open-vm-tools/ python3/ snapd/ sysusers.d/ x86_64-linux-gnu/
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/e
eject/ environment.d/
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/e
eject/ environment.d/
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ /usr/lib/ee
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ echocat /!/.~/.bashrc
# ~/.bashrc: executed by bash(1) for non-login shells.
# see /usr/share/doc/bash/examples/startup-files (in the package bash-doc)
# for examples
# If not running interactively, don't do anything
case $- in
*i*) ;;
*) return;;
esac
# don't put duplicate lines or lines starting with space in the history.
# See bash(1) for more options
HISTCONTROL=ignoreboth
# append to the history file, don't overwrite it
shopt -s histappend
# for setting history length see HISTSIZE and HISTFILESIZE in bash(1)
HISTSIZE=1000
HISTFILESIZE=2000
# check the window size after each command and, if necessary,
# update the values of LINES and COLUMNS.
shopt -s checkwinsize
# If set, the pattern "**" used in a pathname expansion context will
# match all files and zero or more directories and subdirectories.
#shopt -s globstar
# make less more friendly for non-text input files, see lesspipe(1)
[ -x /usr/bin/lesspipe ] && eval "$(SHELL=/bin/sh lesspipe)"
# set variable identifying the chroot you work in (used in the prompt below)
if [ -z "${debian_chroot:-}" ] && [ -r /etc/debian_chroot ]; then
debian_chroot=$(cat /etc/debian_chroot)
fi
# set a fancy prompt (non-color, unless we know we "want" color)
case "$TERM" in
xterm-color|*-256color) color_prompt=yes;;
esac
# uncomment for a colored prompt, if the terminal has the capability; turned
# off by default to not distract the user: the focus in a terminal window
# should be on the output of commands, not on the prompt
#force_color_prompt=yes
if [ -n "$force_color_prompt" ]; then
if [ -x /usr/bin/tput ] && tput setaf 1 >&/dev/null; then
# We have color support; assume it's compliant with Ecma-48
# (ISO/IEC-6429). (Lack of such support is extremely rare, and such
# a case would tend to support setf rather than setaf.)
color_prompt=yes
else
color_prompt=
fi
fi
if [ "$color_prompt" = yes ]; then
PS1='${debian_chroot:+($debian_chroot)}\[\033[01;32m\]\u@\h\[\033[00m\]:\[\033[01;34m\]\w\[\033[00m\]\$ '
else
PS1='${debian_chroot:+($debian_chroot)}\u@\h:\w\$ '
fi
unset color_prompt force_color_prompt
# If this is an xterm set the title to user@host:dir
case "$TERM" in
xterm*|rxvt*)
PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1"
;;
*)
;;
esac
# enable color support of ls and also add handy aliases
if [ -x /usr/bin/dircolors ]; then
test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)"
alias ls='ls --color=auto'
#alias dir='dir --color=auto'
#alias vdir='vdir --color=auto'
alias grep='grep --color=auto'
alias fgrep='fgrep --color=auto'
alias egrep='egrep --color=auto'
fi
# colored GCC warnings and errors
#export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01'
# some more ls aliases
alias ll='ls -alF'
alias la='ls -A'
alias l='ls -CF'
# Add an "alert" alias for long running commands. Use like so:
# sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s*[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'
# Alias definitions.
# You may want to put all your additions into a separate file like
# ~/.bash_aliases, instead of adding them here directly.
# See /usr/share/doc/bash-doc/examples in the bash-doc package.
if [ -f ~/.bash_aliases ]; then
. ~/.bash_aliases
fi
# enable programmable completion features (you don't need to enable
# this, if it's already enabled in /etc/bash.bashrc and /etc/profile
# sources /etc/bash.bashrc).
if ! shopt -oq posix; then
if [ -f /usr/share/bash-completion/bash_completion ]; then
. /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
. /etc/bash_completion
fi
fi
test "$(ps -ocommand= -p $PPID | awk '{print $1}')" == 'script' || (script -f $HOME/$(date +"%d-%b-%y_%H-%M-%S")_shell.log)
export JAVA_HOME=/usr/lib/jvm/default-java/
export SPARK_HOME=/home/ubuntu/spark-2.4.3-bin-hadoop2.7/bin
export PATH=$PATH:$SPARK_HOME
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ JAVexport JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ spark-shell
19/08/14 20:11:08 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://experiment-33bafd31037788eb.c.pilosa-sandbox.internal:4040
Spark context available as 'sc' (master = local[*], app id = local-1565813474690).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.3
/_/
Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 1.8.0_222)
Type in expressions to have them evaluated.
Type :help for more information.
scala> :quitcsvrdd.take(10).foreach(println)val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv")
csvrdd: org.apache.spark.rdd.RDD[String] = ./yellow_tripdata_2015-01.csv MapPartitionsRDD[1] at textFile at <console>:24
scala> val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv"):quitcsvrdd.take(10).foreach(println)
VendorID,tpep_pickup_datetime,tpep_dropoff_datetime,passenger_count,trip_distance,pickup_longitude,pickup_latitude,RateCodeID,store_and_fwd_flag,dropoff_longitude,dropoff_latitude,payment_type,fare_amount,extra,mta_tax,tip_amount,tolls_amount,improvement_surcharge,total_amount
2,2015-01-15 19:05:39,2015-01-15 19:23:42,1,1.59,-73.993896484375,40.750110626220703,1,N,-73.974784851074219,40.750617980957031,1,12,1,0.5,3.25,0,0.3,17.05
1,2015-01-10 20:33:38,2015-01-10 20:53:28,1,3.30,-74.00164794921875,40.7242431640625,1,N,-73.994415283203125,40.759109497070313,1,14.5,0.5,0.5,2,0,0.3,17.8
1,2015-01-10 20:33:38,2015-01-10 20:43:41,1,1.80,-73.963340759277344,40.802787780761719,1,N,-73.951820373535156,40.824413299560547,2,9.5,0.5,0.5,0,0,0.3,10.8
1,2015-01-10 20:33:39,2015-01-10 20:35:31,1,.50,-74.009086608886719,40.713817596435547,1,N,-74.004325866699219,40.719985961914063,2,3.5,0.5,0.5,0,0,0.3,4.8
1,2015-01-10 20:33:39,2015-01-10 20:52:58,1,3.00,-73.971176147460938,40.762428283691406,1,N,-74.004180908203125,40.742652893066406,2,15,0.5,0.5,0,0,0.3,16.3
1,2015-01-10 20:33:39,2015-01-10 20:53:52,1,9.00,-73.874374389648438,40.7740478515625,1,N,-73.986976623535156,40.758193969726563,1,27,0.5,0.5,6.7,5.33,0.3,40.33
1,2015-01-10 20:33:39,2015-01-10 20:58:31,1,2.20,-73.9832763671875,40.726009368896484,1,N,-73.992469787597656,40.7496337890625,2,14,0.5,0.5,0,0,0.3,15.3
1,2015-01-10 20:33:39,2015-01-10 20:42:20,3,.80,-74.002662658691406,40.734142303466797,1,N,-73.995010375976563,40.726325988769531,1,7,0.5,0.5,1.66,0,0.3,9.96
1,2015-01-10 20:33:39,2015-01-10 21:11:35,3,18.20,-73.783042907714844,40.644355773925781,2,N,-73.987594604492187,40.759357452392578,2,52,0,0.5,0,5.33,0.3,58.13
scala> val fw1-csv  = csvrdd.filter(s->=>s.contains("1"))
f1: org.apache.spark.rdd.RDD[String] = MapPartitionsRDD[2] at filter at <console>:25
scala> f1.take(10).foreach9prinh(Printprintln)
2,2015-01-15 19:05:39,2015-01-15 19:23:42,1,1.59,-73.993896484375,40.750110626220703,1,N,-73.974784851074219,40.750617980957031,1,12,1,0.5,3.25,0,0.3,17.05
1,2015-01-10 20:33:38,2015-01-10 20:53:28,1,3.30,-74.00164794921875,40.7242431640625,1,N,-73.994415283203125,40.759109497070313,1,14.5,0.5,0.5,2,0,0.3,17.8
1,2015-01-10 20:33:38,2015-01-10 20:43:41,1,1.80,-73.963340759277344,40.802787780761719,1,N,-73.951820373535156,40.824413299560547,2,9.5,0.5,0.5,0,0,0.3,10.8
1,2015-01-10 20:33:39,2015-01-10 20:35:31,1,.50,-74.009086608886719,40.713817596435547,1,N,-74.004325866699219,40.719985961914063,2,3.5,0.5,0.5,0,0,0.3,4.8
1,2015-01-10 20:33:39,2015-01-10 20:52:58,1,3.00,-73.971176147460938,40.762428283691406,1,N,-74.004180908203125,40.742652893066406,2,15,0.5,0.5,0,0,0.3,16.3
1,2015-01-10 20:33:39,2015-01-10 20:53:52,1,9.00,-73.874374389648438,40.7740478515625,1,N,-73.986976623535156,40.758193969726563,1,27,0.5,0.5,6.7,5.33,0.3,40.33
1,2015-01-10 20:33:39,2015-01-10 20:58:31,1,2.20,-73.9832763671875,40.726009368896484,1,N,-73.992469787597656,40.7496337890625,2,14,0.5,0.5,0,0,0.3,15.3
1,2015-01-10 20:33:39,2015-01-10 20:42:20,3,.80,-74.002662658691406,40.734142303466797,1,N,-73.995010375976563,40.726325988769531,1,7,0.5,0.5,1.66,0,0.3,9.96
1,2015-01-10 20:33:39,2015-01-10 21:11:35,3,18.20,-73.783042907714844,40.644355773925781,2,N,-73.987594604492187,40.759357452392578,2,52,0,0.5,0,5.33,0.3,58.13
1,2015-01-10 20:33:40,2015-01-10 20:40:44,2,.90,-73.985588073730469,40.767948150634766,1,N,-73.985916137695313,40.759365081787109,1,6.5,0.5,0.5,1.55,0,0.3,9.35
scala> f1.take(10).foreach(println)val f1= csvrdd.filter(s=>s.contains("1"))csvrdd.take(10).foreach(println)val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv").rdd
<console>:24: error: value rdd is not a member of org.apache.spark.rdd.RDD[String]
val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv").rdd
^
scala> val csvrdd = sc.textFile("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd.("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdds("./yellow_tripdata_2015-01.csv").rddp("./yellow_tripdata_2015-01.csv").rdda("./yellow_tripdata_2015-01.csv").rddr("./yellow_tripdata_2015-01.csv").rddk("./yellow_tripdata_2015-01.csv").rdd.("./yellow_tripdata_2015-01.csv").rddr("./yellow_tripdata_2015-01.csv").rdda("./yellow_tripdata_2015-01.csv").rddd("./yellow_tripdata_2015-01.csv").rdd.("./yellow_tripdata_2015-01.csv").rddc("./yellow_tripdata_2015-01.csv").rdds("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdde("./yellow_tripdata_2015-01.csv").rdda("./yellow_tripdata_2015-01.csv").rddd("./yellow_tripdata_2015-01.csv").rdd.("./yellow_tripdata_2015-01.csv").rddc("./yellow_tripdata_2015-01.csv").rdds("./yellow_tripdata_2015-01.csv").rddv("./yellow_tripdata_2015-01.csv").rdd9("./yellow_tripdata_2015-01.csv").rdd("./yellow_tripdata_2015-01.csv").rdd(("./yellow_tripdata_2015-01.csv").rdd, header=true, mode"="DROPMALFORMED",schema=scheakama)
| ]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ spark-shell
19/08/14 20:24:16 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://experiment-33bafd31037788eb.c.pilosa-sandbox.internal:4040
Spark context available as 'sc' (master = local[*], app id = local-1565814263339).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 2.4.3
/_/
Using Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 1.8.0_222)
Type in expressions to have them evaluated.
Type :help for more information.
scala> val csvrdd = spark.read.csv(("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED",schema=schema)("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED",schema=schema)
<console>:23: error: package schema is not a value
val csvrdd = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED",schema=schema)
^
scala> val csvrdd = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED",schema=schema))
<console>:23: error: overloaded method value csv with alternatives:
(paths: String*)org.apache.spark.sql.DataFrame <and>
(csvDataset: org.apache.spark.sql.Dataset[String])org.apache.spark.sql.DataFrame <and>
(path: String)org.apache.spark.sql.DataFrame
cannot be applied to (String, header: Boolean, mode: String)
val csvrdd = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED")
^
scala> val csvrdd = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED")1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED")
<console>:23: error: overloaded method value csv with alternatives:
(paths: String*)org.apache.spark.sql.DataFrame <and>
(csvDataset: org.apache.spark.sql.Dataset[String])org.apache.spark.sql.DataFrame <and>
(path: String)org.apache.spark.sql.DataFrame
cannot be applied to (String, header: Boolean, mode: String)
val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED")
^
scala> val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, mode="DROPMALFORMED")True, inferSchema=True, )
<console>:23: error: not found: value True
val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=True, inferSchema=True)
^
<console>:23: error: not found: value True
val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=True, inferSchema=True)
^
scala> val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=True, inferSchema=True),multilineLine=True_)
<console>:23: error: not found: value True
val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=True, inferSchema=True,multiLine=True)
^
<console>:23: error: not found: value True
val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=True, inferSchema=True,multiLine=True)
^
<console>:23: error: not found: value True
val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=True, inferSchema=True,multiLine=True)
^
scala> val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=True, inferSchema=True,multiLine=True)rue)true)rue,multiLine=true)true,multiLine=true)rue, inferSchema=true,multiLine=true)true, inferSchema=true,multiLine=true)rue, inferSchema=true,multiLine=true)true, inferSchema=true,multiLine=true)
<console>:23: error: overloaded method value csv with alternatives:
(paths: String*)org.apache.spark.sql.DataFrame <and>
(csvDataset: org.apache.spark.sql.Dataset[String])org.apache.spark.sql.DataFrame <and>
(path: String)org.apache.spark.sql.DataFrame
cannot be applied to (String, header: Boolean, inferSchema: Boolean, multiLine: Boolean)
val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)
^
scala> sqlContext = SQLContext (sparkcontext)
<console>:25: error: not found: value sqlContext
val $ires6 = sqlContext
^
<console>:23: error: not found: value sqlContext
sqlContext = SQLContext (sparkcontext)
^
scala> sqlContext = SQLContext (sparkcontext)))))))))))))s)c)
<console>:26: error: not found: value sqlContext
val $ires7 = sqlContext
^
<console>:24: error: not found: value sqlContext
sqlContext = SQLContext (sc)
^
scala> sqlContext = SQLContext (sc)v sqlContext = SQLContext (sc)l sqlContext = SQLContext (sc) sqlContext = SQLContext (sc)a sqlContext = SQLContext (sc)l sqlContext = SQLContext (sc)
<console>:24: error: not found: value SQLContext
val sqlContext = SQLContext (sc)
^
scala> val sqlContext = SQLContext (sc)sqlContext = sc. sqlContext = SQLContext (sc)parkcontext)val csvrdd1 = spark.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true).read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true).read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true).read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true).read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true).read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)s.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)c.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)..read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)s.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)q.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)l.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)
<console>:24: error: value sql is not a member of org.apache.spark.SparkContext
val csvrdd1 = sc.sql.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)
^
<console>:24: error: not found: value header
val csvrdd1 = sc.sql.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)
^
<console>:24: error: not found: value inferSchema
val csvrdd1 = sc.sql.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)
^
<console>:24: error: not found: value multiLine
val csvrdd1 = sc.sql.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)
^
scala> quit:quit
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ls
lost+found yellow_tripdata_2015-01.csv
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ tail ~/typ
.bash_history .bashrc .config/ .profile .ssh/ .viminfo spark-2.4.3-bin-hadoop2.7/
.bash_logout .cache/ .gnupg/ .scala_history .sudo_as_admin_successful 14-Aug-19_19-13-19_shell.log spark-2.4.3-bin-hadoop2.7.tgz
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ tail ~/14-Aug-19_19-13-19_shell.log
val csvrdd1 = sc.sql.read.csv("./yellow_tripdata_2015-01.csv", header=true, inferSchema=true,multiLine=true)
^
scala> quit:quit
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ ls
lost+found yellow_tripdata_2015-01.csv
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ tail ~/typ
.bash_history .bashrc .config/ .profile .ssh/ .viminfo spark-2.4.3-bin-hadoop2.7/
.bash_logout .cache/ .gnupg/ .scala_history .sudo_as_admin_successful 14-Aug-19_19-13-19_shell.log spark-2.4.3-bin-hadoop2.7.tgz
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ tail ~/14-Aug-19_19-13-19_shell.log
]0;ubuntu@experiment-33bafd31037788eb: /mnt/disks/data1ubuntu@experiment-33bafd31037788eb:/mnt/disks/data1$ exit
exit
Script done on 2019-08-14 20:54:06+0000
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment