Skip to content

Instantly share code, notes, and snippets.

@julienchastang

julienchastang/out.txt

Last active March 11, 2019 19:06
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save julienchastang/d99a6a081aa6e80033524c4860567c52 to your computer and use it in GitHub Desktop.
Save julienchastang/d99a6a081aa6e80033524c4860567c52 to your computer and use it in GitHub Desktop.
Download ZIP
scale output
Raw
out.txt
Script started on Mon Mar 11 18:50:40 2019
[?1034hsh-4.2$ eval $(ssh-agent -s)
Agent pid 26813
sh-4.2$ ssh-add ~/.ssh/id_rsa
Identity added: /home/openstack/.ssh/id_rsa (/home/openstack/.ssh/id_rsa)
sh-4.2$ pwd
/home/openstack/jetstream_kubespray/inventory/kube-exp
sh-4.2$ cd ../../
sh-4.2$ CLUSTER=kube-exp bash -c 'sh k8s_scale.sh' sh-4.2$ cd  CLUSTER=kube-exp bash -c 'sh k8s_scale.sh'
Using /home/openstack/jetstream_kubespray/ansible.cfg as config file
/home/openstack/jetstream_kubespray/inventory/kube-exp/hosts did not meet host_list requirements, check plugin documentation if this is unexpected
PLAY [localhost] ***********************************************************************************************************************
TASK [Check ansible version !=2.7.0] ***************************************************************************************************
Monday 11 March 2019 18:51:54 +0000 (0:00:00.047) 0:00:00.047 **********
ok: [localhost] => {
 "changed": false, 
 "msg": "All assertions passed"
}
PLAY [localhost] ***********************************************************************************************************************
TASK [deploy warning for non kubeadm] **************************************************************************************************
Monday 11 March 2019 18:51:54 +0000 (0:00:00.088) 0:00:00.135 **********
TASK [deploy cluster for non kubeadm] **************************************************************************************************
Monday 11 March 2019 18:51:54 +0000 (0:00:00.057) 0:00:00.193 **********
 [WARNING]: Could not match supplied host pattern, ignoring: bastion

PLAY [bastion[0]] **********************************************************************************************************************
skipping: no hosts matched
PLAY [kube-node] ***********************************************************************************************************************
TASK [download : include_tasks] ********************************************************************************************************
Monday 11 March 2019 18:51:55 +0000 (0:00:00.133) 0:00:00.326 **********
TASK [download : Download items] *******************************************************************************************************
Monday 11 March 2019 18:51:55 +0000 (0:00:00.146) 0:00:00.472 **********
TASK [download : Sync container] *******************************************************************************************************
Monday 11 March 2019 18:51:56 +0000 (0:00:00.799) 0:00:01.272 **********
TASK [kubespray-defaults : Configure defaults] *****************************************************************************************
Monday 11 March 2019 18:51:56 +0000 (0:00:00.801) 0:00:02.073 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
TASK [bootstrap-os : Fetch /etc/os-release] ********************************************************************************************
Monday 11 March 2019 18:51:57 +0000 (0:00:00.214) 0:00:02.288 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "rc": 0, "stderr": "Shared connection to 10.0.0.6 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.6 closed."], "stdout": "NAME=\"Ubuntu\"\r\nVERSION=\"18.04.2 LTS (Bionic Beaver)\"\r\nID=ubuntu\r\nID_LIKE=debian\r\nPRETTY_NAME=\"Ubuntu 18.04.2 LTS\"\r\nVERSION_ID=\"18.04\"\r\nHOME_URL=\"https://www.ubuntu.com/\"\r\nSUPPORT_URL=\"https://help.ubuntu.com/\"\r\nBUG_REPORT_URL=\"https://bugs.launchpad.net/ubuntu/\"\r\nPRIVACY_POLICY_URL=\"https://www.ubuntu.com/legal/terms-and-policies/privacy-policy\"\r\nVERSION_CODENAME=bionic\r\nUBUNTU_CODENAME=bionic\r\n", "stdout_lines": ["NAME=\"Ubuntu\"", "VERSION=\"18.04.2 LTS (Bionic Beaver)\"", "ID=ubuntu", "ID_LIKE=debian", "PRETTY_NAME=\"Ubuntu 18.04.2 LTS\"", "VERSION_ID=\"18.04\"", "HOME_URL=\"https://www.ubuntu.com/\"", "SUPPORT_URL=\"https://help.ubuntu.com/\"", "BUG_REPORT_URL=\"https://bugs.launchpad.net/ubuntu/\"", "PRIVACY_POLICY_URL=\"https://www.ubuntu.com/legal/terms-and-policies/privacy-policy\"", "VERSION_CODENAME=bionic", "UBUNTU_CODENAME=bionic"]}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "rc": 0, "stderr": "Warning: Permanently added '10.0.0.4' (ECDSA) to the list of known hosts.\r\nShared connection to 10.0.0.4 closed.\r\n", "stderr_lines": ["Warning: Permanently added '10.0.0.4' (ECDSA) to the list of known hosts.", "Shared connection to 10.0.0.4 closed."], "stdout": "NAME=\"Ubuntu\"\r\nVERSION=\"18.04.2 LTS (Bionic Beaver)\"\r\nID=ubuntu\r\nID_LIKE=debian\r\nPRETTY_NAME=\"Ubuntu 18.04.2 LTS\"\r\nVERSION_ID=\"18.04\"\r\nHOME_URL=\"https://www.ubuntu.com/\"\r\nSUPPORT_URL=\"https://help.ubuntu.com/\"\r\nBUG_REPORT_URL=\"https://bugs.launchpad.net/ubuntu/\"\r\nPRIVACY_POLICY_URL=\"https://www.ubuntu.com/legal/terms-and-policies/privacy-policy\"\r\nVERSION_CODENAME=bionic\r\nUBUNTU_CODENAME=bionic\r\n", "stdout_lines": ["NAME=\"Ubuntu\"", "VERSION=\"18.04.2 LTS (Bionic Beaver)\"", "ID=ubuntu", "ID_LIKE=debian", "PRETTY_NAME=\"Ubuntu 18.04.2 LTS\"", "VERSION_ID=\"18.04\"", "HOME_URL=\"https://www.ubuntu.com/\"", "SUPPORT_URL=\"https://help.ubuntu.com/\"", "BUG_REPORT_URL=\"https://bugs.launchpad.net/ubuntu/\"", "PRIVACY_POLICY_URL=\"https://www.ubuntu.com/legal/terms-and-policies/privacy-policy\"", "VERSION_CODENAME=bionic", "UBUNTU_CODENAME=bionic"]}
ok: [kube-exp-k8s-node-nf-3] => {"changed": false, "rc": 0, "stderr": "Warning: Permanently added '10.0.0.14' (ECDSA) to the list of known hosts.\r\nShared connection to 10.0.0.14 closed.\r\n", "stderr_lines": ["Warning: Permanently added '10.0.0.14' (ECDSA) to the list of known hosts.", "Shared connection to 10.0.0.14 closed."], "stdout": "NAME=\"Ubuntu\"\r\nVERSION=\"18.04.2 LTS (Bionic Beaver)\"\r\nID=ubuntu\r\nID_LIKE=debian\r\nPRETTY_NAME=\"Ubuntu 18.04.2 LTS\"\r\nVERSION_ID=\"18.04\"\r\nHOME_URL=\"https://www.ubuntu.com/\"\r\nSUPPORT_URL=\"https://help.ubuntu.com/\"\r\nBUG_REPORT_URL=\"https://bugs.launchpad.net/ubuntu/\"\r\nPRIVACY_POLICY_URL=\"https://www.ubuntu.com/legal/terms-and-policies/privacy-policy\"\r\nVERSION_CODENAME=bionic\r\nUBUNTU_CODENAME=bionic\r\n", "stdout_lines": ["NAME=\"Ubuntu\"", "VERSION=\"18.04.2 LTS (Bionic Beaver)\"", "ID=ubuntu", "ID_LIKE=debian", "PRETTY_NAME=\"Ubuntu 18.04.2 LTS\"", "VERSION_ID=\"18.04\"", "HOME_URL=\"https://www.ubuntu.com/\"", "SUPPORT_URL=\"https://help.ubuntu.com/\"", "BUG_REPORT_URL=\"https://bugs.launchpad.net/ubuntu/\"", "PRIVACY_POLICY_URL=\"https://www.ubuntu.com/legal/terms-and-policies/privacy-policy\"", "VERSION_CODENAME=bionic", "UBUNTU_CODENAME=bionic"]}
TASK [bootstrap-os : Set bootstrap_os] *************************************************************************************************
Monday 11 March 2019 18:52:02 +0000 (0:00:05.290) 0:00:07.579 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"os_family": "ubuntu"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"os_family": "ubuntu"}, "changed": false}
ok: [kube-exp-k8s-node-nf-3] => {"ansible_facts": {"os_family": "ubuntu"}, "changed": false}
TASK [bootstrap-os : include_tasks] ****************************************************************************************************
Monday 11 March 2019 18:52:02 +0000 (0:00:00.210) 0:00:07.789 **********
included: /home/openstack/jetstream_kubespray/roles/bootstrap-os/tasks/bootstrap-ubuntu.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2, kube-exp-k8s-node-nf-3
TASK [bootstrap-os : List ubuntu_packages] *********************************************************************************************
Monday 11 March 2019 18:52:02 +0000 (0:00:00.318) 0:00:08.108 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"ubuntu_packages": ["python", "python-apt", "python-pip", "dbus"]}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"ubuntu_packages": ["python", "python-apt", "python-pip", "dbus"]}, "changed": false}
ok: [kube-exp-k8s-node-nf-3] => {"ansible_facts": {"ubuntu_packages": ["python", "python-apt", "python-pip", "dbus"]}, "changed": false}
TASK [bootstrap-os : Bootstrap | Check if bootstrap is needed] *************************************************************************
Monday 11 March 2019 18:52:03 +0000 (0:00:00.300) 0:00:08.409 **********
ok: [kube-exp-k8s-node-nf-1] => (item=python) => {"changed": false, "failed_when_result": false, "item": "python", "rc": 0, "stderr": "Shared connection to 10.0.0.6 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.6 closed."], "stdout": "python\r\n", "stdout_lines": ["python"]}
ok: [kube-exp-k8s-node-nf-2] => (item=python) => {"changed": false, "failed_when_result": false, "item": "python", "rc": 0, "stderr": "Shared connection to 10.0.0.4 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.4 closed."], "stdout": "python\r\n", "stdout_lines": ["python"]}
ok: [kube-exp-k8s-node-nf-3] => (item=python) => {"changed": false, "failed_when_result": false, "item": "python", "rc": 0, "stderr": "Shared connection to 10.0.0.14 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.14 closed."], "stdout": "python\r\n", "stdout_lines": ["python"]}
ok: [kube-exp-k8s-node-nf-1] => (item=python-apt) => {"changed": false, "failed_when_result": false, "item": "python-apt", "rc": 0, "stderr": "Shared connection to 10.0.0.6 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.6 closed."], "stdout": "python-apt\r\n", "stdout_lines": ["python-apt"]}
ok: [kube-exp-k8s-node-nf-2] => (item=python-apt) => {"changed": false, "failed_when_result": false, "item": "python-apt", "msg": "non-zero return code", "rc": 1, "stderr": "Shared connection to 10.0.0.4 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.4 closed."], "stdout": "", "stdout_lines": []}
ok: [kube-exp-k8s-node-nf-3] => (item=python-apt) => {"changed": false, "failed_when_result": false, "item": "python-apt", "msg": "non-zero return code", "rc": 1, "stderr": "Shared connection to 10.0.0.14 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.14 closed."], "stdout": "", "stdout_lines": []}
ok: [kube-exp-k8s-node-nf-1] => (item=python-pip) => {"changed": false, "failed_when_result": false, "item": "python-pip", "rc": 0, "stderr": "Shared connection to 10.0.0.6 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.6 closed."], "stdout": "python-pip\r\n", "stdout_lines": ["python-pip"]}
ok: [kube-exp-k8s-node-nf-2] => (item=python-pip) => {"changed": false, "failed_when_result": false, "item": "python-pip", "rc": 0, "stderr": "Shared connection to 10.0.0.4 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.4 closed."], "stdout": "python-pip\r\n", "stdout_lines": ["python-pip"]}
ok: [kube-exp-k8s-node-nf-3] => (item=python-pip) => {"changed": false, "failed_when_result": false, "item": "python-pip", "rc": 0, "stderr": "Shared connection to 10.0.0.14 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.14 closed."], "stdout": "python-pip\r\n", "stdout_lines": ["python-pip"]}
ok: [kube-exp-k8s-node-nf-1] => (item=dbus) => {"changed": false, "failed_when_result": false, "item": "dbus", "rc": 0, "stderr": "Shared connection to 10.0.0.6 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.6 closed."], "stdout": "dbus\r\n", "stdout_lines": ["dbus"]}
ok: [kube-exp-k8s-node-nf-2] => (item=dbus) => {"changed": false, "failed_when_result": false, "item": "dbus", "rc": 0, "stderr": "Shared connection to 10.0.0.4 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.4 closed."], "stdout": "dbus\r\n", "stdout_lines": ["dbus"]}
ok: [kube-exp-k8s-node-nf-3] => (item=dbus) => {"changed": false, "failed_when_result": false, "item": "dbus", "rc": 0, "stderr": "Shared connection to 10.0.0.14 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.14 closed."], "stdout": "dbus\r\n", "stdout_lines": ["dbus"]}
TASK [bootstrap-os : Bootstrap | Install python 2.x and pip] ***************************************************************************
Monday 11 March 2019 18:52:04 +0000 (0:00:01.107) 0:00:09.516 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "rc": 0, "stderr": "Shared connection to 10.0.0.4 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.4 closed."], "stdout": "\r0% [Working]\r \rHit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease\r\n\r0% [Working]\r0% [1 InRelease gpgv 88.7 kB] [Connecting to nova.clouds.archive.ubuntu.com]\r \r0% [Waiting for headers]\r \rHit:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease\r\n\r \r0% [Working]\r0% [2 InRelease gpgv 242 kB] [Waiting for headers]\r \rHit:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease\r\n\r \r0% [2 InRelease gpgv 242 kB]\r \rHit:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease\r\n\r0% [2 InRelease gpgv 242 kB]\r \r0% [Working]\r0% [3 InRelease gpgv 88.7 kB]\r \r0% [Working]\r0% [4 InRelease gpgv 74.6 kB]\r \r20% [Working]\r \r\rReading package lists... 0%\r\rReading package lists... 0%\r\rReading package lists... 0%\r\rReading package lists... 5%\r\rReading package lists... 5%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 55%\r\rReading package lists... 55%\r\rReading package lists... 80%\r\rReading package lists... 80%\r\rReading package lists... 81%\r\rReading package lists... 81%\r\rReading package lists... 82%\r\rReading package lists... 82%\r\rReading package lists... 85%\r\rReading package lists... 85%\r\rReading package lists... 85%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 93%\r\rReading package lists... 93%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 96%\r\rReading package lists... 96%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... Done\r\r\n\rReading package lists... 0%\r\rReading package lists... 100%\r\rReading package lists... Done\r\r\n\rBuilding dependency tree... 0%\r\rBuilding dependency tree... 0%\r\rBuilding dependency tree... 50%\r\rBuilding dependency tree... 50%\r\rBuilding dependency tree \r\r\n\rReading state information... 0%\r\rReading state information... 0%\r\rReading state information... Done\r\r\ndbus is already the newest version (1.12.2-1ubuntu1).\r\npython is already the newest version (2.7.15~rc1-1).\r\npython set to manually installed.\r\npython-pip is already the newest version (9.0.1-2.3~ubuntu1).\r\nThe following packages were automatically installed and are no longer required:\r\n grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic\r\n linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic\r\nUse 'sudo apt autoremove' to remove them.\r\nSuggested packages:\r\n python-apt-dbg python-apt-doc\r\nThe following NEW packages will be installed:\r\n python-apt\r\n0 upgraded, 1 newly installed, 0 to remove and 23 not upgraded.\r\nNeed to get 149 kB of archives.\r\nAfter this operation, 682 kB of additional disk space will be used.\r\n\r0% [Working]\r \rGet:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-apt amd64 1.6.3ubuntu1 [149 kB]\r\n\r1% [1 python-apt 2613 B/149 kB 2%]\r \r100% [Working]\r \rFetched 149 kB in 1s (246 kB/s)\r\nSelecting previously unselected package python-apt.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 155987 files and directories currently installed.)\r\nPreparing to unpack .../python-apt_1.6.3ubuntu1_amd64.deb ...\r\nUnpacking python-apt (1.6.3ubuntu1) ...\r\nSetting up python-apt (1.6.3ubuntu1) ...\r\n", "stdout_lines": ["", "0% [Working]", " ", "Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease", "", "0% [Working]", "0% [1 InRelease gpgv 88.7 kB] [Connecting to nova.clouds.archive.ubuntu.com]", " ", "0% [Waiting for headers]", " ", "Hit:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease", "", " ", "0% [Working]", "0% [2 InRelease gpgv 242 kB] [Waiting for headers]", " ", "Hit:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease", "", " ", "0% [2 InRelease gpgv 242 kB]", " ", "Hit:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease", "", "0% [2 InRelease gpgv 242 kB]", " ", "0% [Working]", "0% [3 InRelease gpgv 88.7 kB]", " ", "0% [Working]", "0% [4 InRelease gpgv 74.6 kB]", " ", "20% [Working]", " ", "", "Reading package lists... 0%", "", "Reading package lists... 0%", "", "Reading package lists... 0%", "", "Reading package lists... 5%", "", "Reading package lists... 5%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 55%", "", "Reading package lists... 55%", "", "Reading package lists... 80%", "", "Reading package lists... 80%", "", "Reading package lists... 81%", "", "Reading package lists... 81%", "", "Reading package lists... 82%", "", "Reading package lists... 82%", "", "Reading package lists... 85%", "", "Reading package lists... 85%", "", "Reading package lists... 85%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 93%", "", "Reading package lists... 93%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 96%", "", "Reading package lists... 96%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... Done", "", "", "Reading package lists... 0%", "", "Reading package lists... 100%", "", "Reading package lists... Done", "", "", "Building dependency tree... 0%", "", "Building dependency tree... 0%", "", "Building dependency tree... 50%", "", "Building dependency tree... 50%", "", "Building dependency tree ", "", "", "Reading state information... 0%", "", "Reading state information... 0%", "", "Reading state information... Done", "", "dbus is already the newest version (1.12.2-1ubuntu1).", "python is already the newest version (2.7.15~rc1-1).", "python set to manually installed.", "python-pip is already the newest version (9.0.1-2.3~ubuntu1).", "The following packages were automatically installed and are no longer required:", " grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic", " linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " python-apt-dbg python-apt-doc", "The following NEW packages will be installed:", " python-apt", "0 upgraded, 1 newly installed, 0 to remove and 23 not upgraded.", "Need to get 149 kB of archives.", "After this operation, 682 kB of additional disk space will be used.", "", "0% [Working]", " ", "Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-apt amd64 1.6.3ubuntu1 [149 kB]", "", "1% [1 python-apt 2613 B/149 kB 2%]", " ", "100% [Working]", " ", "Fetched 149 kB in 1s (246 kB/s)", "Selecting previously unselected package python-apt.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 155987 files and directories currently installed.)", "Preparing to unpack .../python-apt_1.6.3ubuntu1_amd64.deb ...", "Unpacking python-apt (1.6.3ubuntu1) ...", "Setting up python-apt (1.6.3ubuntu1) ..."]}
changed: [kube-exp-k8s-node-nf-3] => {"changed": true, "rc": 0, "stderr": "Shared connection to 10.0.0.14 closed.\r\n", "stderr_lines": ["Shared connection to 10.0.0.14 closed."], "stdout": "\r0% [Working]\r \rHit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease\r\n\r0% [Connecting to nova.clouds.archive.ubuntu.com]\r0% [1 InRelease gpgv 88.7 kB] [Connecting to nova.clouds.archive.ubuntu.com]\r \r0% [Waiting for headers]\r \rHit:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease\r\n\r \r0% [Working]\r0% [2 InRelease gpgv 242 kB] [Waiting for headers]\r \rHit:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease\r\n\r \r0% [2 InRelease gpgv 242 kB]\r \rHit:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease\r\n\r0% [2 InRelease gpgv 242 kB]\r \r0% [Working]\r0% [3 InRelease gpgv 88.7 kB]\r \r0% [Working]\r0% [4 InRelease gpgv 74.6 kB]\r \r20% [Working]\r \r\rReading package lists... 0%\r\rReading package lists... 0%\r\rReading package lists... 0%\r\rReading package lists... 5%\r\rReading package lists... 5%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 8%\r\rReading package lists... 55%\r\rReading package lists... 55%\r\rReading package lists... 80%\r\rReading package lists... 80%\r\rReading package lists... 81%\r\rReading package lists... 81%\r\rReading package lists... 82%\r\rReading package lists... 82%\r\rReading package lists... 85%\r\rReading package lists... 85%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 87%\r\rReading package lists... 88%\r\rReading package lists... 93%\r\rReading package lists... 93%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 95%\r\rReading package lists... 96%\r\rReading package lists... 96%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 98%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... 99%\r\rReading package lists... Done\r\r\n\rReading package lists... 0%\r\rReading package lists... 100%\r\rReading package lists... Done\r\r\n\rBuilding dependency tree... 0%\r\rBuilding dependency tree... 0%\r\rBuilding dependency tree... 50%\r\rBuilding dependency tree... 50%\r\rBuilding dependency tree \r\r\n\rReading state information... 0%\r\rReading state information... 0%\r\rReading state information... Done\r\r\ndbus is already the newest version (1.12.2-1ubuntu1).\r\npython is already the newest version (2.7.15~rc1-1).\r\npython set to manually installed.\r\npython-pip is already the newest version (9.0.1-2.3~ubuntu1).\r\nThe following packages were automatically installed and are no longer required:\r\n grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic\r\n linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic\r\nUse 'sudo apt autoremove' to remove them.\r\nSuggested packages:\r\n python-apt-dbg python-apt-doc\r\nThe following NEW packages will be installed:\r\n python-apt\r\n0 upgraded, 1 newly installed, 0 to remove and 23 not upgraded.\r\nNeed to get 149 kB of archives.\r\nAfter this operation, 682 kB of additional disk space will be used.\r\n\r0% [Working]\r \rGet:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-apt amd64 1.6.3ubuntu1 [149 kB]\r\n\r1% [1 python-apt 2613 B/149 kB 2%]\r \r100% [Working]\r \rFetched 149 kB in 1s (246 kB/s)\r\nSelecting previously unselected package python-apt.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 155987 files and directories currently installed.)\r\nPreparing to unpack .../python-apt_1.6.3ubuntu1_amd64.deb ...\r\nUnpacking python-apt (1.6.3ubuntu1) ...\r\nSetting up python-apt (1.6.3ubuntu1) ...\r\n", "stdout_lines": ["", "0% [Working]", " ", "Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease", "", "0% [Connecting to nova.clouds.archive.ubuntu.com]", "0% [1 InRelease gpgv 88.7 kB] [Connecting to nova.clouds.archive.ubuntu.com]", " ", "0% [Waiting for headers]", " ", "Hit:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease", "", " ", "0% [Working]", "0% [2 InRelease gpgv 242 kB] [Waiting for headers]", " ", "Hit:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease", "", " ", "0% [2 InRelease gpgv 242 kB]", " ", "Hit:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease", "", "0% [2 InRelease gpgv 242 kB]", " ", "0% [Working]", "0% [3 InRelease gpgv 88.7 kB]", " ", "0% [Working]", "0% [4 InRelease gpgv 74.6 kB]", " ", "20% [Working]", " ", "", "Reading package lists... 0%", "", "Reading package lists... 0%", "", "Reading package lists... 0%", "", "Reading package lists... 5%", "", "Reading package lists... 5%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 8%", "", "Reading package lists... 55%", "", "Reading package lists... 55%", "", "Reading package lists... 80%", "", "Reading package lists... 80%", "", "Reading package lists... 81%", "", "Reading package lists... 81%", "", "Reading package lists... 82%", "", "Reading package lists... 82%", "", "Reading package lists... 85%", "", "Reading package lists... 85%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 87%", "", "Reading package lists... 88%", "", "Reading package lists... 93%", "", "Reading package lists... 93%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 95%", "", "Reading package lists... 96%", "", "Reading package lists... 96%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 98%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... 99%", "", "Reading package lists... Done", "", "", "Reading package lists... 0%", "", "Reading package lists... 100%", "", "Reading package lists... Done", "", "", "Building dependency tree... 0%", "", "Building dependency tree... 0%", "", "Building dependency tree... 50%", "", "Building dependency tree... 50%", "", "Building dependency tree ", "", "", "Reading state information... 0%", "", "Reading state information... 0%", "", "Reading state information... Done", "", "dbus is already the newest version (1.12.2-1ubuntu1).", "python is already the newest version (2.7.15~rc1-1).", "python set to manually installed.", "python-pip is already the newest version (9.0.1-2.3~ubuntu1).", "The following packages were automatically installed and are no longer required:", " grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic", " linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " python-apt-dbg python-apt-doc", "The following NEW packages will be installed:", " python-apt", "0 upgraded, 1 newly installed, 0 to remove and 23 not upgraded.", "Need to get 149 kB of archives.", "After this operation, 682 kB of additional disk space will be used.", "", "0% [Working]", " ", "Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-apt amd64 1.6.3ubuntu1 [149 kB]", "", "1% [1 python-apt 2613 B/149 kB 2%]", " ", "100% [Working]", " ", "Fetched 149 kB in 1s (246 kB/s)", "Selecting previously unselected package python-apt.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 155987 files and directories currently installed.)", "Preparing to unpack .../python-apt_1.6.3ubuntu1_amd64.deb ...", "Unpacking python-apt (1.6.3ubuntu1) ...", "Setting up python-apt (1.6.3ubuntu1) ..."]}
TASK [bootstrap-os : set_fact] *********************************************************************************************************
Monday 11 March 2019 18:52:15 +0000 (0:00:11.195) 0:00:20.712 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python"}, "changed": false}
ok: [kube-exp-k8s-node-nf-3] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python"}, "changed": false}
TASK [bootstrap-os : include_tasks] ****************************************************************************************************
Monday 11 March 2019 18:52:15 +0000 (0:00:00.241) 0:00:20.953 **********
TASK [bootstrap-os : include_tasks] ****************************************************************************************************
Monday 11 March 2019 18:52:15 +0000 (0:00:00.158) 0:00:21.112 **********
TASK [bootstrap-os : include_tasks] ****************************************************************************************************
Monday 11 March 2019 18:52:16 +0000 (0:00:00.175) 0:00:21.288 **********
TASK [bootstrap-os : include_tasks] ****************************************************************************************************
Monday 11 March 2019 18:52:16 +0000 (0:00:00.148) 0:00:21.436 **********
TASK [bootstrap-os : include_tasks] ****************************************************************************************************
Monday 11 March 2019 18:52:16 +0000 (0:00:00.162) 0:00:21.599 **********
TASK [bootstrap-os : Remove require tty] ***********************************************************************************************
Monday 11 March 2019 18:52:16 +0000 (0:00:00.165) 0:00:21.765 **********
ok: [kube-exp-k8s-node-nf-1] => {"backup": "", "changed": false, "found": 0, "msg": ""}
ok: [kube-exp-k8s-node-nf-3] => {"backup": "", "changed": false, "found": 0, "msg": ""}
ok: [kube-exp-k8s-node-nf-2] => {"backup": "", "changed": false, "found": 0, "msg": ""}
TASK [bootstrap-os : Create remote_tmp for it is used by another module] ***************************************************************
Monday 11 March 2019 18:52:18 +0000 (0:00:02.280) 0:00:24.045 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0700", "owner": "root", "path": "/root/.ansible/tmp", "size": 4096, "state": "directory", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 0, "group": "root", "mode": "0700", "owner": "root", "path": "/root/.ansible/tmp", "size": 4096, "state": "directory", "uid": 0}
changed: [kube-exp-k8s-node-nf-3] => {"changed": true, "gid": 0, "group": "root", "mode": "0700", "owner": "root", "path": "/root/.ansible/tmp", "size": 4096, "state": "directory", "uid": 0}
TASK [bootstrap-os : Gather nodes hostnames] *******************************************************************************************
Monday 11 March 2019 18:52:20 +0000 (0:00:01.915) 0:00:25.960 **********
ok: [kube-exp-k8s-node-nf-1]
ok: [kube-exp-k8s-node-nf-2]
ok: [kube-exp-k8s-node-nf-3]
TASK [bootstrap-os : Assign inventory name to unconfigured hostnames (non-CoreOS and Tumbleweed)] **************************************
Monday 11 March 2019 18:52:23 +0000 (0:00:02.569) 0:00:28.530 **********
ok: [kube-exp-k8s-node-nf-3] => {"ansible_facts": {"ansible_domain": "openstacklocal", "ansible_fqdn": "host-10-0-0-14.openstacklocal", "ansible_hostname": "kube-exp-k8s-node-nf-3", "ansible_nodename": "kube-exp-k8s-node-nf-3"}, "changed": false, "name": "kube-exp-k8s-node-nf-3"}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"ansible_domain": "openstacklocal", "ansible_fqdn": "host-10-0-0-4.openstacklocal", "ansible_hostname": "kube-exp-k8s-node-nf-2", "ansible_nodename": "kube-exp-k8s-node-nf-2"}, "changed": false, "name": "kube-exp-k8s-node-nf-2"}
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"ansible_domain": "cluster.local", "ansible_fqdn": "kube-exp-k8s-node-nf-1.cluster.local", "ansible_hostname": "kube-exp-k8s-node-nf-1", "ansible_nodename": "kube-exp-k8s-node-nf-1"}, "changed": false, "name": "kube-exp-k8s-node-nf-1"}
TASK [bootstrap-os : Assign inventory name to unconfigured hostnames (CoreOS and Tumbleweed only)] *************************************
Monday 11 March 2019 18:52:26 +0000 (0:00:02.678) 0:00:31.208 **********
TASK [bootstrap-os : Update hostname fact (CoreOS and Tumbleweed only)] ****************************************************************
Monday 11 March 2019 18:52:26 +0000 (0:00:00.189) 0:00:31.398 **********
 [WARNING]: Could not match supplied host pattern, ignoring: calico-rr

PLAY [k8s-cluster:etcd:calico-rr] ******************************************************************************************************
PLAY [etcd] ****************************************************************************************************************************
TASK [download : include_tasks] ********************************************************************************************************
Monday 11 March 2019 18:52:26 +0000 (0:00:00.235) 0:00:31.634 **********
TASK [download : Download items] *******************************************************************************************************
Monday 11 March 2019 18:52:26 +0000 (0:00:00.095) 0:00:31.729 **********
TASK [download : Sync container] *******************************************************************************************************
Monday 11 March 2019 18:52:27 +0000 (0:00:00.814) 0:00:32.544 **********
TASK [kubespray-defaults : Configure defaults] *****************************************************************************************
Monday 11 March 2019 18:52:28 +0000 (0:00:00.757) 0:00:33.301 **********
ok: [kube-exp-k8s-master-1] => {
 "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
TASK [adduser : User | Create User Group] **********************************************************************************************
Monday 11 March 2019 18:52:28 +0000 (0:00:00.147) 0:00:33.449 **********
ok: [kube-exp-k8s-master-1] => {"changed": false, "gid": 998, "name": "etcd", "state": "present", "system": true}
TASK [adduser : User | Create User] ****************************************************************************************************
Monday 11 March 2019 18:52:28 +0000 (0:00:00.683) 0:00:34.133 **********
ok: [kube-exp-k8s-master-1] => {"append": false, "changed": false, "comment": "Etcd user", "group": 998, "home": "/var/lib/etcd", "move_home": false, "name": "etcd", "shell": "/bin/nologin", "state": "present", "uid": 998}
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:29 +0000 (0:00:00.732) 0:00:34.866 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/check_certs.yml for kube-exp-k8s-master-1
TASK [etcd : Check_certs | check if all certs have already been generated on first master] *********************************************
Monday 11 March 2019 18:52:29 +0000 (0:00:00.191) 0:00:35.058 **********
ok: [kube-exp-k8s-master-1 -> None] => {"changed": false, "examined": 14, "files": [{"atime": 1552267336.682097, "checksum": "a05d412fcc4abc60a6c5bd6acfae19a91ba990b4", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 262099, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552261995.1492913, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-3-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1675, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "8dca8ff66af44a8c8e47944d60ebf6016bcb2457", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051791, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.1281831, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-1.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "17a458c528b755673002e6281cf48bb87fa171f0", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051789, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.116183, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-1-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1679, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "e9e8f5cf66de4efe979882dcd46889136b5d0d95", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 262101, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552261995.1612911, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-3.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "825df5bb397229af9c8d0c2f544e68f4f705f535", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051786, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.0321817, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-master-1-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1675, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267209.8738856, "checksum": "bc7d8ca4ac0a7c2bc891d89601adfcc59f9d7aa2", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051778, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085290.7081766, "nlink": 1, "path": "/etc/ssl/etcd/ssl/ca.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1094, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "90d3c4f4f1de5a554002a135efd78786e2585aec", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 288934, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552089490.9037845, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-2-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1679, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "5298cfeb2b91a9886fe283660b7fd3fb21a89aef", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 288936, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552089490.9157844, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-2.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267210.781887, "checksum": "cef1b1c60308194126bb3b7f04c9883f57a6ad51", "ctime": 1552267208.6818836, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051788, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.0401819, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-master-1.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 9, "msg": ""}
TASK [etcd : Check_certs | Set default value for 'sync_certs', 'gen_certs' and 'etcd_secret_changed' to false] *************************
Monday 11 March 2019 18:52:30 +0000 (0:00:00.715) 0:00:35.774 **********
ok: [kube-exp-k8s-master-1] => {"ansible_facts": {"etcd_secret_changed": false, "gen_certs": false, "sync_certs": false}, "changed": false}
TASK [etcd : Check certs | check if a cert already exists on node] *********************************************************************
Monday 11 March 2019 18:52:30 +0000 (0:00:00.143) 0:00:35.917 **********
ok: [kube-exp-k8s-master-1] => (item=ca.pem) => {"changed": false, "item": "ca.pem", "stat": {"atime": 1552267209.8738856, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "bc7d8ca4ac0a7c2bc891d89601adfcc59f9d7aa2", "ctime": 1552267208.6818836, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1051778, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0640", "mtime": 1552085290.7081766, "nlink": 1, "path": "/etc/ssl/etcd/ssl/ca.pem", "pw_name": "kube", "readable": true, "rgrp": true, "roth": false, "rusr": true, "size": 1094, "uid": 999, "version": "1481223699", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
ok: [kube-exp-k8s-master-1] => (item=node-kube-exp-k8s-master-1-key.pem) => {"changed": false, "item": "node-kube-exp-k8s-master-1-key.pem", "stat": {"atime": 1552267336.682097, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "825df5bb397229af9c8d0c2f544e68f4f705f535", "ctime": 1552267208.6818836, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1051786, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0640", "mtime": 1552085291.0321817, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-master-1-key.pem", "pw_name": "kube", "readable": true, "rgrp": true, "roth": false, "rusr": true, "size": 1675, "uid": 999, "version": "1085475531", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
TASK [etcd : Check_certs | Set 'gen_certs' to true] ************************************************************************************
Monday 11 March 2019 18:52:31 +0000 (0:00:01.046) 0:00:36.963 **********
TASK [etcd : Check_certs | Set 'gen_node_certs' to true] *******************************************************************************
Monday 11 March 2019 18:52:31 +0000 (0:00:00.199) 0:00:37.163 **********
ok: [kube-exp-k8s-master-1] => {"ansible_facts": {"gen_node_certs": {"kube-exp-k8s-master-1": false, "kube-exp-k8s-node-nf-1": false, "kube-exp-k8s-node-nf-2": false, "kube-exp-k8s-node-nf-3": false}}, "changed": false}
TASK [etcd : Check_certs | Set 'sync_certs' to true] ***********************************************************************************
Monday 11 March 2019 18:52:32 +0000 (0:00:00.215) 0:00:37.378 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:32 +0000 (0:00:00.124) 0:00:37.502 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/gen_certs_script.yml for kube-exp-k8s-master-1
TASK [etcd : Gen_certs | create etcd cert dir] *****************************************************************************************
Monday 11 March 2019 18:52:32 +0000 (0:00:00.202) 0:00:37.704 **********
changed: [kube-exp-k8s-master-1] => {"changed": true, "gid": 0, "group": "root", "mode": "0700", "owner": "kube", "path": "/etc/ssl/etcd/ssl", "size": 4096, "state": "directory", "uid": 999}
TASK [etcd : Gen_certs | create etcd script dir (on kube-exp-k8s-master-1)] ************************************************************
Monday 11 March 2019 18:52:33 +0000 (0:00:00.621) 0:00:38.326 **********
ok: [kube-exp-k8s-master-1 -> None] => {"changed": false, "gid": 0, "group": "root", "mode": "0700", "owner": "root", "path": "/usr/local/bin/etcd-scripts", "size": 4096, "state": "directory", "uid": 0}
TASK [etcd : Gen_certs | create etcd cert dir (on kube-exp-k8s-master-1)] **************************************************************
Monday 11 March 2019 18:52:33 +0000 (0:00:00.570) 0:00:38.897 **********
ok: [kube-exp-k8s-master-1 -> None] => {"changed": false, "gid": 0, "group": "root", "mode": "0700", "owner": "kube", "path": "/etc/ssl/etcd/ssl", "size": 4096, "state": "directory", "uid": 999}
TASK [etcd : Gen_certs | write openssl config] *****************************************************************************************
Monday 11 March 2019 18:52:34 +0000 (0:00:00.541) 0:00:39.438 **********
TASK [etcd : Gen_certs | copy certs generation script] *********************************************************************************
Monday 11 March 2019 18:52:34 +0000 (0:00:00.162) 0:00:39.601 **********
TASK [etcd : Gen_certs | run cert generation script] ***********************************************************************************
Monday 11 March 2019 18:52:34 +0000 (0:00:00.142) 0:00:39.744 **********
TASK [etcd : Gen_certs | Gather etcd master certs] *************************************************************************************
Monday 11 March 2019 18:52:34 +0000 (0:00:00.162) 0:00:39.907 **********
TASK [etcd : Gen_certs | Write etcd master certs] **************************************************************************************
Monday 11 March 2019 18:52:35 +0000 (0:00:00.328) 0:00:40.236 **********
TASK [etcd : set_fact] *****************************************************************************************************************
Monday 11 March 2019 18:52:35 +0000 (0:00:00.384) 0:00:40.620 **********
ok: [kube-exp-k8s-master-1] => {"ansible_facts": {"my_etcd_node_certs": ["ca.pem", "node-kube-exp-k8s-master-1.pem", "node-kube-exp-k8s-master-1-key.pem"]}, "changed": false}
TASK [etcd : Check_certs | Set 'sync_certs' to true on nodes] **************************************************************************
Monday 11 March 2019 18:52:35 +0000 (0:00:00.194) 0:00:40.814 **********
TASK [etcd : Gen_certs | Gather node certs] ********************************************************************************************
Monday 11 March 2019 18:52:35 +0000 (0:00:00.211) 0:00:41.025 **********
TASK [etcd : Gen_certs | Copy certs on nodes] ******************************************************************************************
Monday 11 March 2019 18:52:35 +0000 (0:00:00.116) 0:00:41.142 **********
TASK [etcd : Gen_certs | check certificate permissions] ********************************************************************************
Monday 11 March 2019 18:52:36 +0000 (0:00:00.109) 0:00:41.252 **********
changed: [kube-exp-k8s-master-1] => {"changed": true, "gid": 0, "group": "root", "mode": "0640", "owner": "kube", "path": "/etc/ssl/etcd/ssl", "size": 4096, "state": "directory", "uid": 999}
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:36 +0000 (0:00:00.536) 0:00:41.788 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/upd_ca_trust.yml for kube-exp-k8s-master-1
TASK [etcd : Gen_certs | target ca-certificate store file] *****************************************************************************
Monday 11 March 2019 18:52:36 +0000 (0:00:00.185) 0:00:41.973 **********
ok: [kube-exp-k8s-master-1] => {"ansible_facts": {"ca_cert_path": "/usr/local/share/ca-certificates/etcd-ca.crt"}, "changed": false}
TASK [etcd : Gen_certs | add CA to trusted CA dir] *************************************************************************************
Monday 11 March 2019 18:52:36 +0000 (0:00:00.212) 0:00:42.186 **********
ok: [kube-exp-k8s-master-1] => {"changed": false, "checksum": "bc7d8ca4ac0a7c2bc891d89601adfcc59f9d7aa2", "dest": "/usr/local/share/ca-certificates/etcd-ca.crt", "gid": 0, "group": "root", "md5sum": "cae985594200f5cb749dd2dcb934ac92", "mode": "0644", "owner": "root", "size": 1094, "src": "/etc/ssl/etcd/ssl/ca.pem", "state": "file", "uid": 0}
TASK [etcd : Gen_certs | update ca-certificates (Debian/Ubuntu/SUSE/Container Linux by CoreOS)] ****************************************
Monday 11 March 2019 18:52:37 +0000 (0:00:00.929) 0:00:43.116 **********
TASK [etcd : Gen_certs | update ca-certificates (RedHat)] ******************************************************************************
Monday 11 March 2019 18:52:38 +0000 (0:00:00.103) 0:00:43.219 **********
TASK [etcd : Gen_certs | Get etcd certificate serials] *********************************************************************************
Monday 11 March 2019 18:52:38 +0000 (0:00:00.102) 0:00:43.322 **********
ok: [kube-exp-k8s-master-1] => {"changed": false, "cmd": ["openssl", "x509", "-in", "/etc/ssl/etcd/ssl/node-kube-exp-k8s-master-1.pem", "-noout", "-serial"], "delta": "0:00:00.009811", "end": "2019-03-11 18:52:38.690806", "rc": 0, "start": "2019-03-11 18:52:38.680995", "stderr": "", "stderr_lines": [], "stdout": "serial=821A7D37763BBD01", "stdout_lines": ["serial=821A7D37763BBD01"]}
TASK [etcd : Set etcd_client_cert_serial] **********************************************************************************************
Monday 11 March 2019 18:52:38 +0000 (0:00:00.649) 0:00:43.971 **********
ok: [kube-exp-k8s-master-1] => {"ansible_facts": {"etcd_client_cert_serial": "821A7D37763BBD01"}, "changed": false}
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:38 +0000 (0:00:00.174) 0:00:44.146 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/install_docker.yml for kube-exp-k8s-master-1
TASK [etcd : Install | Copy etcdctl binary from docker container] **********************************************************************
Monday 11 March 2019 18:52:39 +0000 (0:00:00.175) 0:00:44.322 **********
TASK [etcd : Install etcd launch script] ***********************************************************************************************
Monday 11 March 2019 18:52:39 +0000 (0:00:00.085) 0:00:44.407 **********
TASK [etcd : Install etcd-events launch script] ****************************************************************************************
Monday 11 March 2019 18:52:39 +0000 (0:00:00.090) 0:00:44.498 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:39 +0000 (0:00:00.099) 0:00:44.597 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/configure.yml for kube-exp-k8s-master-1
TASK [etcd : Configure | Check if etcd cluster is healthy] *****************************************************************************
Monday 11 March 2019 18:52:39 +0000 (0:00:00.200) 0:00:44.798 **********
TASK [etcd : Configure | Check if etcd-events cluster is healthy] **********************************************************************
Monday 11 March 2019 18:52:39 +0000 (0:00:00.146) 0:00:44.944 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:39 +0000 (0:00:00.120) 0:00:45.065 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/refresh_config.yml for kube-exp-k8s-master-1
TASK [etcd : Refresh config | Create etcd config file] *********************************************************************************
Monday 11 March 2019 18:52:40 +0000 (0:00:00.164) 0:00:45.229 **********
TASK [etcd : Refresh config | Create etcd-events config file] **************************************************************************
Monday 11 March 2019 18:52:40 +0000 (0:00:00.105) 0:00:45.335 **********
TASK [etcd : Configure | Copy etcd.service systemd file] *******************************************************************************
Monday 11 March 2019 18:52:40 +0000 (0:00:00.100) 0:00:45.435 **********
TASK [etcd : Configure | Copy etcd-events.service systemd file] ************************************************************************
Monday 11 March 2019 18:52:40 +0000 (0:00:00.110) 0:00:45.545 **********
TASK [etcd : Configure | reload systemd] ***********************************************************************************************
Monday 11 March 2019 18:52:40 +0000 (0:00:00.108) 0:00:45.654 **********
changed: [kube-exp-k8s-master-1] => {"changed": true, "cmd": ["systemctl", "daemon-reload"], "delta": "0:00:00.196976", "end": "2019-03-11 18:52:41.028203", "rc": 0, "start": "2019-03-11 18:52:40.831227", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
TASK [etcd : Configure | Ensure etcd is running] ***************************************************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.680) 0:00:46.334 **********
TASK [etcd : Configure | Ensure etcd-events is running] ********************************************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.112) 0:00:46.447 **********
TASK [etcd : Configure | Check if etcd cluster is healthy] *****************************************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.108) 0:00:46.555 **********
TASK [etcd : Configure | Check if etcd-events cluster is healthy] **********************************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.108) 0:00:46.663 **********
TASK [etcd : Configure | Check if member is in etcd cluster] ***************************************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.106) 0:00:46.770 **********
TASK [etcd : Configure | Check if member is in etcd-events cluster] ********************************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.108) 0:00:46.878 **********
TASK [etcd : Configure | Join member(s) to etcd cluster one at a time] *****************************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.107) 0:00:46.985 **********
TASK [etcd : Configure | Join member(s) to etcd-events cluster one at a time] **********************************************************
Monday 11 March 2019 18:52:41 +0000 (0:00:00.114) 0:00:47.100 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.119) 0:00:47.219 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/refresh_config.yml for kube-exp-k8s-master-1
TASK [etcd : Refresh config | Create etcd config file] *********************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.172) 0:00:47.392 **********
TASK [etcd : Refresh config | Create etcd-events config file] **************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.107) 0:00:47.500 **********
TASK [etcd : Restart etcd if certs changed] ********************************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.106) 0:00:47.606 **********
TASK [etcd : Restart etcd-events if certs changed] *************************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.107) 0:00:47.714 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.102) 0:00:47.817 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/refresh_config.yml for kube-exp-k8s-master-1
TASK [etcd : Refresh config | Create etcd config file] *********************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.172) 0:00:47.989 **********
TASK [etcd : Refresh config | Create etcd-events config file] **************************************************************************
Monday 11 March 2019 18:52:42 +0000 (0:00:00.098) 0:00:48.088 **********
PLAY [kube-node] ***********************************************************************************************************************
TASK [download : include_tasks] ********************************************************************************************************
Monday 11 March 2019 18:52:43 +0000 (0:00:00.240) 0:00:48.328 **********
TASK [download : Download items] *******************************************************************************************************
Monday 11 March 2019 18:52:43 +0000 (0:00:00.171) 0:00:48.500 **********
TASK [download : Sync container] *******************************************************************************************************
Monday 11 March 2019 18:52:44 +0000 (0:00:00.813) 0:00:49.314 **********
TASK [kubespray-defaults : Configure defaults] *****************************************************************************************
Monday 11 March 2019 18:52:44 +0000 (0:00:00.860) 0:00:50.174 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
TASK [adduser : User | Create User Group] **********************************************************************************************
Monday 11 March 2019 18:52:45 +0000 (0:00:00.285) 0:00:50.459 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 999, "name": "kube-cert", "state": "present", "system": true}
changed: [kube-exp-k8s-node-nf-3] => {"changed": true, "gid": 999, "name": "kube-cert", "state": "present", "system": true}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 999, "name": "kube-cert", "state": "present", "system": true}
TASK [adduser : User | Create User] ****************************************************************************************************
Monday 11 March 2019 18:52:46 +0000 (0:00:01.371) 0:00:51.831 **********
ok: [kube-exp-k8s-node-nf-1] => {"append": false, "changed": false, "comment": "Kubernetes user", "group": 999, "home": "/home/kube", "move_home": false, "name": "kube", "shell": "/sbin/nologin", "state": "present", "uid": 999}
changed: [kube-exp-k8s-node-nf-3] => {"changed": true, "comment": "Kubernetes user", "create_home": false, "group": 999, "home": "/home/kube", "name": "kube", "shell": "/sbin/nologin", "state": "present", "system": true, "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "comment": "Kubernetes user", "create_home": false, "group": 999, "home": "/home/kube", "name": "kube", "shell": "/sbin/nologin", "state": "present", "system": true, "uid": 999}
TASK [kubernetes/preinstall : Remove swapfile from /etc/fstab] *************************************************************************
Monday 11 March 2019 18:52:50 +0000 (0:00:03.404) 0:00:55.235 **********
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "dump": "0", "fstab": "/etc/fstab", "fstype": "swap", "name": "swap", "opts": "defaults", "passno": "0"}
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "dump": "0", "fstab": "/etc/fstab", "fstype": "swap", "name": "swap", "opts": "defaults", "passno": "0"}
ok: [kube-exp-k8s-node-nf-3] => {"changed": false, "dump": "0", "fstab": "/etc/fstab", "fstype": "swap", "name": "swap", "opts": "defaults", "passno": "0"}
TASK [kubernetes/preinstall : Disable swap] ********************************************************************************************
Monday 11 March 2019 18:52:50 +0000 (0:00:00.897) 0:00:56.133 **********
TASK [kubernetes/preinstall : Stop if ansible version is too low] **********************************************************************
Monday 11 March 2019 18:52:51 +0000 (0:00:00.190) 0:00:56.323 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if either kube-master, kube-node or etcd is empty] **************************************************
Monday 11 March 2019 18:52:51 +0000 (0:00:00.194) 0:00:56.518 **********
ok: [kube-exp-k8s-node-nf-1] => (item=kube-master) => {
 "changed": false, 
 "item": "kube-master", 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-1] => (item=kube-node) => {
 "changed": false, 
 "item": "kube-node", 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-1] => (item=etcd) => {
 "changed": false, 
 "item": "etcd", 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if non systemd OS type] *****************************************************************************
Monday 11 March 2019 18:52:51 +0000 (0:00:00.299) 0:00:56.818 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if unknown OS] **************************************************************************************
Monday 11 March 2019 18:52:51 +0000 (0:00:00.310) 0:00:57.129 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if unknown network plugin] **************************************************************************
Monday 11 March 2019 18:52:52 +0000 (0:00:00.297) 0:00:57.426 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if incompatible network plugin and cloudprovider] ***************************************************
Monday 11 March 2019 18:52:52 +0000 (0:00:00.289) 0:00:57.716 **********
TASK [kubernetes/preinstall : Stop if known booleans are set as strings (Use JSON format on CLI: -e "{'key': true }")] *****************
Monday 11 March 2019 18:52:52 +0000 (0:00:00.165) 0:00:57.881 **********
ok: [kube-exp-k8s-node-nf-1] => (item={u'name': u'kubeadm_enabled', u'value': True}) => {
 "changed": false, 
 "item": {
 "name": "kubeadm_enabled", 
 "value": true
 }, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-1] => (item={u'name': u'download_run_once', u'value': False}) => {
 "changed": false, 
 "item": {
 "name": "download_run_once", 
 "value": false
 }, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-1] => (item={u'name': u'deploy_netchecker', u'value': False}) => {
 "changed": false, 
 "item": {
 "name": "deploy_netchecker", 
 "value": false
 }, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-1] => (item={u'name': u'download_always_pull', u'value': False}) => {
 "changed": false, 
 "item": {
 "name": "download_always_pull", 
 "value": false
 }, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-1] => (item={u'name': u'helm_enabled', u'value': True}) => {
 "changed": false, 
 "item": {
 "name": "helm_enabled", 
 "value": true
 }, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-1] => (item={u'name': u'openstack_lbaas_enabled', u'value': False}) => {
 "changed": false, 
 "item": {
 "name": "openstack_lbaas_enabled", 
 "value": false
 }, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if even number of etcd hosts] ***********************************************************************
Monday 11 March 2019 18:52:53 +0000 (0:00:00.412) 0:00:58.294 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if memory is too small for masters] *****************************************************************
Monday 11 March 2019 18:52:53 +0000 (0:00:00.367) 0:00:58.662 **********
TASK [kubernetes/preinstall : Stop if memory is too small for nodes] *******************************************************************
Monday 11 March 2019 18:52:53 +0000 (0:00:00.230) 0:00:58.893 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Guarantee that enough network address space is available for all pods] ***********************************
Monday 11 March 2019 18:52:54 +0000 (0:00:00.328) 0:00:59.221 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-3] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if ip var does not match local ips] *****************************************************************
Monday 11 March 2019 18:52:54 +0000 (0:00:00.351) 0:00:59.572 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
fatal: [kube-exp-k8s-node-nf-3]: FAILED! => {
 "assertion": "ip in ansible_all_ipv4_addresses", 
 "changed": false, 
 "evaluated_to": false, 
 "msg": "Assertion failed"
}
TASK [kubernetes/preinstall : Stop if access_ip is not pingable] ***********************************************************************
Monday 11 March 2019 18:52:54 +0000 (0:00:00.335) 0:00:59.908 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "cmd": ["ping", "-c1", "10.0.0.6"], "delta": "0:00:00.009275", "end": "2019-03-11 18:52:55.246152", "rc": 0, "start": "2019-03-11 18:52:55.236877", "stderr": "", "stderr_lines": [], "stdout": "PING 10.0.0.6 (10.0.0.6) 56(84) bytes of data.\n64 bytes from 10.0.0.6: icmp_seq=1 ttl=64 time=0.090 ms\n\n--- 10.0.0.6 ping statistics ---\n1 packets transmitted, 1 received, 0% packet loss, time 0ms\nrtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms", "stdout_lines": ["PING 10.0.0.6 (10.0.0.6) 56(84) bytes of data.", "64 bytes from 10.0.0.6: icmp_seq=1 ttl=64 time=0.090 ms", "", "--- 10.0.0.6 ping statistics ---", "1 packets transmitted, 1 received, 0% packet loss, time 0ms", "rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms"]}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["ping", "-c1", "10.0.0.4"], "delta": "0:00:00.019384", "end": "2019-03-11 18:52:55.317890", "rc": 0, "start": "2019-03-11 18:52:55.298506", "stderr": "", "stderr_lines": [], "stdout": "PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data.\n64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.028 ms\n\n--- 10.0.0.4 ping statistics ---\n1 packets transmitted, 1 received, 0% packet loss, time 0ms\nrtt min/avg/max/mdev = 0.028/0.028/0.028/0.000 ms", "stdout_lines": ["PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data.", "64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.028 ms", "", "--- 10.0.0.4 ping statistics ---", "1 packets transmitted, 1 received, 0% packet loss, time 0ms", "rtt min/avg/max/mdev = 0.028/0.028/0.028/0.000 ms"]}
TASK [kubernetes/preinstall : Stop if RBAC is not enabled when dashboard is enabled] ***************************************************
Monday 11 March 2019 18:52:55 +0000 (0:00:00.792) 0:01:00.701 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if RBAC is not enabled when OCI cloud controller is enabled] ****************************************
Monday 11 March 2019 18:52:55 +0000 (0:00:00.322) 0:01:01.023 **********
TASK [kubernetes/preinstall : Stop if RBAC and anonymous-auth are not enabled when insecure port is disabled] **************************
Monday 11 March 2019 18:52:55 +0000 (0:00:00.147) 0:01:01.170 **********
TASK [kubernetes/preinstall : Stop if kernel version is too low] ***********************************************************************
Monday 11 March 2019 18:52:56 +0000 (0:00:00.139) 0:01:01.310 **********
TASK [kubernetes/preinstall : Stop if bad hostname] ************************************************************************************
Monday 11 March 2019 18:52:56 +0000 (0:00:00.143) 0:01:01.453 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : check cloud_provider value] ******************************************************************************
Monday 11 March 2019 18:52:56 +0000 (0:00:00.305) 0:01:01.759 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
ok: [kube-exp-k8s-node-nf-2] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Get current version of calico cluster version] ***********************************************************
Monday 11 March 2019 18:52:56 +0000 (0:00:00.261) 0:01:02.021 **********
changed: [kube-exp-k8s-node-nf-1 -> None] => {"changed": true, "cmd": "/usr/local/bin/calicoctl version | grep 'Cluster Version:' | awk '{ print $3}'", "delta": "0:00:00.008384", "end": "2019-03-11 18:52:57.261637", "rc": 0, "start": "2019-03-11 18:52:57.253253", "stderr": "/bin/sh: 1: /usr/local/bin/calicoctl: not found", "stderr_lines": ["/bin/sh: 1: /usr/local/bin/calicoctl: not found"], "stdout": "", "stdout_lines": []}
TASK [kubernetes/preinstall : Check that calico version is enough for upgrade] *********************************************************
Monday 11 March 2019 18:52:57 +0000 (0:00:00.565) 0:01:02.587 **********
TASK [kubernetes/preinstall : Check that kube_service_addresses is a network range] ****************************************************
Monday 11 March 2019 18:52:57 +0000 (0:00:00.139) 0:01:02.727 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Check that kube_pods_subnet is a network range] **********************************************************
Monday 11 March 2019 18:52:57 +0000 (0:00:00.208) 0:01:02.935 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Check that kube_pods_subnet does not collide with kube_service_addresses] ********************************
Monday 11 March 2019 18:52:57 +0000 (0:00:00.209) 0:01:03.145 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if unknown dns mode] ********************************************************************************
Monday 11 March 2019 18:52:58 +0000 (0:00:00.195) 0:01:03.340 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if unknown kube proxy mode] *************************************************************************
Monday 11 March 2019 18:52:58 +0000 (0:00:00.198) 0:01:03.539 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if vault is chose] **********************************************************************************
Monday 11 March 2019 18:52:58 +0000 (0:00:00.216) 0:01:03.755 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if unknown cert_management] *************************************************************************
Monday 11 March 2019 18:52:58 +0000 (0:00:00.210) 0:01:03.966 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Stop if unknown resolvconf_mode] *************************************************************************
Monday 11 March 2019 18:52:58 +0000 (0:00:00.205) 0:01:04.171 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "changed": false, 
 "msg": "All assertions passed"
}
TASK [kubernetes/preinstall : Pre-upgrade | check if old credential dir exists] ********************************************************
Monday 11 March 2019 18:52:59 +0000 (0:00:00.208) 0:01:04.380 **********
ok: [kube-exp-k8s-node-nf-1 -> localhost] => {"changed": false, "stat": {"exists": false}}
TASK [kubernetes/preinstall : Pre-upgrade | check if new credential dir exists] ********************************************************
Monday 11 March 2019 18:52:59 +0000 (0:00:00.271) 0:01:04.652 **********
TASK [kubernetes/preinstall : Pre-upgrade | move data from old credential dir to new] **************************************************
Monday 11 March 2019 18:52:59 +0000 (0:00:00.149) 0:01:04.801 **********
TASK [kubernetes/preinstall : set_fact] ************************************************************************************************
Monday 11 March 2019 18:52:59 +0000 (0:00:00.103) 0:01:04.905 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"architecture_groups": {"aarch64": "arm64", "x86_64": "amd64"}}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"architecture_groups": {"aarch64": "arm64", "x86_64": "amd64"}}, "changed": false}
TASK [kubernetes/preinstall : ansible_architecture_rename] *****************************************************************************
Monday 11 March 2019 18:52:59 +0000 (0:00:00.243) 0:01:05.149 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"host_architecture": "amd64"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"host_architecture": "amd64"}, "changed": false}
TASK [kubernetes/preinstall : Force binaries directory for Container Linux by CoreOS] **************************************************
Monday 11 March 2019 18:53:00 +0000 (0:00:00.226) 0:01:05.375 **********
TASK [kubernetes/preinstall : check if atomic host] ************************************************************************************
Monday 11 March 2019 18:53:00 +0000 (0:00:00.146) 0:01:05.522 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"exists": false}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"exists": false}}
TASK [kubernetes/preinstall : set_fact] ************************************************************************************************
Monday 11 March 2019 18:53:01 +0000 (0:00:00.701) 0:01:06.223 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"is_atomic": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"is_atomic": false}, "changed": false}
TASK [kubernetes/preinstall : set_fact] ************************************************************************************************
Monday 11 March 2019 18:53:01 +0000 (0:00:00.266) 0:01:06.490 **********
TASK [kubernetes/preinstall : check resolvconf] ****************************************************************************************
Monday 11 March 2019 18:53:01 +0000 (0:00:00.162) 0:01:06.653 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": "which resolvconf", "delta": "0:00:00.005184", "end": "2019-03-11 18:53:01.906025", "failed_when_result": false, "msg": "non-zero return code", "rc": 1, "start": "2019-03-11 18:53:01.900841", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": "which resolvconf", "delta": "0:00:00.005351", "end": "2019-03-11 18:53:01.975378", "failed_when_result": false, "msg": "non-zero return code", "rc": 1, "start": "2019-03-11 18:53:01.970027", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
TASK [kubernetes/preinstall : set_fact] ************************************************************************************************
Monday 11 March 2019 18:53:02 +0000 (0:00:00.673) 0:01:07.327 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"resolvconf": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"resolvconf": false}, "changed": false}
TASK [kubernetes/preinstall : set_fact] ************************************************************************************************
Monday 11 March 2019 18:53:02 +0000 (0:00:00.266) 0:01:07.593 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"bogus_domains": "cluster.local.default.svc.cluster.local./default.svc.cluster.local.default.svc.cluster.local./com.default.svc.cluster.local./cluster.local.svc.cluster.local./svc.cluster.local.svc.cluster.local./com.svc.cluster.local./", "cloud_resolver": []}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"bogus_domains": "cluster.local.default.svc.cluster.local./default.svc.cluster.local.default.svc.cluster.local./com.default.svc.cluster.local./cluster.local.svc.cluster.local./svc.cluster.local.svc.cluster.local./com.svc.cluster.local./", "cloud_resolver": []}, "changed": false}
TASK [kubernetes/preinstall : check if kubelet is configured] **************************************************************************
Monday 11 March 2019 18:53:02 +0000 (0:00:00.271) 0:01:07.865 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"atime": 1552262021.0944629, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "ddebca211f87999ae4bca1faa4fec6bdde14aa9c", "ctime": 1552085447.4354668, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1554110, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1552085446.3274667, "nlink": 1, "path": "/etc/kubernetes/kubelet.env", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 1822, "uid": 0, "version": "567052028", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"exists": false}}
TASK [kubernetes/preinstall : check if early DNS configuration stage] ******************************************************************
Monday 11 March 2019 18:53:03 +0000 (0:00:00.720) 0:01:08.586 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"dns_early": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"dns_early": true}, "changed": false}
TASK [kubernetes/preinstall : target resolv.conf files] ********************************************************************************
Monday 11 March 2019 18:53:03 +0000 (0:00:00.261) 0:01:08.848 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"base": "", "head": "", "resolvconffile": "/etc/resolv.conf"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"base": "", "head": "", "resolvconffile": "/etc/resolv.conf"}, "changed": false}
TASK [kubernetes/preinstall : target temporary resolvconf cloud init file (Container Linux by CoreOS)] *********************************
Monday 11 March 2019 18:53:03 +0000 (0:00:00.258) 0:01:09.107 **********
TASK [kubernetes/preinstall : check if /etc/dhclient.conf exists] **********************************************************************
Monday 11 March 2019 18:53:04 +0000 (0:00:00.171) 0:01:09.279 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"exists": false}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"exists": false}}
TASK [kubernetes/preinstall : target dhclient conf file for /etc/dhclient.conf] ********************************************************
Monday 11 March 2019 18:53:04 +0000 (0:00:00.658) 0:01:09.937 **********
TASK [kubernetes/preinstall : check if /etc/dhcp/dhclient.conf exists] *****************************************************************
Monday 11 March 2019 18:53:04 +0000 (0:00:00.135) 0:01:10.073 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"atime": 1552262023.1704621, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "c5cce63ffbcf0100b361519ffc5529116566d4ec", "ctime": 1552089576.424981, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1554187, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1552089576.424981, "nlink": 1, "path": "/etc/dhcp/dhclient.conf", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 1954, "uid": 0, "version": "1488380962", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"atime": 1552329478.212, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "4ada2f1b00772234a6e7403712622489634510f2", "ctime": 1524719688.1036575, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 792, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1507812486.0, "nlink": 1, "path": "/etc/dhcp/dhclient.conf", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 1735, "uid": 0, "version": "3288704217", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
TASK [kubernetes/preinstall : target dhclient conf file for /etc/dhcp/dhclient.conf] ***************************************************
Monday 11 March 2019 18:53:05 +0000 (0:00:00.778) 0:01:10.852 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"dhclientconffile": "/etc/dhcp/dhclient.conf"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"dhclientconffile": "/etc/dhcp/dhclient.conf"}, "changed": false}
TASK [kubernetes/preinstall : target dhclient hook file for Red Hat family] ************************************************************
Monday 11 March 2019 18:53:05 +0000 (0:00:00.265) 0:01:11.117 **********
TASK [kubernetes/preinstall : target dhclient hook file for Debian family] *************************************************************
Monday 11 March 2019 18:53:06 +0000 (0:00:00.191) 0:01:11.308 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"dhclienthookfile": "/etc/dhcp/dhclient-exit-hooks.d/zdnsupdate"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"dhclienthookfile": "/etc/dhcp/dhclient-exit-hooks.d/zdnsupdate"}, "changed": false}
TASK [kubernetes/preinstall : generate search domains to resolvconf] *******************************************************************
Monday 11 March 2019 18:53:06 +0000 (0:00:00.264) 0:01:11.573 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"domainentry": "domain cluster.local", "searchentries": "search default.svc.cluster.local svc.cluster.local", "supersede_domain": "supersede domain-name \"cluster.local\";", "supersede_search": "supersede domain-search \"default.svc.cluster.local\", \"svc.cluster.local\";"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"domainentry": "domain cluster.local", "searchentries": "search default.svc.cluster.local svc.cluster.local", "supersede_domain": "supersede domain-name \"cluster.local\";", "supersede_search": "supersede domain-search \"default.svc.cluster.local\", \"svc.cluster.local\";"}, "changed": false}
TASK [kubernetes/preinstall : pick dnsmasq cluster IP or default resolver] *************************************************************
Monday 11 March 2019 18:53:06 +0000 (0:00:00.284) 0:01:11.858 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"dnsmasq_server": ["10.233.0.3", "8.8.8.8", "8.8.4.4"]}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"dnsmasq_server": ["8.8.8.8", "8.8.4.4"]}, "changed": false}
TASK [kubernetes/preinstall : generate nameservers to resolvconf] **********************************************************************
Monday 11 March 2019 18:53:06 +0000 (0:00:00.285) 0:01:12.143 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"nameserverentries": "nameserver 10.233.0.3,nameserver 8.8.8.8,nameserver 8.8.4.4", "supersede_nameserver": "supersede domain-name-servers 10.233.0.3, 8.8.8.8, 8.8.4.4;"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"nameserverentries": "nameserver 8.8.8.8,nameserver 8.8.4.4", "supersede_nameserver": "supersede domain-name-servers 8.8.8.8, 8.8.4.4;"}, "changed": false}
TASK [kubernetes/preinstall : gather os specific variables] ****************************************************************************
Monday 11 March 2019 18:53:07 +0000 (0:00:00.258) 0:01:12.401 **********
ok: [kube-exp-k8s-node-nf-1] => (item=/home/openstack/jetstream_kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml) => {"ansible_facts": {"required_pkgs": ["python-apt", "aufs-tools", "apt-transport-https", "software-properties-common", "ebtables"]}, "ansible_included_var_files": ["/home/openstack/jetstream_kubespray/roles/kubernetes/preinstall/vars/ubuntu.yml"], "changed": false, "item": "/home/openstack/jetstream_kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml"}
ok: [kube-exp-k8s-node-nf-2] => (item=/home/openstack/jetstream_kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml) => {"ansible_facts": {"required_pkgs": ["python-apt", "aufs-tools", "apt-transport-https", "software-properties-common", "ebtables"]}, "ansible_included_var_files": ["/home/openstack/jetstream_kubespray/roles/kubernetes/preinstall/vars/ubuntu.yml"], "changed": false, "item": "/home/openstack/jetstream_kubespray/roles/kubernetes/preinstall/vars/../vars/ubuntu.yml"}
TASK [kubernetes/preinstall : force kube_proxy removal if proxy services are replaced by other means] **********************************
Monday 11 March 2019 18:53:07 +0000 (0:00:00.278) 0:01:12.680 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"kube_proxy_remove": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"kube_proxy_remove": false}, "changed": false}
TASK [kubernetes/preinstall : override kube_proxy_mode to ipvs if kube_proxy_remove is set, as ipvs won't require kube-proxy cleanup when kube-proxy daemonset gets deleted] ***
Monday 11 March 2019 18:53:07 +0000 (0:00:00.224) 0:01:12.905 **********
TASK [kubernetes/preinstall : Create kubernetes directories] ***************************************************************************
Monday 11 March 2019 18:53:07 +0000 (0:00:00.138) 0:01:13.044 **********
ok: [kube-exp-k8s-node-nf-1] => (item=/usr/local/bin) => {"changed": false, "gid": 0, "group": "root", "item": "/usr/local/bin", "mode": "0755", "owner": "kube", "path": "/usr/local/bin", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/usr/local/bin) => {"changed": true, "gid": 0, "group": "root", "item": "/usr/local/bin", "mode": "0755", "owner": "kube", "path": "/usr/local/bin", "size": 4096, "state": "directory", "uid": 999}
ok: [kube-exp-k8s-node-nf-1] => (item=/etc/kubernetes) => {"changed": false, "gid": 0, "group": "root", "item": "/etc/kubernetes", "mode": "0755", "owner": "kube", "path": "/etc/kubernetes", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/etc/kubernetes) => {"changed": true, "gid": 0, "group": "root", "item": "/etc/kubernetes", "mode": "0755", "owner": "kube", "path": "/etc/kubernetes", "size": 4096, "state": "directory", "uid": 999}
ok: [kube-exp-k8s-node-nf-1] => (item=/etc/kubernetes/ssl) => {"changed": false, "gid": 0, "group": "root", "item": "/etc/kubernetes/ssl", "mode": "0755", "owner": "kube", "path": "/etc/kubernetes/ssl", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/etc/kubernetes/ssl) => {"changed": true, "gid": 0, "group": "root", "item": "/etc/kubernetes/ssl", "mode": "0755", "owner": "kube", "path": "/etc/kubernetes/ssl", "size": 4096, "state": "directory", "uid": 999}
ok: [kube-exp-k8s-node-nf-1] => (item=/etc/kubernetes/manifests) => {"changed": false, "gid": 0, "group": "root", "item": "/etc/kubernetes/manifests", "mode": "0755", "owner": "kube", "path": "/etc/kubernetes/manifests", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/etc/kubernetes/manifests) => {"changed": true, "gid": 0, "group": "root", "item": "/etc/kubernetes/manifests", "mode": "0755", "owner": "kube", "path": "/etc/kubernetes/manifests", "size": 4096, "state": "directory", "uid": 999}
ok: [kube-exp-k8s-node-nf-1] => (item=/usr/local/bin/kubernetes-scripts) => {"changed": false, "gid": 0, "group": "root", "item": "/usr/local/bin/kubernetes-scripts", "mode": "0755", "owner": "kube", "path": "/usr/local/bin/kubernetes-scripts", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/usr/local/bin/kubernetes-scripts) => {"changed": true, "gid": 0, "group": "root", "item": "/usr/local/bin/kubernetes-scripts", "mode": "0755", "owner": "kube", "path": "/usr/local/bin/kubernetes-scripts", "size": 4096, "state": "directory", "uid": 999}
TASK [kubernetes/preinstall : Create cni directories] **********************************************************************************
Monday 11 March 2019 18:53:10 +0000 (0:00:02.357) 0:01:15.401 **********
ok: [kube-exp-k8s-node-nf-1] => (item=/etc/cni/net.d) => {"changed": false, "gid": 0, "group": "root", "item": "/etc/cni/net.d", "mode": "0755", "owner": "kube", "path": "/etc/cni/net.d", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/etc/cni/net.d) => {"changed": true, "gid": 0, "group": "root", "item": "/etc/cni/net.d", "mode": "0755", "owner": "kube", "path": "/etc/cni/net.d", "size": 4096, "state": "directory", "uid": 999}
ok: [kube-exp-k8s-node-nf-1] => (item=/opt/cni/bin) => {"changed": false, "gid": 0, "group": "root", "item": "/opt/cni/bin", "mode": "0755", "owner": "kube", "path": "/opt/cni/bin", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/opt/cni/bin) => {"changed": true, "gid": 0, "group": "root", "item": "/opt/cni/bin", "mode": "0755", "owner": "kube", "path": "/opt/cni/bin", "size": 4096, "state": "directory", "uid": 999}
ok: [kube-exp-k8s-node-nf-1] => (item=/var/lib/calico) => {"changed": false, "gid": 0, "group": "root", "item": "/var/lib/calico", "mode": "0755", "owner": "kube", "path": "/var/lib/calico", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => (item=/var/lib/calico) => {"changed": true, "gid": 0, "group": "root", "item": "/var/lib/calico", "mode": "0755", "owner": "kube", "path": "/var/lib/calico", "size": 4096, "state": "directory", "uid": 999}
TASK [kubernetes/preinstall : Create local volume provisioner directories] *************************************************************
Monday 11 March 2019 18:53:11 +0000 (0:00:01.579) 0:01:16.981 **********
TASK [kubernetes/preinstall : create temporary resolveconf cloud init file] ************************************************************
Monday 11 March 2019 18:53:11 +0000 (0:00:00.188) 0:01:17.169 **********
TASK [kubernetes/preinstall : Add domain/search/nameservers/options to resolv.conf] ****************************************************
Monday 11 March 2019 18:53:12 +0000 (0:00:00.176) 0:01:17.345 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "msg": "Block inserted"}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "msg": "Block inserted"}
TASK [kubernetes/preinstall : Remove search/domain/nameserver options before block] ****************************************************
Monday 11 March 2019 18:53:13 +0000 (0:00:01.338) 0:01:18.683 **********
ok: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'search ']) => {"changed": false, "item": ["/etc/resolv.conf", "search "], "msg": ""}
ok: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'search ']) => {"changed": false, "item": ["/etc/resolv.conf", "search "], "msg": ""}
ok: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'nameserver ']) => {"changed": false, "item": ["/etc/resolv.conf", "nameserver "], "msg": ""}
ok: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'nameserver ']) => {"changed": false, "item": ["/etc/resolv.conf", "nameserver "], "msg": ""}
ok: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'domain ']) => {"changed": false, "item": ["/etc/resolv.conf", "domain "], "msg": ""}
ok: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'domain ']) => {"changed": false, "item": ["/etc/resolv.conf", "domain "], "msg": ""}
ok: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'options ']) => {"changed": false, "item": ["/etc/resolv.conf", "options "], "msg": ""}
ok: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'options ']) => {"changed": false, "item": ["/etc/resolv.conf", "options "], "msg": ""}
TASK [kubernetes/preinstall : Remove search/domain/nameserver options after block] *****************************************************
Monday 11 March 2019 18:53:15 +0000 (0:00:02.435) 0:01:21.119 **********
changed: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'search ']) => {"backup_file": "/etc/resolv.conf.30083.2019-03-11@18:53:16~", "changed": true, "item": ["/etc/resolv.conf", "search "], "msg": "1 replacements made"}
changed: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'search ']) => {"backup_file": "/etc/resolv.conf.10333.2019-03-11@18:53:16~", "changed": true, "item": ["/etc/resolv.conf", "search "], "msg": "1 replacements made"}
changed: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'nameserver ']) => {"backup_file": "/etc/resolv.conf.30091.2019-03-11@18:53:16~", "changed": true, "item": ["/etc/resolv.conf", "nameserver "], "msg": "1 replacements made"}
changed: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'nameserver ']) => {"backup_file": "/etc/resolv.conf.10341.2019-03-11@18:53:17~", "changed": true, "item": ["/etc/resolv.conf", "nameserver "], "msg": "1 replacements made"}
ok: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'domain ']) => {"changed": false, "item": ["/etc/resolv.conf", "domain "], "msg": ""}
ok: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'domain ']) => {"changed": false, "item": ["/etc/resolv.conf", "domain "], "msg": ""}
changed: [kube-exp-k8s-node-nf-1] => (item=[u'/etc/resolv.conf', u'options ']) => {"backup_file": "/etc/resolv.conf.30104.2019-03-11@18:53:17~", "changed": true, "item": ["/etc/resolv.conf", "options "], "msg": "1 replacements made"}
changed: [kube-exp-k8s-node-nf-2] => (item=[u'/etc/resolv.conf', u'options ']) => {"backup_file": "/etc/resolv.conf.10354.2019-03-11@18:53:18~", "changed": true, "item": ["/etc/resolv.conf", "options "], "msg": "1 replacements made"}
TASK [kubernetes/preinstall : get temporary resolveconf cloud init file content] *******************************************************
Monday 11 March 2019 18:53:18 +0000 (0:00:02.272) 0:01:23.391 **********
TASK [kubernetes/preinstall : persist resolvconf cloud init file] **********************************************************************
Monday 11 March 2019 18:53:18 +0000 (0:00:00.160) 0:01:23.552 **********
TASK [kubernetes/preinstall : Update package management cache (YUM)] *******************************************************************
Monday 11 March 2019 18:53:18 +0000 (0:00:00.165) 0:01:23.717 **********
TASK [kubernetes/preinstall : Expire management cache (YUM) for Updation - Redhat] *****************************************************
Monday 11 March 2019 18:53:18 +0000 (0:00:00.129) 0:01:23.846 **********
TASK [kubernetes/preinstall : Update package management cache (YUM) - Redhat] **********************************************************
Monday 11 March 2019 18:53:18 +0000 (0:00:00.121) 0:01:23.967 **********
TASK [kubernetes/preinstall : Update package management cache (zypper) - SUSE] *********************************************************
Monday 11 March 2019 18:53:18 +0000 (0:00:00.153) 0:01:24.121 **********
TASK [kubernetes/preinstall : Update package management cache (APT)] *******************************************************************
Monday 11 March 2019 18:53:19 +0000 (0:00:00.158) 0:01:24.280 **********
ok: [kube-exp-k8s-node-nf-2] => {"cache_update_time": 1552330325, "cache_updated": false, "changed": false}
changed: [kube-exp-k8s-node-nf-1] => {"cache_update_time": 1552330402, "cache_updated": true, "changed": true}
TASK [kubernetes/preinstall : Install python-dnf for latest RedHat versions] ***********************************************************
Monday 11 March 2019 18:53:32 +0000 (0:00:13.687) 0:01:37.967 **********
TASK [kubernetes/preinstall : Install epel-release on RedHat/CentOS] *******************************************************************
Monday 11 March 2019 18:53:32 +0000 (0:00:00.202) 0:01:38.170 **********
TASK [kubernetes/preinstall : Update common_required_pkgs with ipvsadm when kube_proxy_mode is ipvs] ***********************************
Monday 11 March 2019 18:53:33 +0000 (0:00:00.160) 0:01:38.331 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"common_required_pkgs": ["python-httplib2", "openssl", "curl", "rsync", "bash-completion", "socat", "unzip", "ipvsadm"]}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"common_required_pkgs": ["python-httplib2", "openssl", "curl", "rsync", "bash-completion", "socat", "unzip", "ipvsadm"]}, "changed": false}
TASK [kubernetes/preinstall : Install packages requirements] ***************************************************************************
Monday 11 March 2019 18:53:33 +0000 (0:00:00.312) 0:01:38.644 **********
ok: [kube-exp-k8s-node-nf-1] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'ebtables', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion', u'socat', u'unzip', u'ipvsadm']) => {"attempts": 1, "cache_update_time": 1552330402, "cache_updated": false, "changed": false, "item": ["python-apt", "aufs-tools", "apt-transport-https", "software-properties-common", "ebtables", "python-httplib2", "openssl", "curl", "rsync", "bash-completion", "socat", "unzip", "ipvsadm"]}
changed: [kube-exp-k8s-node-nf-2] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'ebtables', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion', u'socat', u'unzip', u'ipvsadm']) => {"attempts": 1, "cache_update_time": 1552330325, "cache_updated": false, "changed": true, "item": ["python-apt", "aufs-tools", "apt-transport-https", "software-properties-common", "ebtables", "python-httplib2", "openssl", "curl", "rsync", "bash-completion", "socat", "unzip", "ipvsadm"], "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic\n linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n libnl-3-200 libnl-genl-3-200\nSuggested packages:\n heartbeat keepalived ldirectord zip\nThe following NEW packages will be installed:\n apt-transport-https aufs-tools ipvsadm libnl-3-200 libnl-genl-3-200\n python-httplib2 socat unzip\n0 upgraded, 8 newly installed, 0 to remove and 23 not upgraded.\nNeed to get 748 kB of archives.\nAfter this operation, 2487 kB of additional disk space will be used.\nGet:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 apt-transport-https all 1.6.8 [1692 B]\nGet:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/universe amd64 aufs-tools amd64 1:4.9+20170918-1ubuntu1 [104 kB]\nGet:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 libnl-3-200 amd64 3.2.29-0ubuntu3 [52.8 kB]\nGet:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 libnl-genl-3-200 amd64 3.2.29-0ubuntu3 [11.2 kB]\nGet:5 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 python-httplib2 all 0.9.2+dfsg-1 [34.6 kB]\nGet:6 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 unzip amd64 6.0-21ubuntu1 [167 kB]\nGet:7 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 ipvsadm amd64 1:1.28-3build1 [35.4 kB]\nGet:8 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB]\nFetched 748 kB in 1s (723 kB/s)\nSelecting previously unselected package apt-transport-https.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 156016 files and directories currently installed.)\r\nPreparing to unpack .../0-apt-transport-https_1.6.8_all.deb ...\r\nUnpacking apt-transport-https (1.6.8) ...\r\nSelecting previously unselected package aufs-tools.\r\nPreparing to unpack .../1-aufs-tools_1%3a4.9+20170918-1ubuntu1_amd64.deb ...\r\nUnpacking aufs-tools (1:4.9+20170918-1ubuntu1) ...\r\nSelecting previously unselected package libnl-3-200:amd64.\r\nPreparing to unpack .../2-libnl-3-200_3.2.29-0ubuntu3_amd64.deb ...\r\nUnpacking libnl-3-200:amd64 (3.2.29-0ubuntu3) ...\r\nSelecting previously unselected package libnl-genl-3-200:amd64.\r\nPreparing to unpack .../3-libnl-genl-3-200_3.2.29-0ubuntu3_amd64.deb ...\r\nUnpacking libnl-genl-3-200:amd64 (3.2.29-0ubuntu3) ...\r\nSelecting previously unselected package python-httplib2.\r\nPreparing to unpack .../4-python-httplib2_0.9.2+dfsg-1_all.deb ...\r\nUnpacking python-httplib2 (0.9.2+dfsg-1) ...\r\nSelecting previously unselected package unzip.\r\nPreparing to unpack .../5-unzip_6.0-21ubuntu1_amd64.deb ...\r\nUnpacking unzip (6.0-21ubuntu1) ...\r\nSelecting previously unselected package ipvsadm.\r\nPreparing to unpack .../6-ipvsadm_1%3a1.28-3build1_amd64.deb ...\r\nUnpacking ipvsadm (1:1.28-3build1) ...\r\nSelecting previously unselected package socat.\r\nPreparing to unpack .../7-socat_1.7.3.2-2ubuntu2_amd64.deb ...\r\nUnpacking socat (1.7.3.2-2ubuntu2) ...\r\nSetting up aufs-tools (1:4.9+20170918-1ubuntu1) ...\r\nSetting up apt-transport-https (1.6.8) ...\r\nProcessing triggers for mime-support (3.60ubuntu1) ...\r\nProcessing triggers for ureadahead (0.100.0-20) ...\r\nSetting up socat (1.7.3.2-2ubuntu2) ...\r\nSetting up unzip (6.0-21ubuntu1) ...\r\nSetting up python-httplib2 (0.9.2+dfsg-1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\nProcessing triggers for systemd (237-3ubuntu10.13) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nSetting up libnl-3-200:amd64 (3.2.29-0ubuntu3) ...\r\nSetting up libnl-genl-3-200:amd64 (3.2.29-0ubuntu3) ...\r\nSetting up ipvsadm (1:1.28-3build1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\nProcessing triggers for systemd (237-3ubuntu10.13) ...\r\nProcessing triggers for ureadahead (0.100.0-20) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic", " linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " libnl-3-200 libnl-genl-3-200", "Suggested packages:", " heartbeat keepalived ldirectord zip", "The following NEW packages will be installed:", " apt-transport-https aufs-tools ipvsadm libnl-3-200 libnl-genl-3-200", " python-httplib2 socat unzip", "0 upgraded, 8 newly installed, 0 to remove and 23 not upgraded.", "Need to get 748 kB of archives.", "After this operation, 2487 kB of additional disk space will be used.", "Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 apt-transport-https all 1.6.8 [1692 B]", "Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/universe amd64 aufs-tools amd64 1:4.9+20170918-1ubuntu1 [104 kB]", "Get:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 libnl-3-200 amd64 3.2.29-0ubuntu3 [52.8 kB]", "Get:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 libnl-genl-3-200 amd64 3.2.29-0ubuntu3 [11.2 kB]", "Get:5 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 python-httplib2 all 0.9.2+dfsg-1 [34.6 kB]", "Get:6 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 unzip amd64 6.0-21ubuntu1 [167 kB]", "Get:7 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 ipvsadm amd64 1:1.28-3build1 [35.4 kB]", "Get:8 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB]", "Fetched 748 kB in 1s (723 kB/s)", "Selecting previously unselected package apt-transport-https.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 156016 files and directories currently installed.)", "Preparing to unpack .../0-apt-transport-https_1.6.8_all.deb ...", "Unpacking apt-transport-https (1.6.8) ...", "Selecting previously unselected package aufs-tools.", "Preparing to unpack .../1-aufs-tools_1%3a4.9+20170918-1ubuntu1_amd64.deb ...", "Unpacking aufs-tools (1:4.9+20170918-1ubuntu1) ...", "Selecting previously unselected package libnl-3-200:amd64.", "Preparing to unpack .../2-libnl-3-200_3.2.29-0ubuntu3_amd64.deb ...", "Unpacking libnl-3-200:amd64 (3.2.29-0ubuntu3) ...", "Selecting previously unselected package libnl-genl-3-200:amd64.", "Preparing to unpack .../3-libnl-genl-3-200_3.2.29-0ubuntu3_amd64.deb ...", "Unpacking libnl-genl-3-200:amd64 (3.2.29-0ubuntu3) ...", "Selecting previously unselected package python-httplib2.", "Preparing to unpack .../4-python-httplib2_0.9.2+dfsg-1_all.deb ...", "Unpacking python-httplib2 (0.9.2+dfsg-1) ...", "Selecting previously unselected package unzip.", "Preparing to unpack .../5-unzip_6.0-21ubuntu1_amd64.deb ...", "Unpacking unzip (6.0-21ubuntu1) ...", "Selecting previously unselected package ipvsadm.", "Preparing to unpack .../6-ipvsadm_1%3a1.28-3build1_amd64.deb ...", "Unpacking ipvsadm (1:1.28-3build1) ...", "Selecting previously unselected package socat.", "Preparing to unpack .../7-socat_1.7.3.2-2ubuntu2_amd64.deb ...", "Unpacking socat (1.7.3.2-2ubuntu2) ...", "Setting up aufs-tools (1:4.9+20170918-1ubuntu1) ...", "Setting up apt-transport-https (1.6.8) ...", "Processing triggers for mime-support (3.60ubuntu1) ...", "Processing triggers for ureadahead (0.100.0-20) ...", "Setting up socat (1.7.3.2-2ubuntu2) ...", "Setting up unzip (6.0-21ubuntu1) ...", "Setting up python-httplib2 (0.9.2+dfsg-1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ...", "Processing triggers for systemd (237-3ubuntu10.13) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Setting up libnl-3-200:amd64 (3.2.29-0ubuntu3) ...", "Setting up libnl-genl-3-200:amd64 (3.2.29-0ubuntu3) ...", "Setting up ipvsadm (1:1.28-3build1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ...", "Processing triggers for systemd (237-3ubuntu10.13) ...", "Processing triggers for ureadahead (0.100.0-20) ..."]}
TASK [kubernetes/preinstall : Confirm selinux deployed] ********************************************************************************
Monday 11 March 2019 18:54:18 +0000 (0:00:45.331) 0:02:23.975 **********
TASK [kubernetes/preinstall : Set selinux policy] **************************************************************************************
Monday 11 March 2019 18:54:18 +0000 (0:00:00.166) 0:02:24.142 **********
TASK [kubernetes/preinstall : Disable IPv6 DNS lookup] *********************************************************************************
Monday 11 March 2019 18:54:19 +0000 (0:00:00.156) 0:02:24.298 **********
TASK [kubernetes/preinstall : Stat sysctl file configuration] **************************************************************************
Monday 11 March 2019 18:54:19 +0000 (0:00:00.137) 0:02:24.436 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"atime": 1552240290.073892, "attr_flags": "", "attributes": [], "block_size": 4096, "blocks": 0, "charset": "binary", "ctime": 1550845354.0106936, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 24239, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": true, "isreg": false, "issock": false, "isuid": false, "lnk_source": "/etc/sysctl.conf", "lnk_target": "../sysctl.conf", "mimetype": "inode/symlink", "mode": "0777", "mtime": 1550093554.0, "nlink": 1, "path": "/etc/sysctl.d/99-sysctl.conf", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 14, "uid": 0, "version": null, "wgrp": true, "woth": true, "writeable": true, "wusr": true, "xgrp": true, "xoth": true, "xusr": true}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"atime": 1552329476.596, "attr_flags": "", "attributes": [], "block_size": 4096, "blocks": 0, "charset": "binary", "ctime": 1550845354.0106936, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 24239, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": true, "isreg": false, "issock": false, "isuid": false, "lnk_source": "/etc/sysctl.conf", "lnk_target": "../sysctl.conf", "mimetype": "inode/symlink", "mode": "0777", "mtime": 1550093554.0, "nlink": 1, "path": "/etc/sysctl.d/99-sysctl.conf", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 14, "uid": 0, "version": null, "wgrp": true, "woth": true, "writeable": true, "wusr": true, "xgrp": true, "xoth": true, "xusr": true}}
TASK [kubernetes/preinstall : Change sysctl file path to link source if linked] ********************************************************
Monday 11 March 2019 18:54:20 +0000 (0:00:00.789) 0:02:25.226 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"sysctl_file_path": "/etc/sysctl.conf"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"sysctl_file_path": "/etc/sysctl.conf"}, "changed": false}
TASK [kubernetes/preinstall : Enable ip forwarding] ************************************************************************************
Monday 11 March 2019 18:54:20 +0000 (0:00:00.266) 0:02:25.492 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true}
TASK [kubernetes/preinstall : Hosts | populate inventory into hosts file] **************************************************************
Monday 11 March 2019 18:54:21 +0000 (0:00:00.926) 0:02:26.418 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "msg": "Block inserted"}
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "msg": "Block inserted"}
TASK [kubernetes/preinstall : Hosts | populate kubernetes loadbalancer address into hosts file] ****************************************
Monday 11 March 2019 18:54:23 +0000 (0:00:02.208) 0:02:28.627 **********
TASK [kubernetes/preinstall : Hosts | Retrieve hosts file content] *********************************************************************
Monday 11 March 2019 18:54:23 +0000 (0:00:00.173) 0:02:28.801 **********
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "content": "MTI3LjAuMC4xIGxvY2FsaG9zdAoKIyBUaGUgZm9sbG93aW5nIGxpbmVzIGFyZSBkZXNpcmFibGUgZm9yIElQdjYgY2FwYWJsZSBob3N0cwo6OjEgaXA2LWxvY2FsaG9zdCBpcDYtbG9vcGJhY2sKZmUwMDo6MCBpcDYtbG9jYWxuZXQKZmYwMDo6MCBpcDYtbWNhc3RwcmVmaXgKZmYwMjo6MSBpcDYtYWxsbm9kZXMKZmYwMjo6MiBpcDYtYWxscm91dGVycwpmZjAyOjozIGlwNi1hbGxob3N0cwojIEFuc2libGUgaW52ZW50b3J5IGhvc3RzIEJFR0lOCjEwLjAuMC42IGt1YmUtZXhwLWs4cy1ub2RlLW5mLTEga3ViZS1leHAtazhzLW5vZGUtbmYtMS5jbHVzdGVyLmxvY2FsCjEwLjAuMC40IGt1YmUtZXhwLWs4cy1ub2RlLW5mLTIga3ViZS1leHAtazhzLW5vZGUtbmYtMi5jbHVzdGVyLmxvY2FsCjEwLjAuMC4xNCBrdWJlLWV4cC1rOHMtbm9kZS1uZi0zIGt1YmUtZXhwLWs4cy1ub2RlLW5mLTMuY2x1c3Rlci5sb2NhbAoxMC4wLjAuMTIga3ViZS1leHAtazhzLW1hc3Rlci0xIGt1YmUtZXhwLWs4cy1tYXN0ZXItMS5jbHVzdGVyLmxvY2FsCiMgQW5zaWJsZSBpbnZlbnRvcnkgaG9zdHMgRU5ECg==", "encoding": "base64", "source": "/etc/hosts"}
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "content": "MTI3LjAuMC4xIGxvY2FsaG9zdCBsb2NhbGhvc3QubG9jYWxkb21haW4KCiMgVGhlIGZvbGxvd2luZyBsaW5lcyBhcmUgZGVzaXJhYmxlIGZvciBJUHY2IGNhcGFibGUgaG9zdHMKOjoxIGlwNi1sb2NhbGhvc3QgaXA2LWxvb3BiYWNrIGxvY2FsaG9zdDYgbG9jYWxob3N0Ni5sb2NhbGRvbWFpbgpmZTAwOjowIGlwNi1sb2NhbG5ldApmZjAwOjowIGlwNi1tY2FzdHByZWZpeApmZjAyOjoxIGlwNi1hbGxub2RlcwpmZjAyOjoyIGlwNi1hbGxyb3V0ZXJzCmZmMDI6OjMgaXA2LWFsbGhvc3RzCiMgQW5zaWJsZSBpbnZlbnRvcnkgaG9zdHMgQkVHSU4KMTAuMC4wLjYga3ViZS1leHAtazhzLW5vZGUtbmYtMSBrdWJlLWV4cC1rOHMtbm9kZS1uZi0xLmNsdXN0ZXIubG9jYWwKMTAuMC4wLjQga3ViZS1leHAtazhzLW5vZGUtbmYtMiBrdWJlLWV4cC1rOHMtbm9kZS1uZi0yLmNsdXN0ZXIubG9jYWwKMTAuMC4wLjE0IGt1YmUtZXhwLWs4cy1ub2RlLW5mLTMga3ViZS1leHAtazhzLW5vZGUtbmYtMy5jbHVzdGVyLmxvY2FsCjEwLjAuMC4xMiBrdWJlLWV4cC1rOHMtbWFzdGVyLTEga3ViZS1leHAtazhzLW1hc3Rlci0xLmNsdXN0ZXIubG9jYWwKIyBBbnNpYmxlIGludmVudG9yeSBob3N0cyBFTkQK", "encoding": "base64", "source": "/etc/hosts"}
TASK [kubernetes/preinstall : Hosts | Extract existing entries for localhost from hosts file] ******************************************
Monday 11 March 2019 18:54:24 +0000 (0:00:00.817) 0:02:29.619 **********
ok: [kube-exp-k8s-node-nf-1] => (item=127.0.0.1 localhost localhost.localdomain) => {"ansible_facts": {"etc_hosts_localhosts_dict": {"127.0.0.1": ["localhost", "localhost.localdomain"]}}, "changed": false, "item": "127.0.0.1 localhost localhost.localdomain"}
ok: [kube-exp-k8s-node-nf-2] => (item=127.0.0.1 localhost) => {"ansible_facts": {"etc_hosts_localhosts_dict": {"127.0.0.1": ["localhost"]}}, "changed": false, "item": "127.0.0.1 localhost"}
ok: [kube-exp-k8s-node-nf-1] => (item=::1 ip6-localhost ip6-loopback localhost6 localhost6.localdomain) => {"ansible_facts": {"etc_hosts_localhosts_dict": {"127.0.0.1": ["localhost", "localhost.localdomain"], "::1": ["ip6-localhost", "ip6-loopback", "localhost6", "localhost6.localdomain"]}}, "changed": false, "item": "::1 ip6-localhost ip6-loopback localhost6 localhost6.localdomain"}
ok: [kube-exp-k8s-node-nf-2] => (item=::1 ip6-localhost ip6-loopback) => {"ansible_facts": {"etc_hosts_localhosts_dict": {"127.0.0.1": ["localhost"], "::1": ["ip6-localhost", "ip6-loopback"]}}, "changed": false, "item": "::1 ip6-localhost ip6-loopback"}
TASK [kubernetes/preinstall : Hosts | Update target hosts file entries dict with required entries] *************************************
Monday 11 March 2019 18:54:24 +0000 (0:00:00.498) 0:02:30.118 **********
ok: [kube-exp-k8s-node-nf-1] => (item={'value': {u'expected': [u'localhost6', u'localhost6.localdomain'], u'unexpected': [u'localhost', u'localhost.localdomain']}, 'key': u'::1'}) => {"ansible_facts": {"etc_hosts_localhosts_dict_target": {"::1": ["ip6-localhost", "ip6-loopback", "localhost6", "localhost6.localdomain"]}}, "changed": false, "item": {"key": "::1", "value": {"expected": ["localhost6", "localhost6.localdomain"], "unexpected": ["localhost", "localhost.localdomain"]}}}
ok: [kube-exp-k8s-node-nf-1] => (item={'value': {u'expected': [u'localhost', u'localhost.localdomain']}, 'key': u'127.0.0.1'}) => {"ansible_facts": {"etc_hosts_localhosts_dict_target": {"127.0.0.1": ["localhost", "localhost.localdomain"], "::1": ["ip6-localhost", "ip6-loopback", "localhost6", "localhost6.localdomain"]}}, "changed": false, "item": {"key": "127.0.0.1", "value": {"expected": ["localhost", "localhost.localdomain"]}}}
ok: [kube-exp-k8s-node-nf-2] => (item={'value': {u'expected': [u'localhost6', u'localhost6.localdomain'], u'unexpected': [u'localhost', u'localhost.localdomain']}, 'key': u'::1'}) => {"ansible_facts": {"etc_hosts_localhosts_dict_target": {"::1": ["ip6-localhost", "ip6-loopback", "localhost6", "localhost6.localdomain"]}}, "changed": false, "item": {"key": "::1", "value": {"expected": ["localhost6", "localhost6.localdomain"], "unexpected": ["localhost", "localhost.localdomain"]}}}
ok: [kube-exp-k8s-node-nf-2] => (item={'value': {u'expected': [u'localhost', u'localhost.localdomain']}, 'key': u'127.0.0.1'}) => {"ansible_facts": {"etc_hosts_localhosts_dict_target": {"127.0.0.1": ["localhost", "localhost.localdomain"], "::1": ["ip6-localhost", "ip6-loopback", "localhost6", "localhost6.localdomain"]}}, "changed": false, "item": {"key": "127.0.0.1", "value": {"expected": ["localhost", "localhost.localdomain"]}}}
TASK [kubernetes/preinstall : Hosts | Update (if necessary) hosts file] ****************************************************************
Monday 11 March 2019 18:54:25 +0000 (0:00:00.317) 0:02:30.435 **********
ok: [kube-exp-k8s-node-nf-1] => (item={'value': [u'ip6-localhost', u'ip6-loopback', u'localhost6', u'localhost6.localdomain'], 'key': u'::1'}) => {"backup": "", "changed": false, "item": {"key": "::1", "value": ["ip6-localhost", "ip6-loopback", "localhost6", "localhost6.localdomain"]}, "msg": ""}
changed: [kube-exp-k8s-node-nf-2] => (item={'value': [u'ip6-localhost', u'ip6-loopback', u'localhost6', u'localhost6.localdomain'], 'key': u'::1'}) => {"backup": "/etc/hosts.10846.2019-03-11@18:54:25~", "changed": true, "item": {"key": "::1", "value": ["ip6-localhost", "ip6-loopback", "localhost6", "localhost6.localdomain"]}, "msg": "line replaced"}
ok: [kube-exp-k8s-node-nf-1] => (item={'value': [u'localhost', u'localhost.localdomain'], 'key': u'127.0.0.1'}) => {"backup": "", "changed": false, "item": {"key": "127.0.0.1", "value": ["localhost", "localhost.localdomain"]}, "msg": ""}
changed: [kube-exp-k8s-node-nf-2] => (item={'value': [u'localhost', u'localhost.localdomain'], 'key': u'127.0.0.1'}) => {"backup": "/etc/hosts.10853.2019-03-11@18:54:26~", "changed": true, "item": {"key": "127.0.0.1", "value": ["localhost", "localhost.localdomain"]}, "msg": "line replaced"}
TASK [kubernetes/preinstall : Configure dhclient to supersede search/domain/nameservers] ***********************************************
Monday 11 March 2019 18:54:26 +0000 (0:00:01.106) 0:02:31.541 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "msg": ""}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "msg": "Block inserted"}
TASK [kubernetes/preinstall : Configure dhclient hooks for resolv.conf (non-RH)] *******************************************************
Monday 11 March 2019 18:54:26 +0000 (0:00:00.627) 0:02:32.169 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "717640740ff90e3976bb5df73ca9ba2c8936f8c4", "dest": "/etc/dhcp/dhclient-exit-hooks.d/zdnsupdate", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/dhcp/dhclient-exit-hooks.d/zdnsupdate", "size": 474, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "717640740ff90e3976bb5df73ca9ba2c8936f8c4", "dest": "/etc/dhcp/dhclient-exit-hooks.d/zdnsupdate", "gid": 0, "group": "root", "md5sum": "3ec0c9032991a149c71f953f568eb7d5", "mode": "0755", "owner": "root", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330467.14-11093762384323/source", "state": "file", "uid": 0}
TASK [kubernetes/preinstall : Configure dhclient hooks for resolv.conf (RH-only)] ******************************************************
Monday 11 March 2019 18:54:29 +0000 (0:00:02.058) 0:02:34.228 **********
TASK [kubernetes/preinstall : Remove kubespray specific config from dhclient config] ***************************************************
Monday 11 March 2019 18:54:29 +0000 (0:00:00.191) 0:02:34.419 **********
TASK [kubernetes/preinstall : Remove kubespray specific dhclient hook] *****************************************************************
Monday 11 March 2019 18:54:29 +0000 (0:00:00.172) 0:02:34.591 **********
RUNNING HANDLER [kubernetes/preinstall : Preinstall | restart network] *****************************************************************
Monday 11 March 2019 18:54:29 +0000 (0:00:00.133) 0:02:34.725 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "cmd": ["/bin/true"], "delta": "0:00:00.003094", "end": "2019-03-11 18:54:30.067223", "rc": 0, "start": "2019-03-11 18:54:30.064129", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["/bin/true"], "delta": "0:00:00.003358", "end": "2019-03-11 18:54:30.120853", "rc": 0, "start": "2019-03-11 18:54:30.117495", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [kubernetes/preinstall : Preinstall | reload network] ******************************************************************
Monday 11 March 2019 18:54:30 +0000 (0:00:00.856) 0:02:35.581 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "name": "systemd-networkd", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 01:21:02 UTC", "ActiveEnterTimestampMonotonic": "183310866724", "ActiveExitTimestamp": "Mon 2019-03-11 01:21:02 UTC", "ActiveExitTimestampMonotonic": "183310746534", "ActiveState": "active", "After": "systemd-networkd.socket -.mount network-pre.target systemd-sysctl.service system.slice systemd-sysusers.service systemd-udevd.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 01:21:02 UTC", "AssertTimestampMonotonic": "183310791968", "Before": "network.target systemd-networkd-wait-online.service systemd-resolved.service shutdown.target multi-user.target apt-daily.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 01:21:02 UTC", "ConditionTimestampMonotonic": "183310791894", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/systemd-networkd.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "Network Service", "DevicePolicy": "auto", "Documentation": "man:systemd-networkd.service(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1905", "ExecMainStartTimestamp": "Mon 2019-03-11 01:21:02 UTC", "ExecMainStartTimestampMonotonic": "183310794624", "ExecMainStatus": "0", "ExecStart": "{ path=/lib/systemd/systemd-networkd ; argv[]=/lib/systemd/systemd-networkd ; ignore_errors=no ; start_time=[Mon 2019-03-11 01:21:02 UTC] ; stop_time=[n/a] ; pid=1905 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/systemd-networkd.service", "GID": "102", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "systemd-networkd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2019-03-11 01:21:02 UTC", "InactiveEnterTimestampMonotonic": "183310789100", "InactiveExitTimestamp": "Mon 2019-03-11 01:21:02 UTC", "InactiveExitTimestampMonotonic": "183310794711", "InvocationID": "de258cbd2c254f0395e17f390667ab61", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "120504", "LimitNPROCSoft": "120504", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "yes", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1905", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "yes", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "systemd-networkd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "yes", "ProtectHome": "yes", "ProtectKernelModules": "yes", "ProtectKernelTunables": "no", "ProtectSystem": "strict", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "RequiredBy": "systemd-networkd-wait-online.service", "Requires": "system.slice -.mount", "RequiresMountsFor": "/run/systemd/netif", "Restart": "on-failure", "RestartUSec": "0", "RestrictNamespaces": "no", "RestrictRealtime": "yes", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "systemd/netif", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "yes", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 01:21:02 UTC", "StateChangeTimestampMonotonic": "183310866724", "StateDirectoryMode": "0755", "StatusErrno": "0", "StatusText": "Processing requests...", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallArchitectures": "native", "SystemCallErrorNumber": "0", "SystemCallFilter": "~_sysctl add_key adjtimex afs_syscall bdflush break chroot clock_adjtime clock_settime create_module delete_module finit_module ftime get_kernel_syms getpmsg gtty idle init_module ioperm iopl kexec_file_load kexec_load keyctl lock lookup_dcookie modify_ldt mount mpx pciconfig_iobase pciconfig_read pciconfig_write perf_event_open pivot_root process_vm_readv process_vm_writev prof profil ptrace putpmsg query_module reboot request_key rtas s390_pci_mmio_read s390_pci_mmio_write s390_runtime_instr security settimeofday sgetmask spu_run ssetmask stime stty swapoff swapon switch_endian sysfs tuxcall ulimit umount umount2 uselib ustat vm86 vm86old vserver", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "systemd-networkd.socket", "Type": "notify", "UID": "100", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "systemd-network", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network.target", "WatchdogTimestamp": "Mon 2019-03-11 18:54:12 UTC", "WatchdogTimestampMonotonic": "246500498707", "WatchdogUSec": "3min"}}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "name": "systemd-networkd", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 18:38:05 UTC", "ActiveEnterTimestampMonotonic": "22896388", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-sysusers.service systemd-sysctl.service systemd-networkd.socket network-pre.target systemd-journald.socket system.slice systemd-udevd.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 18:38:05 UTC", "AssertTimestampMonotonic": "22843223", "Before": "network.target systemd-networkd-wait-online.service shutdown.target multi-user.target systemd-resolved.service apt-daily.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 18:38:05 UTC", "ConditionTimestampMonotonic": "22843135", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/systemd-networkd.service", "ControlPID": "0", "DefaultDependencies": "no", "Delegate": "no", "Description": "Network Service", "DevicePolicy": "auto", "Documentation": "man:systemd-networkd.service(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "821", "ExecMainStartTimestamp": "Mon 2019-03-11 18:38:05 UTC", "ExecMainStartTimestampMonotonic": "22844854", "ExecMainStatus": "0", "ExecStart": "{ path=/lib/systemd/systemd-networkd ; argv[]=/lib/systemd/systemd-networkd ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/systemd-networkd.service", "GID": "102", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "systemd-networkd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-03-11 18:38:05 UTC", "InactiveExitTimestampMonotonic": "22844935", "InvocationID": "6ae1d6dfc5044533a30103cb5c1ae095", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "120504", "LimitNPROCSoft": "120504", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "yes", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "821", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "yes", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "systemd-networkd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "yes", "ProtectHome": "yes", "ProtectKernelModules": "yes", "ProtectKernelTunables": "no", "ProtectSystem": "strict", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "RequiredBy": "systemd-networkd-wait-online.service", "Requires": "-.mount system.slice", "RequiresMountsFor": "/run/systemd/netif", "Restart": "on-failure", "RestartUSec": "0", "RestrictNamespaces": "no", "RestrictRealtime": "yes", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "systemd/netif", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "yes", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 18:38:05 UTC", "StateChangeTimestampMonotonic": "22896388", "StateDirectoryMode": "0755", "StatusErrno": "0", "StatusText": "Processing requests...", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallArchitectures": "native", "SystemCallErrorNumber": "0", "SystemCallFilter": "~_sysctl add_key adjtimex afs_syscall bdflush break chroot clock_adjtime clock_settime create_module delete_module finit_module ftime get_kernel_syms getpmsg gtty idle init_module ioperm iopl kexec_file_load kexec_load keyctl lock lookup_dcookie modify_ldt mount mpx pciconfig_iobase pciconfig_read pciconfig_write perf_event_open pivot_root process_vm_readv process_vm_writev prof profil ptrace putpmsg query_module reboot request_key rtas s390_pci_mmio_read s390_pci_mmio_write s390_runtime_instr security settimeofday sgetmask spu_run ssetmask stime stty swapoff swapon switch_endian sysfs tuxcall ulimit umount umount2 uselib ustat vm86 vm86old vserver", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "systemd-networkd.socket", "Type": "notify", "UID": "100", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "systemd-network", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network.target", "WatchdogTimestamp": "Mon 2019-03-11 18:52:21 UTC", "WatchdogTimestampMonotonic": "878301958", "WatchdogUSec": "3min"}}
RUNNING HANDLER [kubernetes/preinstall : Preinstall | reload kubelet] ******************************************************************
Monday 11 March 2019 18:54:33 +0000 (0:00:03.513) 0:02:39.095 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "name": "kubelet", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 01:21:03 UTC", "ActiveEnterTimestampMonotonic": "183311934017", "ActiveExitTimestamp": "Mon 2019-03-11 01:21:03 UTC", "ActiveExitTimestampMonotonic": "183311856465", "ActiveState": "active", "After": "docker.service sysinit.target systemd-journald.socket basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 01:21:03 UTC", "AssertTimestampMonotonic": "183311926728", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 01:21:03 UTC", "ConditionTimestampMonotonic": "183311926728", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/kubelet.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Kubernetes Kubelet Server", "DevicePolicy": "auto", "Documentation": "https://github.com/GoogleCloudPlatform/kubernetes", "DynamicUser": "no", "EnvironmentFile": "/etc/kubernetes/kubelet.env (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1975", "ExecMainStartTimestamp": "Mon 2019-03-11 01:21:03 UTC", "ExecMainStartTimestampMonotonic": "183311933930", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/local/bin/kubelet ; argv[]=/usr/local/bin/kubelet $KUBE_LOGTOSTDERR $KUBE_LOG_LEVEL $KUBELET_API_SERVER $KUBELET_ADDRESS $KUBELET_PORT $KUBELET_HOSTNAME $KUBE_ALLOW_PRIV $KUBELET_ARGS $DOCKER_SOCKET $KUBELET_NETWORK_PLUGIN $KUBELET_VOLUME_PLUGIN $KUBELET_CLOUDPROVIDER ; ignore_errors=no ; start_time=[Mon 2019-03-11 01:21:03 UTC] ; stop_time=[n/a] ; pid=1975 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/bin/mkdir ; argv[]=/bin/mkdir -p /var/lib/kubelet/volume-plugins ; ignore_errors=yes ; start_time=[Mon 2019-03-11 01:21:03 UTC] ; stop_time=[Mon 2019-03-11 01:21:03 UTC] ; pid=1974 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/kubelet.service", "GID": "0", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "kubelet.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2019-03-11 01:21:03 UTC", "InactiveEnterTimestampMonotonic": "183311924444", "InactiveExitTimestamp": "Mon 2019-03-11 01:21:03 UTC", "InactiveExitTimestampMonotonic": "183311928909", "InvocationID": "6ccd39e7279e4ac19dda3cbfea01722f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "120504", "LimitNPROCSoft": "120504", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1975", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "kubelet.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "always", "RestartUSec": "10s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 01:21:03 UTC", "StateChangeTimestampMonotonic": "183311934017", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "0", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "0", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "root", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "docker.socket", "WatchdogTimestamp": "Mon 2019-03-11 01:21:03 UTC", "WatchdogTimestampMonotonic": "183311934015", "WatchdogUSec": "0"}}
RUNNING HANDLER [kubernetes/preinstall : Preinstall | kube-apiserver configured] *******************************************************
Monday 11 March 2019 18:54:34 +0000 (0:00:00.976) 0:02:40.072 **********
RUNNING HANDLER [kubernetes/preinstall : Preinstall | kube-controller configured] ******************************************************
Monday 11 March 2019 18:54:35 +0000 (0:00:00.131) 0:02:40.203 **********
RUNNING HANDLER [kubernetes/preinstall : Preinstall | restart kube-controller-manager] *************************************************
Monday 11 March 2019 18:54:35 +0000 (0:00:00.138) 0:02:40.341 **********
RUNNING HANDLER [kubernetes/preinstall : Preinstall | restart kube-apiserver] **********************************************************
Monday 11 March 2019 18:54:35 +0000 (0:00:00.158) 0:02:40.500 **********
TASK [kubernetes/preinstall : Check if we are running inside a Azure VM] ***************************************************************
Monday 11 March 2019 18:54:35 +0000 (0:00:00.177) 0:02:40.678 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"exists": false}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"exists": false}}
TASK [kubernetes/preinstall : install growpart] ****************************************************************************************
Monday 11 March 2019 18:54:36 +0000 (0:00:00.727) 0:02:41.406 **********
TASK [kubernetes/preinstall : check if growpart needs to be run] ***********************************************************************
Monday 11 March 2019 18:54:36 +0000 (0:00:00.161) 0:02:41.568 **********
TASK [kubernetes/preinstall : check fs type] *******************************************************************************************
Monday 11 March 2019 18:54:36 +0000 (0:00:00.163) 0:02:41.731 **********
TASK [kubernetes/preinstall : run growpart] ********************************************************************************************
Monday 11 March 2019 18:54:36 +0000 (0:00:00.192) 0:02:41.924 **********
TASK [kubernetes/preinstall : run xfs_growfs] ******************************************************************************************
Monday 11 March 2019 18:54:36 +0000 (0:00:00.145) 0:02:42.069 **********
TASK [container-engine/cri-o : gather os specific variables] ***************************************************************************
Monday 11 March 2019 18:54:37 +0000 (0:00:00.161) 0:02:42.231 **********
TASK [container-engine/cri-o : Add OpenShift Origin repository] ************************************************************************
Monday 11 March 2019 18:54:37 +0000 (0:00:00.172) 0:02:42.403 **********
TASK [container-engine/cri-o : Install cri-o packages] *********************************************************************************
Monday 11 March 2019 18:54:37 +0000 (0:00:00.144) 0:02:42.547 **********
TASK [container-engine/cri-o : Install cri-o config] ***********************************************************************************
Monday 11 March 2019 18:54:37 +0000 (0:00:00.189) 0:02:42.736 **********
TASK [container-engine/cri-o : Copy mounts.conf] ***************************************************************************************
Monday 11 March 2019 18:54:37 +0000 (0:00:00.162) 0:02:42.899 **********
TASK [container-engine/cri-o : Create directory for oci hooks] *************************************************************************
Monday 11 March 2019 18:54:37 +0000 (0:00:00.144) 0:02:43.044 **********
TASK [container-engine/cri-o : Install cri-o service] **********************************************************************************
Monday 11 March 2019 18:54:37 +0000 (0:00:00.140) 0:02:43.184 **********
TASK [container-engine/rkt : gather os specific variables for rkt] *********************************************************************
Monday 11 March 2019 18:54:38 +0000 (0:00:00.139) 0:02:43.324 **********
TASK [container-engine/rkt : install rkt pkg on ubuntu] ********************************************************************************
Monday 11 March 2019 18:54:38 +0000 (0:00:00.224) 0:02:43.549 **********
TASK [container-engine/rkt : install rkt pkg on fedora] ********************************************************************************
Monday 11 March 2019 18:54:38 +0000 (0:00:00.155) 0:02:43.705 **********
TASK [container-engine/rkt : install rkt pkg on centos] ********************************************************************************
Monday 11 March 2019 18:54:38 +0000 (0:00:00.150) 0:02:43.856 **********
TASK [container-engine/rkt : install rkt pkg on openSUSE] ******************************************************************************
Monday 11 March 2019 18:54:38 +0000 (0:00:00.140) 0:02:43.997 **********
TASK [container-engine/rkt : Set up cron job to do garbage cleanup] ********************************************************************
Monday 11 March 2019 18:54:38 +0000 (0:00:00.178) 0:02:44.175 **********
TASK [container-engine/docker-storage : docker-storage-setup | install git and make] ***************************************************
Monday 11 March 2019 18:54:39 +0000 (0:00:00.163) 0:02:44.339 **********
TASK [container-engine/docker-storage : docker-storage-setup | docker-storage-setup sysconfig template] ********************************
Monday 11 March 2019 18:54:39 +0000 (0:00:00.211) 0:02:44.550 **********
TASK [container-engine/docker-storage : docker-storage-override-directory | docker service storage-setup override dir] *****************
Monday 11 March 2019 18:54:39 +0000 (0:00:00.160) 0:02:44.710 **********
TASK [container-engine/docker-storage : docker-storage-override | docker service storage-setup override file] **************************
Monday 11 March 2019 18:54:39 +0000 (0:00:00.183) 0:02:44.894 **********
TASK [container-engine/docker-storage : docker-storage-setup | install lvm2] ***********************************************************
Monday 11 March 2019 18:54:39 +0000 (0:00:00.153) 0:02:45.048 **********
TASK [container-engine/docker-storage : docker-storage-setup | install and run container-storage-setup] ********************************
Monday 11 March 2019 18:54:40 +0000 (0:00:00.163) 0:02:45.211 **********
TASK [container-engine/docker : check if atomic host] **********************************************************************************
Monday 11 March 2019 18:54:40 +0000 (0:00:00.212) 0:02:45.424 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"exists": false}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"exists": false}}
TASK [container-engine/docker : set_fact] **********************************************************************************************
Monday 11 March 2019 18:54:40 +0000 (0:00:00.696) 0:02:46.121 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"is_atomic": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"is_atomic": false}, "changed": false}
TASK [container-engine/docker : gather os specific variables] **************************************************************************
Monday 11 March 2019 18:54:41 +0000 (0:00:00.226) 0:02:46.348 **********
ok: [kube-exp-k8s-node-nf-1] => (item=/home/openstack/jetstream_kubespray/roles/container-engine/docker/vars/../vars/ubuntu-bionic.yml) => {"ansible_facts": {"docker_kernel_min_version": "3.10", "docker_package_info": {"pkg_mgr": "apt", "pkgs": [{"force": true, "name": "{{ docker_versioned_pkg[docker_version | string] }}"}]}, "docker_repo_info": {"pkg_repo": "apt_repository", "repos": ["deb [arch=amd64] {{ docker_ubuntu_repo_base_url }} bionic stable\n"]}, "docker_repo_key_info": {"pkg_key": "apt_key", "repo_keys": ["9DC858229FC7DD38854AE2D88D81803C0EBFCD88"], "url": "{{ docker_ubuntu_repo_gpgkey }}"}, "docker_versioned_pkg": {"18.03": "docker-ce=18.03.1~ce-3-0~ubuntu", "18.06": "docker-ce=18.06.1~ce~3-0~ubuntu", "edge": "docker-ce=18.06.1~ce~3-0~ubuntu", "latest": "docker-ce", "stable": "docker-ce=18.06.1~ce~3-0~ubuntu"}, "use_docker_engine": false}, "ansible_included_var_files": ["/home/openstack/jetstream_kubespray/roles/container-engine/docker/vars/ubuntu-bionic.yml"], "changed": false, "item": "/home/openstack/jetstream_kubespray/roles/container-engine/docker/vars/../vars/ubuntu-bionic.yml"}
ok: [kube-exp-k8s-node-nf-2] => (item=/home/openstack/jetstream_kubespray/roles/container-engine/docker/vars/../vars/ubuntu-bionic.yml) => {"ansible_facts": {"docker_kernel_min_version": "3.10", "docker_package_info": {"pkg_mgr": "apt", "pkgs": [{"force": true, "name": "{{ docker_versioned_pkg[docker_version | string] }}"}]}, "docker_repo_info": {"pkg_repo": "apt_repository", "repos": ["deb [arch=amd64] {{ docker_ubuntu_repo_base_url }} bionic stable\n"]}, "docker_repo_key_info": {"pkg_key": "apt_key", "repo_keys": ["9DC858229FC7DD38854AE2D88D81803C0EBFCD88"], "url": "{{ docker_ubuntu_repo_gpgkey }}"}, "docker_versioned_pkg": {"18.03": "docker-ce=18.03.1~ce-3-0~ubuntu", "18.06": "docker-ce=18.06.1~ce~3-0~ubuntu", "edge": "docker-ce=18.06.1~ce~3-0~ubuntu", "latest": "docker-ce", "stable": "docker-ce=18.06.1~ce~3-0~ubuntu"}, "use_docker_engine": false}, "ansible_included_var_files": ["/home/openstack/jetstream_kubespray/roles/container-engine/docker/vars/ubuntu-bionic.yml"], "changed": false, "item": "/home/openstack/jetstream_kubespray/roles/container-engine/docker/vars/../vars/ubuntu-bionic.yml"}
TASK [container-engine/docker : Warn about Docker version on SUSE] *********************************************************************
Monday 11 March 2019 18:54:41 +0000 (0:00:00.274) 0:02:46.623 **********
TASK [container-engine/docker : include_tasks] *****************************************************************************************
Monday 11 March 2019 18:54:41 +0000 (0:00:00.155) 0:02:46.779 **********
TASK [container-engine/docker : check for minimum kernel version] **********************************************************************
Monday 11 March 2019 18:54:41 +0000 (0:00:00.162) 0:02:46.941 **********
TASK [container-engine/docker : Ensure old versions of Docker are not installed. | Debian] *********************************************
Monday 11 March 2019 18:54:41 +0000 (0:00:00.152) 0:02:47.094 **********
ok: [kube-exp-k8s-node-nf-1] => (item=docker) => {"changed": false, "item": "docker"}
ok: [kube-exp-k8s-node-nf-1] => (item=docker-engine) => {"changed": false, "item": "docker-engine"}
ok: [kube-exp-k8s-node-nf-1] => (item=docker.io) => {"changed": false, "item": "docker.io"}
changed: [kube-exp-k8s-node-nf-2] => (item=docker) => {"changed": true, "item": "docker", "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic\n linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n docker\n0 upgraded, 0 newly installed, 1 to remove and 23 not upgraded.\nAfter this operation, 45.1 kB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 156172 files and directories currently installed.)\r\nRemoving docker (1.5-1build1) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " grub-pc-bin linux-headers-4.15.0-42 linux-headers-4.15.0-42-generic", " linux-image-4.15.0-42-generic linux-modules-4.15.0-42-generic", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " docker", "0 upgraded, 0 newly installed, 1 to remove and 23 not upgraded.", "After this operation, 45.1 kB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 156172 files and directories currently installed.)", "Removing docker (1.5-1build1) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ..."]}
ok: [kube-exp-k8s-node-nf-2] => (item=docker-engine) => {"changed": false, "item": "docker-engine"}
changed: [kube-exp-k8s-node-nf-2] => (item=docker.io) => {"changed": true, "item": "docker.io", "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n bridge-utils cgroupfs-mount grub-pc-bin linux-headers-4.15.0-42\n linux-headers-4.15.0-42-generic linux-image-4.15.0-42-generic\n linux-modules-4.15.0-42-generic pigz ubuntu-fan\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n docker.io\n0 upgraded, 0 newly installed, 1 to remove and 23 not upgraded.\nAfter this operation, 197 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 156165 files and directories currently installed.)\r\nRemoving docker.io (18.06.1-0ubuntu1.2~18.04.1) ...\r\n'/usr/share/docker.io/contrib/nuke-graph-directory.sh' -> '/var/lib/docker/nuke-graph-directory.sh'\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " bridge-utils cgroupfs-mount grub-pc-bin linux-headers-4.15.0-42", " linux-headers-4.15.0-42-generic linux-image-4.15.0-42-generic", " linux-modules-4.15.0-42-generic pigz ubuntu-fan", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " docker.io", "0 upgraded, 0 newly installed, 1 to remove and 23 not upgraded.", "After this operation, 197 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 156165 files and directories currently installed.)", "Removing docker.io (18.06.1-0ubuntu1.2~18.04.1) ...", "'/usr/share/docker.io/contrib/nuke-graph-directory.sh' -> '/var/lib/docker/nuke-graph-directory.sh'", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ..."]}
TASK [container-engine/docker : Ensure old versions of Docker are not installed. | RedHat] *********************************************
Monday 11 March 2019 18:54:58 +0000 (0:00:16.850) 0:03:03.945 **********
TASK [container-engine/docker : ensure docker-ce repository public key is installed] ***************************************************
Monday 11 March 2019 18:54:59 +0000 (0:00:00.550) 0:03:04.496 **********
ok: [kube-exp-k8s-node-nf-1] => (item=9DC858229FC7DD38854AE2D88D81803C0EBFCD88) => {"attempts": 1, "changed": false, "item": "9DC858229FC7DD38854AE2D88D81803C0EBFCD88"}
changed: [kube-exp-k8s-node-nf-2] => (item=9DC858229FC7DD38854AE2D88D81803C0EBFCD88) => {"attempts": 1, "changed": true, "item": "9DC858229FC7DD38854AE2D88D81803C0EBFCD88"}
TASK [container-engine/docker : ensure docker-ce repository is enabled] ****************************************************************
Monday 11 March 2019 18:55:01 +0000 (0:00:02.240) 0:03:06.737 **********
ok: [kube-exp-k8s-node-nf-1] => (item=deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable
) => {"changed": false, "item": "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable\n", "repo": "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable\n", "state": "present"}
changed: [kube-exp-k8s-node-nf-2] => (item=deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable
) => {"changed": true, "item": "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable\n", "repo": "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable\n", "state": "present"}
TASK [container-engine/docker : ensure docker-engine repository public key is installed] ***********************************************
Monday 11 March 2019 18:55:10 +0000 (0:00:09.017) 0:03:15.754 **********
TASK [container-engine/docker : ensure docker-engine repository is enabled] ************************************************************
Monday 11 March 2019 18:55:10 +0000 (0:00:00.215) 0:03:15.969 **********
TASK [container-engine/docker : Configure docker repository on Fedora] *****************************************************************
Monday 11 March 2019 18:55:10 +0000 (0:00:00.211) 0:03:16.181 **********
TASK [container-engine/docker : Configure docker repository on RedHat/CentOS] **********************************************************
Monday 11 March 2019 18:55:11 +0000 (0:00:00.174) 0:03:16.356 **********
TASK [container-engine/docker : Copy yum.conf for editing] *****************************************************************************
Monday 11 March 2019 18:55:11 +0000 (0:00:00.177) 0:03:16.534 **********
TASK [container-engine/docker : Edit copy of yum.conf to set obsoletes=0] **************************************************************
Monday 11 March 2019 18:55:11 +0000 (0:00:00.161) 0:03:16.695 **********
TASK [container-engine/docker : ensure docker packages are installed] ******************************************************************
Monday 11 March 2019 18:55:11 +0000 (0:00:00.141) 0:03:16.837 **********
ok: [kube-exp-k8s-node-nf-1] => (item={u'force': True, u'name': u'docker-ce=18.06.1~ce~3-0~ubuntu'}) => {"attempts": 1, "cache_update_time": 1552330515, "cache_updated": true, "changed": false, "item": {"force": true, "name": "docker-ce=18.06.1~ce~3-0~ubuntu"}}
changed: [kube-exp-k8s-node-nf-2] => (item={u'force': True, u'name': u'docker-ce=18.06.1~ce~3-0~ubuntu'}) => {"attempts": 1, "cache_update_time": 1552330513, "cache_updated": true, "changed": true, "item": {"force": true, "name": "docker-ce=18.06.1~ce~3-0~ubuntu"}, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n bridge-utils grub-pc-bin linux-headers-4.15.0-42\n linux-headers-4.15.0-42-generic linux-image-4.15.0-42-generic\n linux-modules-4.15.0-42-generic ubuntu-fan\nUse 'sudo apt autoremove' to remove them.\nThe following NEW packages will be installed:\n docker-ce\n0 upgraded, 1 newly installed, 0 to remove and 23 not upgraded.\nNeed to get 40.2 MB of archives.\nAfter this operation, 198 MB of additional disk space will be used.\nGet:1 https://download.docker.com/linux/ubuntu bionic/stable amd64 docker-ce amd64 18.06.1~ce~3-0~ubuntu [40.2 MB]\nFetched 40.2 MB in 1s (36.7 MB/s)\nSelecting previously unselected package docker-ce.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 155967 files and directories currently installed.)\r\nPreparing to unpack .../docker-ce_18.06.1~ce~3-0~ubuntu_amd64.deb ...\r\nUnpacking docker-ce (18.06.1~ce~3-0~ubuntu) ...\r\nSetting up docker-ce (18.06.1~ce~3-0~ubuntu) ...\r\nInstalling new version of config file /etc/init.d/docker ...\r\nInstalling new version of config file /etc/init/docker.conf ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for ureadahead (0.100.0-20) ...\r\nProcessing triggers for systemd (237-3ubuntu10.13) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " bridge-utils grub-pc-bin linux-headers-4.15.0-42", " linux-headers-4.15.0-42-generic linux-image-4.15.0-42-generic", " linux-modules-4.15.0-42-generic ubuntu-fan", "Use 'sudo apt autoremove' to remove them.", "The following NEW packages will be installed:", " docker-ce", "0 upgraded, 1 newly installed, 0 to remove and 23 not upgraded.", "Need to get 40.2 MB of archives.", "After this operation, 198 MB of additional disk space will be used.", "Get:1 https://download.docker.com/linux/ubuntu bionic/stable amd64 docker-ce amd64 18.06.1~ce~3-0~ubuntu [40.2 MB]", "Fetched 40.2 MB in 1s (36.7 MB/s)", "Selecting previously unselected package docker-ce.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 155967 files and directories currently installed.)", "Preparing to unpack .../docker-ce_18.06.1~ce~3-0~ubuntu_amd64.deb ...", "Unpacking docker-ce (18.06.1~ce~3-0~ubuntu) ...", "Setting up docker-ce (18.06.1~ce~3-0~ubuntu) ...", "Installing new version of config file /etc/init.d/docker ...", "Installing new version of config file /etc/init/docker.conf ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for ureadahead (0.100.0-20) ...", "Processing triggers for systemd (237-3ubuntu10.13) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ..."]}
TASK [container-engine/docker : get available packages on Ubuntu] **********************************************************************
Monday 11 March 2019 18:55:45 +0000 (0:00:33.931) 0:03:50.769 **********
TASK [container-engine/docker : show available packages on ubuntu] *********************************************************************
Monday 11 March 2019 18:55:45 +0000 (0:00:00.182) 0:03:50.951 **********
TASK [container-engine/docker : Set docker pin priority to apt_preferences on Debian family] *******************************************
Monday 11 March 2019 18:55:45 +0000 (0:00:00.173) 0:03:51.124 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "acd87895af22b9d6cde191838650b769441e2809", "dest": "/etc/apt/preferences.d/docker", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/docker", "size": 58, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "acd87895af22b9d6cde191838650b769441e2809", "dest": "/etc/apt/preferences.d/docker", "gid": 0, "group": "root", "md5sum": "680b72b54bb4e12c9a20cb27240eeb3a", "mode": "0644", "owner": "root", "size": 58, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330546.09-91784698952711/source", "state": "file", "uid": 0}
TASK [container-engine/docker : ensure service is started if docker packages are already present] **************************************
Monday 11 March 2019 18:55:48 +0000 (0:00:02.216) 0:03:53.341 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2019-03-08 22:44:26 UTC", "ActiveEnterTimestampMonotonic": "1114410909", "ActiveExitTimestamp": "Fri 2019-03-08 22:44:16 UTC", "ActiveExitTimestampMonotonic": "1104811716", "ActiveState": "active", "After": "sysinit.target docker.socket basic.target system.slice network.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2019-03-08 22:44:17 UTC", "AssertTimestampMonotonic": "1105832415", "Before": "kubelet.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2019-03-08 22:44:17 UTC", "ConditionTimestampMonotonic": "1105832415", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "http://docs.docker.com", "DropInPaths": "/etc/systemd/system/docker.service.d/docker-options.conf", "DynamicUser": "no", "Environment": "GOTRACEBACK=crash [unprintable]", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "15198", "ExecMainStartTimestamp": "Fri 2019-03-08 22:44:17 UTC", "ExecMainStartTimestampMonotonic": "1105834141", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd $DOCKER_OPTS $DOCKER_STORAGE_OPTIONS $DOCKER_NETWORK_OPTIONS $DOCKER_DNS_OPTIONS $INSECURE_REGISTRY ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2019-03-08 22:44:17 UTC", "InactiveEnterTimestampMonotonic": "1105823504", "InactiveExitTimestamp": "Fri 2019-03-08 22:44:17 UTC", "InactiveExitTimestampMonotonic": "1105834250", "InvocationID": "ffa52e67bc304eb18a35c764cdbf4298", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "1048576", "LimitNOFILESoft": "1048576", "LimitNPROC": "1048576", "LimitNPROCSoft": "1048576", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "15198", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "on-failure", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2019-03-08 22:44:26 UTC", "StateChangeTimestampMonotonic": "1114410909", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "0", "TasksMax": "infinity", "TimeoutStartUSec": "1min", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "docker.socket", "WatchdogTimestamp": "Fri 2019-03-08 22:44:26 UTC", "WatchdogTimestampMonotonic": "1114410906", "WatchdogUSec": "0"}}
 [WARNING]: flush_handlers task does not support when conditional

RUNNING HANDLER [container-engine/docker : restart docker] *****************************************************************************
Monday 11 March 2019 18:55:48 +0000 (0:00:00.718) 0:03:54.059 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["/bin/true"], "delta": "0:00:00.003292", "end": "2019-03-11 18:55:49.432986", "rc": 0, "start": "2019-03-11 18:55:49.429694", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [container-engine/docker : Docker | reload systemd] ********************************************************************
Monday 11 March 2019 18:55:49 +0000 (0:00:00.907) 0:03:54.966 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": "systemctl daemon-reload", "delta": "0:00:00.170282", "end": "2019-03-11 18:55:50.420849", "rc": 0, "start": "2019-03-11 18:55:50.250567", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [container-engine/docker : Docker | reload docker.socket] **************************************************************
Monday 11 March 2019 18:55:50 +0000 (0:00:00.727) 0:03:55.694 **********
RUNNING HANDLER [container-engine/docker : Docker | reload docker] *********************************************************************
Monday 11 March 2019 18:55:50 +0000 (0:00:00.130) 0:03:55.824 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 18:55:38 UTC", "ActiveEnterTimestampMonotonic": "1075794020", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "firewalld.service systemd-journald.socket network-online.target basic.target docker.socket system.slice sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 18:55:30 UTC", "AssertTimestampMonotonic": "1067259624", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 18:55:30 UTC", "ConditionTimestampMonotonic": "1067259623", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "12678", "ExecMainStartTimestamp": "Mon 2019-03-11 18:55:30 UTC", "ExecMainStartTimestampMonotonic": "1067260628", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-03-11 18:55:30 UTC", "InactiveExitTimestampMonotonic": "1067260687", "InvocationID": "332af99f041144e3a725d3fa39c4a611", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "1048576", "LimitNOFILESoft": "1048576", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "12678", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "on-failure", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 18:55:38 UTC", "StateChangeTimestampMonotonic": "1075794020", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "35", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target", "WatchdogTimestamp": "Mon 2019-03-11 18:55:38 UTC", "WatchdogTimestampMonotonic": "1075794017", "WatchdogUSec": "0"}}
RUNNING HANDLER [container-engine/docker : Docker | pause while Docker restarts] *******************************************************
Monday 11 March 2019 18:56:00 +0000 (0:00:09.917) 0:04:05.741 **********
Pausing for 10 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
[container-engine/docker : Docker | pause while Docker restarts]
Waiting for docker restart:
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2019-03-11 18:56:00.729561", "stderr": "", "stdout": "Paused for 10.0 seconds", "stop": "2019-03-11 18:56:10.729919", "user_input": ""}
RUNNING HANDLER [container-engine/docker : Docker | wait for docker] *******************************************************************
Monday 11 March 2019 18:56:10 +0000 (0:00:10.201) 0:04:15.943 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "images"], "delta": "0:00:00.127478", "end": "2019-03-11 18:56:11.478781", "rc": 0, "start": "2019-03-11 18:56:11.351303", "stderr": "", "stderr_lines": [], "stdout": "REPOSITORY TAG IMAGE ID CREATED SIZE", "stdout_lines": ["REPOSITORY TAG IMAGE ID CREATED SIZE"]}
TASK [container-engine/docker : set fact for docker_version] ***************************************************************************
Monday 11 March 2019 18:56:11 +0000 (0:00:00.892) 0:04:16.835 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": ["docker", "version", "-f", "{{.Client.Version}}"], "delta": "0:00:00.109316", "end": "2019-03-11 18:56:12.277561", "rc": 0, "start": "2019-03-11 18:56:12.168245", "stderr": "", "stderr_lines": [], "stdout": "18.06.1-ce", "stdout_lines": ["18.06.1-ce"]}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": ["docker", "version", "-f", "{{.Client.Version}}"], "delta": "0:00:00.101076", "end": "2019-03-11 18:56:12.320386", "rc": 0, "start": "2019-03-11 18:56:12.219310", "stderr": "", "stderr_lines": [], "stdout": "18.06.1-ce", "stdout_lines": ["18.06.1-ce"]}
TASK [container-engine/docker : check minimum docker version for docker_dns mode. You need at least docker version >= 1.12 for resolvconf_mode=docker_dns] ***
Monday 11 March 2019 18:56:12 +0000 (0:00:00.871) 0:04:17.707 **********
TASK [container-engine/docker : Create docker service systemd directory if it doesn't exist] *******************************************
Monday 11 March 2019 18:56:12 +0000 (0:00:00.163) 0:04:17.871 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/systemd/system/docker.service.d", "size": 4096, "state": "directory", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/systemd/system/docker.service.d", "size": 4096, "state": "directory", "uid": 0}
TASK [container-engine/docker : Write docker proxy drop-in] ****************************************************************************
Monday 11 March 2019 18:56:13 +0000 (0:00:00.755) 0:04:18.626 **********
TASK [container-engine/docker : get systemd version] ***********************************************************************************
Monday 11 March 2019 18:56:13 +0000 (0:00:00.194) 0:04:18.821 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": "systemctl --version | head -n 1 | cut -d \" \" -f 2", "delta": "0:00:00.010531", "end": "2019-03-11 18:56:14.205951", "rc": 0, "start": "2019-03-11 18:56:14.195420", "stderr": "", "stderr_lines": [], "stdout": "237", "stdout_lines": ["237"]}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": "systemctl --version | head -n 1 | cut -d \" \" -f 2", "delta": "0:00:00.009279", "end": "2019-03-11 18:56:14.237361", "rc": 0, "start": "2019-03-11 18:56:14.228082", "stderr": "", "stderr_lines": [], "stdout": "237", "stdout_lines": ["237"]}
TASK [container-engine/docker : Write docker.service systemd file] *********************************************************************
Monday 11 March 2019 18:56:14 +0000 (0:00:00.802) 0:04:19.623 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "3bfad7373a69c5f22c73c6122aaa64c425287f71", "dest": "/etc/systemd/system/docker.service", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/systemd/system/docker.service", "size": 702, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "3bfad7373a69c5f22c73c6122aaa64c425287f71", "dest": "/etc/systemd/system/docker.service", "gid": 0, "group": "root", "md5sum": "f9a357de22baf1b57b7e4a8f9a544616", "mode": "0644", "owner": "root", "size": 702, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330574.67-52959041193488/source", "state": "file", "uid": 0}
TASK [container-engine/docker : Write docker options systemd drop-in] ******************************************************************
Monday 11 March 2019 18:56:16 +0000 (0:00:02.285) 0:04:21.909 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "75b0d34cd7c8ea384a129e671a67554d1078b48a", "dest": "/etc/systemd/system/docker.service.d/docker-options.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/systemd/system/docker.service.d/docker-options.conf", "size": 127, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "75b0d34cd7c8ea384a129e671a67554d1078b48a", "dest": "/etc/systemd/system/docker.service.d/docker-options.conf", "gid": 0, "group": "root", "md5sum": "0f1fd1b6086ef8295cc970b63247f234", "mode": "0644", "owner": "root", "size": 127, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330576.94-118333066368647/source", "state": "file", "uid": 0}
TASK [container-engine/docker : Write docker dns systemd drop-in] **********************************************************************
Monday 11 March 2019 18:56:18 +0000 (0:00:02.212) 0:04:24.121 **********
TASK [container-engine/docker : Copy docker orphan clean up script to the node] ********************************************************
Monday 11 March 2019 18:56:19 +0000 (0:00:00.193) 0:04:24.315 **********
TASK [container-engine/docker : Write docker orphan clean up systemd drop-in] **********************************************************
Monday 11 March 2019 18:56:19 +0000 (0:00:00.243) 0:04:24.559 **********
RUNNING HANDLER [container-engine/docker : restart docker] *****************************************************************************
Monday 11 March 2019 18:56:19 +0000 (0:00:00.226) 0:04:24.786 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["/bin/true"], "delta": "0:00:00.003306", "end": "2019-03-11 18:56:20.103826", "rc": 0, "start": "2019-03-11 18:56:20.100520", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [container-engine/docker : Docker | reload systemd] ********************************************************************
Monday 11 March 2019 18:56:20 +0000 (0:00:00.848) 0:04:25.635 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": "systemctl daemon-reload", "delta": "0:00:00.174149", "end": "2019-03-11 18:56:21.076019", "rc": 0, "start": "2019-03-11 18:56:20.901870", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [container-engine/docker : Docker | reload docker.socket] **************************************************************
Monday 11 March 2019 18:56:21 +0000 (0:00:00.709) 0:04:26.344 **********
RUNNING HANDLER [container-engine/docker : Docker | reload docker] *********************************************************************
Monday 11 March 2019 18:56:21 +0000 (0:00:00.119) 0:04:26.464 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 18:56:00 UTC", "ActiveEnterTimestampMonotonic": "1097672601", "ActiveExitTimestamp": "Mon 2019-03-11 18:55:51 UTC", "ActiveExitTimestampMonotonic": "1088508588", "ActiveState": "active", "After": "sysinit.target network.target basic.target system.slice docker.socket systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 18:55:52 UTC", "AssertTimestampMonotonic": "1089525900", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 18:55:52 UTC", "ConditionTimestampMonotonic": "1089525899", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "http://docs.docker.com", "DropInPaths": "/etc/systemd/system/docker.service.d/docker-options.conf", "DynamicUser": "no", "Environment": "GOTRACEBACK=crash [unprintable]", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "13815", "ExecMainStartTimestamp": "Mon 2019-03-11 18:55:52 UTC", "ExecMainStartTimestampMonotonic": "1089527593", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd $DOCKER_OPTS $DOCKER_STORAGE_OPTIONS $DOCKER_NETWORK_OPTIONS $DOCKER_DNS_OPTIONS $INSECURE_REGISTRY ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2019-03-11 18:55:52 UTC", "InactiveEnterTimestampMonotonic": "1089516649", "InactiveExitTimestamp": "Mon 2019-03-11 18:55:52 UTC", "InactiveExitTimestampMonotonic": "1089527677", "InvocationID": "5d8f5cec206248ab81f9bd3a2970c966", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "1048576", "LimitNOFILESoft": "1048576", "LimitNPROC": "1048576", "LimitNPROCSoft": "1048576", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "13815", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "on-failure", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 18:56:00 UTC", "StateChangeTimestampMonotonic": "1097672601", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "34", "TasksMax": "infinity", "TimeoutStartUSec": "1min", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "docker.socket", "WatchdogTimestamp": "Mon 2019-03-11 18:56:00 UTC", "WatchdogTimestampMonotonic": "1097672598", "WatchdogUSec": "0"}}
RUNNING HANDLER [container-engine/docker : Docker | pause while Docker restarts] *******************************************************
Monday 11 March 2019 18:56:27 +0000 (0:00:06.383) 0:04:32.848 **********
Pausing for 10 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
[container-engine/docker : Docker | pause while Docker restarts]
Waiting for docker restart:
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "delta": 10, "echo": true, "rc": 0, "start": "2019-03-11 18:56:27.835869", "stderr": "", "stdout": "Paused for 10.0 seconds", "stop": "2019-03-11 18:56:37.836294", "user_input": ""}
RUNNING HANDLER [container-engine/docker : Docker | wait for docker] *******************************************************************
Monday 11 March 2019 18:56:37 +0000 (0:00:10.201) 0:04:43.049 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "images"], "delta": "0:00:00.106810", "end": "2019-03-11 18:56:38.554500", "rc": 0, "start": "2019-03-11 18:56:38.447690", "stderr": "", "stderr_lines": [], "stdout": "REPOSITORY TAG IMAGE ID CREATED SIZE", "stdout_lines": ["REPOSITORY TAG IMAGE ID CREATED SIZE"]}
TASK [container-engine/docker : ensure docker service is started and enabled] **********************************************************
Monday 11 March 2019 18:56:38 +0000 (0:00:00.865) 0:04:43.915 **********
ok: [kube-exp-k8s-node-nf-1] => (item=docker) => {"changed": false, "enabled": true, "item": "docker", "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2019-03-08 22:44:26 UTC", "ActiveEnterTimestampMonotonic": "1114410909", "ActiveExitTimestamp": "Fri 2019-03-08 22:44:16 UTC", "ActiveExitTimestampMonotonic": "1104811716", "ActiveState": "active", "After": "sysinit.target docker.socket basic.target system.slice network.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2019-03-08 22:44:17 UTC", "AssertTimestampMonotonic": "1105832415", "Before": "kubelet.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2019-03-08 22:44:17 UTC", "ConditionTimestampMonotonic": "1105832415", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "http://docs.docker.com", "DropInPaths": "/etc/systemd/system/docker.service.d/docker-options.conf", "DynamicUser": "no", "Environment": "GOTRACEBACK=crash [unprintable]", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "15198", "ExecMainStartTimestamp": "Fri 2019-03-08 22:44:17 UTC", "ExecMainStartTimestampMonotonic": "1105834141", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd $DOCKER_OPTS $DOCKER_STORAGE_OPTIONS $DOCKER_NETWORK_OPTIONS $DOCKER_DNS_OPTIONS $INSECURE_REGISTRY ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2019-03-08 22:44:17 UTC", "InactiveEnterTimestampMonotonic": "1105823504", "InactiveExitTimestamp": "Fri 2019-03-08 22:44:17 UTC", "InactiveExitTimestampMonotonic": "1105834250", "InvocationID": "ffa52e67bc304eb18a35c764cdbf4298", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "1048576", "LimitNOFILESoft": "1048576", "LimitNPROC": "1048576", "LimitNPROCSoft": "1048576", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "15198", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "on-failure", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2019-03-08 22:44:26 UTC", "StateChangeTimestampMonotonic": "1114410909", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "0", "TasksMax": "infinity", "TimeoutStartUSec": "1min", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "docker.socket", "WatchdogTimestamp": "Fri 2019-03-08 22:44:26 UTC", "WatchdogTimestampMonotonic": "1114410906", "WatchdogUSec": "0"}}
ok: [kube-exp-k8s-node-nf-2] => (item=docker) => {"changed": false, "enabled": true, "item": "docker", "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 18:56:27 UTC", "ActiveEnterTimestampMonotonic": "1124779610", "ActiveExitTimestamp": "Mon 2019-03-11 18:56:21 UTC", "ActiveExitTimestampMonotonic": "1119144647", "ActiveState": "active", "After": "sysinit.target network.target basic.target system.slice docker.socket systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 18:56:22 UTC", "AssertTimestampMonotonic": "1120163756", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 18:56:22 UTC", "ConditionTimestampMonotonic": "1120163756", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "http://docs.docker.com", "DropInPaths": "/etc/systemd/system/docker.service.d/docker-options.conf", "DynamicUser": "no", "Environment": "GOTRACEBACK=crash [unprintable]", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "14141", "ExecMainStartTimestamp": "Mon 2019-03-11 18:56:22 UTC", "ExecMainStartTimestampMonotonic": "1120165477", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd $DOCKER_OPTS $DOCKER_STORAGE_OPTIONS $DOCKER_NETWORK_OPTIONS $DOCKER_DNS_OPTIONS $INSECURE_REGISTRY ; ignore_errors=no ; start_time=[Mon 2019-03-11 18:56:22 UTC] ; stop_time=[n/a] ; pid=14141 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2019-03-11 18:56:22 UTC", "InactiveEnterTimestampMonotonic": "1120154780", "InactiveExitTimestamp": "Mon 2019-03-11 18:56:22 UTC", "InactiveExitTimestampMonotonic": "1120165596", "InvocationID": "bb2daa06d9ea47c686bee3c0054fdde4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "1048576", "LimitNOFILESoft": "1048576", "LimitNPROC": "1048576", "LimitNPROCSoft": "1048576", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "14141", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "on-failure", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 18:56:27 UTC", "StateChangeTimestampMonotonic": "1124779610", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "37", "TasksMax": "infinity", "TimeoutStartUSec": "1min", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "docker.socket", "WatchdogTimestamp": "Mon 2019-03-11 18:56:27 UTC", "WatchdogTimestampMonotonic": "1124779607", "WatchdogUSec": "0"}}
TASK [download : include_tasks] ********************************************************************************************************
Monday 11 March 2019 18:56:39 +0000 (0:00:00.824) 0:04:44.740 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_prep.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:56:39 +0000 (0:00:00.263) 0:04:45.004 **********
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : container_download | Create dest directory for saved/loaded container images] *****************************************
Monday 11 March 2019 18:56:40 +0000 (0:00:00.820) 0:04:45.824 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases/containers", "size": 4096, "state": "directory", "uid": 1000}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases/containers", "size": 4096, "state": "directory", "uid": 1000}
TASK [download : container_download | create local directory for saved/loaded container images] ****************************************
Monday 11 March 2019 18:56:41 +0000 (0:00:00.657) 0:04:46.482 **********
TASK [download : Download items] *******************************************************************************************************
Monday 11 March 2019 18:56:41 +0000 (0:00:00.137) 0:04:46.619 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'dnsautoscaler', 'value': {u'container': True, u'enabled': True, u'repo': u'gcr.io/google_containers/cluster-proportional-autoscaler-amd64', u'tag': u'1.3.0', u'groups': [u'kube-node'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'pod_infra', 'value': {u'container': True, u'enabled': True, u'repo': u'gcr.io/google_containers/pause-amd64', u'tag': u'3.1', u'groups': [u'k8s-cluster'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'etcd', 'value': {u'unarchive': True, u'container': True, u'groups': [u'etcd'], u'dest': u'/tmp/releases/etcd-v3.2.24-linux-amd64.tar.gz', u'version': u'v3.2.24', u'enabled': True, u'repo': u'quay.io/coreos/etcd', u'url': u'https://github.com/coreos/etcd/releases/download/v3.2.24/etcd-v3.2.24-linux-amd64.tar.gz', u'tag': u'v3.2.24', u'mode': u'0755', u'file': False, u'owner': u'root', u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'helm', 'value': {u'container': True, u'enabled': True, u'repo': u'lachlanevenson/k8s-helm', u'tag': u'v2.11.0', u'groups': [u'kube-node'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_file.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'kubeadm', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/kubeadm', u'enabled': True, u'url': u'https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/kubeadm', u'version': u'v1.12.5', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'd61730b3deb4d9825af0cc1e452a4be2292400507128279770c39669f6599af9'}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'flannel_cni', 'value': {u'container': True, u'enabled': True, u'repo': u'quay.io/coreos/flannel-cni', u'tag': u'v0.3.0', u'groups': [u'k8s-cluster'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'nginx', 'value': {u'container': True, u'enabled': True, u'repo': u'nginx', u'tag': 1.13, u'groups': [u'kube-node'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'tiller', 'value': {u'container': True, u'enabled': True, u'repo': u'gcr.io/kubernetes-helm/tiller', u'tag': u'v2.11.0', u'groups': [u'kube-node'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'flannel', 'value': {u'container': True, u'enabled': True, u'repo': u'quay.io/coreos/flannel', u'tag': u'v0.10.0', u'groups': [u'k8s-cluster'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'dashboard', 'value': {u'container': True, u'enabled': True, u'repo': u'gcr.io/google_containers/kubernetes-dashboard-amd64', u'tag': u'v1.10.0', u'groups': [u'kube-master'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'calico_policy', 'value': {u'container': True, u'enabled': True, u'repo': u'quay.io/calico/kube-controllers', u'tag': u'v3.1.3', u'groups': [u'k8s-cluster'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'cert_manager_controller', 'value': {u'container': True, u'enabled': True, u'repo': u'quay.io/jetstack/cert-manager-controller', u'tag': u'v0.5.2', u'groups': [u'kube-node'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'ingress_nginx_controller', 'value': {u'container': True, u'enabled': True, u'repo': u'quay.io/kubernetes-ingress-controller/nginx-ingress-controller', u'tag': u'0.21.0', u'groups': [u'kube-node'], u'sha256': u''}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_file.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'hyperkube_file', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/hyperkube', u'enabled': True, u'url': u'https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/hyperkube', u'version': u'v1.12.5', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'f8b651816b2caa33e8b25a666e5c370e9786356d59f89579bba772f28370ed00'}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_file.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'cni', 'value': {u'unarchive': False, u'file': True, u'dest': u'/tmp/releases/cni-plugins-amd64-v0.6.0.tgz', u'enabled': True, u'url': u'https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz', u'version': u'v0.6.0', u'mode': u'0755', u'groups': [u'k8s-cluster'], u'owner': u'root', u'sha256': u'f04339a21b8edf76d415e7f17b620e63b8f37a76b2f706671587ab6464411f2d'}})
included: /home/openstack/jetstream_kubespray/roles/download/tasks/download_container.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2 => (item={'key': u'coredns', 'value': {u'container': True, u'enabled': True, u'repo': u'coredns/coredns', u'tag': u'1.2.6', u'groups': [u'kube-node'], u'sha256': u''}})
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:56:43 +0000 (0:00:02.214) 0:04:48.834 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:44 +0000 (0:00:00.505) 0:04:49.340 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:44 +0000 (0:00:00.328) 0:04:49.668 **********
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "gcr.io/google_containers/cluster-proportional-autoscaler-amd64:1.3.0"}, "changed": false}
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "gcr.io/google_containers/cluster-proportional-autoscaler-amd64:1.3.0"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:56:44 +0000 (0:00:00.268) 0:04:49.937 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:45 +0000 (0:00:00.976) 0:04:50.913 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:56:46 +0000 (0:00:00.332) 0:04:51.246 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:56:46 +0000 (0:00:00.232) 0:04:51.479 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:56:46 +0000 (0:00:00.111) 0:04:51.590 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "gcr.io/google_containers/cluster-proportional-autoscaler-amd64:1.3.0"], "delta": "0:00:02.711368", "end": "2019-03-11 18:56:49.690769", "rc": 0, "start": "2019-03-11 18:56:46.979401", "stderr": "", "stderr_lines": [], "stdout": "1.3.0: Pulling from google_containers/cluster-proportional-autoscaler-amd64\na818bc65d708: Pulling fs layer\na818bc65d708: Download complete\na818bc65d708: Pull complete\nDigest: sha256:4fd37c5b29a38b02c408c56254bd1a3a76f3e236610bc7a8382500bbf9ecfc76\nStatus: Downloaded newer image for gcr.io/google_containers/cluster-proportional-autoscaler-amd64:1.3.0", "stdout_lines": ["1.3.0: Pulling from google_containers/cluster-proportional-autoscaler-amd64", "a818bc65d708: Pulling fs layer", "a818bc65d708: Download complete", "a818bc65d708: Pull complete", "Digest: sha256:4fd37c5b29a38b02c408c56254bd1a3a76f3e236610bc7a8382500bbf9ecfc76", "Status: Downloaded newer image for gcr.io/google_containers/cluster-proportional-autoscaler-amd64:1.3.0"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:56:49 +0000 (0:00:03.491) 0:04:55.082 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:50 +0000 (0:00:00.483) 0:04:55.566 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:50 +0000 (0:00:00.324) 0:04:55.890 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "gcr.io/google_containers/pause-amd64:3.1"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "gcr.io/google_containers/pause-amd64:3.1"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:56:50 +0000 (0:00:00.238) 0:04:56.129 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:51 +0000 (0:00:01.032) 0:04:57.162 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:56:52 +0000 (0:00:00.263) 0:04:57.426 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:56:52 +0000 (0:00:00.225) 0:04:57.651 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:56:52 +0000 (0:00:00.131) 0:04:57.782 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "gcr.io/google_containers/pause-amd64:3.1"], "delta": "0:00:01.508310", "end": "2019-03-11 18:56:54.611824", "rc": 0, "start": "2019-03-11 18:56:53.103514", "stderr": "", "stderr_lines": [], "stdout": "3.1: Pulling from google_containers/pause-amd64\n67ddbfb20a22: Pulling fs layer\n67ddbfb20a22: Verifying Checksum\n67ddbfb20a22: Download complete\n67ddbfb20a22: Pull complete\nDigest: sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610\nStatus: Downloaded newer image for gcr.io/google_containers/pause-amd64:3.1", "stdout_lines": ["3.1: Pulling from google_containers/pause-amd64", "67ddbfb20a22: Pulling fs layer", "67ddbfb20a22: Verifying Checksum", "67ddbfb20a22: Download complete", "67ddbfb20a22: Pull complete", "Digest: sha256:59eec8837a4d942cc19a52b8c09ea75121acc38114a2c68b98983ce9356b8610", "Status: Downloaded newer image for gcr.io/google_containers/pause-amd64:3.1"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:56:54 +0000 (0:00:02.274) 0:05:00.057 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:55 +0000 (0:00:00.448) 0:05:00.506 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:55 +0000 (0:00:00.262) 0:05:00.769 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "quay.io/coreos/etcd:v3.2.24"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "quay.io/coreos/etcd:v3.2.24"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:56:55 +0000 (0:00:00.218) 0:05:00.987 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:56 +0000 (0:00:00.844) 0:05:01.832 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": true}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:56:56 +0000 (0:00:00.277) 0:05:02.110 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:56:57 +0000 (0:00:00.251) 0:05:02.362 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:56:57 +0000 (0:00:00.116) 0:05:02.478 **********
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:56:57 +0000 (0:00:00.256) 0:05:02.734 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:58 +0000 (0:00:00.491) 0:05:03.226 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:58 +0000 (0:00:00.272) 0:05:03.498 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "lachlanevenson/k8s-helm:v2.11.0"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "lachlanevenson/k8s-helm:v2.11.0"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:56:58 +0000 (0:00:00.264) 0:05:03.763 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:56:59 +0000 (0:00:00.908) 0:05:04.672 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:56:59 +0000 (0:00:00.269) 0:05:04.941 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:56:59 +0000 (0:00:00.249) 0:05:05.191 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:57:00 +0000 (0:00:00.131) 0:05:05.323 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "lachlanevenson/k8s-helm:v2.11.0"], "delta": "0:00:04.075379", "end": "2019-03-11 18:57:04.727184", "rc": 0, "start": "2019-03-11 18:57:00.651805", "stderr": "", "stderr_lines": [], "stdout": "v2.11.0: Pulling from lachlanevenson/k8s-helm\n4fe2ade4980c: Pulling fs layer\n617111325000: Pulling fs layer\n4fe2ade4980c: Verifying Checksum\n4fe2ade4980c: Download complete\n617111325000: Verifying Checksum\n617111325000: Download complete\n4fe2ade4980c: Pull complete\n617111325000: Pull complete\nDigest: sha256:9d91041c1c48b6577878e95d734362ac8cd4107f9a507e8e31bef36aad9947b2\nStatus: Downloaded newer image for lachlanevenson/k8s-helm:v2.11.0", "stdout_lines": ["v2.11.0: Pulling from lachlanevenson/k8s-helm", "4fe2ade4980c: Pulling fs layer", "617111325000: Pulling fs layer", "4fe2ade4980c: Verifying Checksum", "4fe2ade4980c: Download complete", "617111325000: Verifying Checksum", "617111325000: Download complete", "4fe2ade4980c: Pull complete", "617111325000: Pull complete", "Digest: sha256:9d91041c1c48b6577878e95d734362ac8cd4107f9a507e8e31bef36aad9947b2", "Status: Downloaded newer image for lachlanevenson/k8s-helm:v2.11.0"]}
TASK [download : file_download | Downloading...] ***************************************************************************************
Monday 11 March 2019 18:57:04 +0000 (0:00:04.802) 0:05:10.125 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "msg": [
 "URL: https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/kubeadm", 
 "Dest: /tmp/releases/kubeadm"
 ]
}
ok: [kube-exp-k8s-node-nf-2] => {
 "msg": [
 "URL: https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/kubeadm", 
 "Dest: /tmp/releases/kubeadm"
 ]
}
TASK [download : file_download | Create dest directory] ********************************************************************************
Monday 11 March 2019 18:57:05 +0000 (0:00:00.266) 0:05:10.392 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases", "size": 4096, "state": "directory", "uid": 1000}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases", "size": 4096, "state": "directory", "uid": 1000}
TASK [download : file_download | Download item] ****************************************************************************************
Monday 11 March 2019 18:57:05 +0000 (0:00:00.695) 0:05:11.087 **********
ok: [kube-exp-k8s-node-nf-1] => {"attempts": 1, "changed": false, "dest": "/tmp/releases/kubeadm", "gid": 0, "group": "root", "mode": "0755", "msg": "file already exists", "owner": "root", "size": 54042659, "state": "file", "uid": 0, "url": "https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/kubeadm"}
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "c62767b492bdf98bf90ead913dfad2e94dec80f4", "dest": "/tmp/releases/kubeadm", "gid": 0, "group": "root", "md5sum": "df9824616d8122262f3e52fd06ebfc23", "mode": "0755", "msg": "OK (54042659 bytes)", "owner": "root", "size": 54042659, "src": "/root/.ansible/tmp/ansible-moduletmp-1552330626.71-WuP4cx/tmphAgroh", "state": "file", "status_code": 200, "uid": 0, "url": "https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/kubeadm"}
TASK [download : file_download | Extract archives] *************************************************************************************
Monday 11 March 2019 18:57:07 +0000 (0:00:01.850) 0:05:12.938 **********
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:57:07 +0000 (0:00:00.254) 0:05:13.193 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:08 +0000 (0:00:00.456) 0:05:13.649 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:08 +0000 (0:00:00.324) 0:05:13.974 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "quay.io/coreos/flannel-cni:v0.3.0"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "quay.io/coreos/flannel-cni:v0.3.0"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:57:09 +0000 (0:00:00.330) 0:05:14.304 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:10 +0000 (0:00:01.028) 0:05:15.333 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:57:10 +0000 (0:00:00.334) 0:05:15.668 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:57:10 +0000 (0:00:00.221) 0:05:15.889 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:57:10 +0000 (0:00:00.117) 0:05:16.007 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "quay.io/coreos/flannel-cni:v0.3.0"], "delta": "0:00:23.699316", "end": "2019-03-11 18:57:35.022749", "rc": 0, "start": "2019-03-11 18:57:11.323433", "stderr": "", "stderr_lines": [], "stdout": "v0.3.0: Pulling from coreos/flannel-cni\nadd3ddb21ede: Pulling fs layer\n114533101008: Pulling fs layer\ne8aefe4c3300: Pulling fs layer\n53dd8766ff50: Pulling fs layer\n886fe0e6a209: Pulling fs layer\nb7b6e786befa: Pulling fs layer\n0678e6c3bbf1: Pulling fs layer\n3f085226af2c: Pulling fs layer\ncb53f6fd41bb: Pulling fs layer\n634f3aaa2eb9: Pulling fs layer\n21e12609b41e: Pulling fs layer\n775f6963ab2f: Pulling fs layer\ned381e0cc19e: Pulling fs layer\ne388b5433db2: Pulling fs layer\nd964a176fb57: Pulling fs layer\na5bd106e94ef: Pulling fs layer\n53dd8766ff50: Waiting\ncb53f6fd41bb: Waiting\n886fe0e6a209: Waiting\n634f3aaa2eb9: Waiting\nb7b6e786befa: Waiting\n21e12609b41e: Waiting\n0678e6c3bbf1: Waiting\n775f6963ab2f: Waiting\n3f085226af2c: Waiting\ned381e0cc19e: Waiting\na5bd106e94ef: Waiting\nd964a176fb57: Waiting\ne388b5433db2: Waiting\nadd3ddb21ede: Verifying Checksum\nadd3ddb21ede: Download complete\ne8aefe4c3300: Verifying Checksum\ne8aefe4c3300: Download complete\n114533101008: Verifying Checksum\n114533101008: Download complete\n53dd8766ff50: Verifying Checksum\n53dd8766ff50: Download complete\n886fe0e6a209: Verifying Checksum\n886fe0e6a209: Download complete\nb7b6e786befa: Download complete\nadd3ddb21ede: Pull complete\n3f085226af2c: Verifying Checksum\n3f085226af2c: Download complete\ncb53f6fd41bb: Verifying Checksum\ncb53f6fd41bb: Download complete\n0678e6c3bbf1: Verifying Checksum\n0678e6c3bbf1: Download complete\n634f3aaa2eb9: Verifying Checksum\n634f3aaa2eb9: Download complete\n21e12609b41e: Verifying Checksum\n21e12609b41e: Download complete\n114533101008: Pull complete\n775f6963ab2f: Verifying Checksum\n775f6963ab2f: Download complete\ned381e0cc19e: Verifying Checksum\ned381e0cc19e: Download complete\nd964a176fb57: Download complete\ne388b5433db2: Verifying Checksum\ne388b5433db2: Download complete\na5bd106e94ef: Verifying Checksum\na5bd106e94ef: Download complete\ne8aefe4c3300: Pull complete\n53dd8766ff50: Pull complete\n886fe0e6a209: Pull complete\nb7b6e786befa: Pull complete\n0678e6c3bbf1: Pull complete\n3f085226af2c: Pull complete\ncb53f6fd41bb: Pull complete\n634f3aaa2eb9: Pull complete\n21e12609b41e: Pull complete\n775f6963ab2f: Pull complete\ned381e0cc19e: Pull complete\ne388b5433db2: Pull complete\nd964a176fb57: Pull complete\na5bd106e94ef: Pull complete\nDigest: sha256:734b4222110980abd0abe74974b6ca36452d26bdd2a20e25f37fdf7fdc2da170\nStatus: Downloaded newer image for quay.io/coreos/flannel-cni:v0.3.0", "stdout_lines": ["v0.3.0: Pulling from coreos/flannel-cni", "add3ddb21ede: Pulling fs layer", "114533101008: Pulling fs layer", "e8aefe4c3300: Pulling fs layer", "53dd8766ff50: Pulling fs layer", "886fe0e6a209: Pulling fs layer", "b7b6e786befa: Pulling fs layer", "0678e6c3bbf1: Pulling fs layer", "3f085226af2c: Pulling fs layer", "cb53f6fd41bb: Pulling fs layer", "634f3aaa2eb9: Pulling fs layer", "21e12609b41e: Pulling fs layer", "775f6963ab2f: Pulling fs layer", "ed381e0cc19e: Pulling fs layer", "e388b5433db2: Pulling fs layer", "d964a176fb57: Pulling fs layer", "a5bd106e94ef: Pulling fs layer", "53dd8766ff50: Waiting", "cb53f6fd41bb: Waiting", "886fe0e6a209: Waiting", "634f3aaa2eb9: Waiting", "b7b6e786befa: Waiting", "21e12609b41e: Waiting", "0678e6c3bbf1: Waiting", "775f6963ab2f: Waiting", "3f085226af2c: Waiting", "ed381e0cc19e: Waiting", "a5bd106e94ef: Waiting", "d964a176fb57: Waiting", "e388b5433db2: Waiting", "add3ddb21ede: Verifying Checksum", "add3ddb21ede: Download complete", "e8aefe4c3300: Verifying Checksum", "e8aefe4c3300: Download complete", "114533101008: Verifying Checksum", "114533101008: Download complete", "53dd8766ff50: Verifying Checksum", "53dd8766ff50: Download complete", "886fe0e6a209: Verifying Checksum", "886fe0e6a209: Download complete", "b7b6e786befa: Download complete", "add3ddb21ede: Pull complete", "3f085226af2c: Verifying Checksum", "3f085226af2c: Download complete", "cb53f6fd41bb: Verifying Checksum", "cb53f6fd41bb: Download complete", "0678e6c3bbf1: Verifying Checksum", "0678e6c3bbf1: Download complete", "634f3aaa2eb9: Verifying Checksum", "634f3aaa2eb9: Download complete", "21e12609b41e: Verifying Checksum", "21e12609b41e: Download complete", "114533101008: Pull complete", "775f6963ab2f: Verifying Checksum", "775f6963ab2f: Download complete", "ed381e0cc19e: Verifying Checksum", "ed381e0cc19e: Download complete", "d964a176fb57: Download complete", "e388b5433db2: Verifying Checksum", "e388b5433db2: Download complete", "a5bd106e94ef: Verifying Checksum", "a5bd106e94ef: Download complete", "e8aefe4c3300: Pull complete", "53dd8766ff50: Pull complete", "886fe0e6a209: Pull complete", "b7b6e786befa: Pull complete", "0678e6c3bbf1: Pull complete", "3f085226af2c: Pull complete", "cb53f6fd41bb: Pull complete", "634f3aaa2eb9: Pull complete", "21e12609b41e: Pull complete", "775f6963ab2f: Pull complete", "ed381e0cc19e: Pull complete", "e388b5433db2: Pull complete", "d964a176fb57: Pull complete", "a5bd106e94ef: Pull complete", "Digest: sha256:734b4222110980abd0abe74974b6ca36452d26bdd2a20e25f37fdf7fdc2da170", "Status: Downloaded newer image for quay.io/coreos/flannel-cni:v0.3.0"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:57:35 +0000 (0:00:24.440) 0:05:40.447 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:35 +0000 (0:00:00.455) 0:05:40.903 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:35 +0000 (0:00:00.263) 0:05:41.167 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "nginx:1.13"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "nginx:1.13"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:57:36 +0000 (0:00:00.267) 0:05:41.434 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:37 +0000 (0:00:00.901) 0:05:42.336 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:57:37 +0000 (0:00:00.267) 0:05:42.603 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:57:37 +0000 (0:00:00.211) 0:05:42.814 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:57:37 +0000 (0:00:00.141) 0:05:42.956 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "nginx:1.13"], "delta": "0:00:13.023166", "end": "2019-03-11 18:57:51.318539", "rc": 0, "start": "2019-03-11 18:57:38.295373", "stderr": "", "stderr_lines": [], "stdout": "1.13: Pulling from library/nginx\nf2aa67a397c4: Pulling fs layer\n3c091c23e29d: Pulling fs layer\n4a99993b8636: Pulling fs layer\n4a99993b8636: Verifying Checksum\n4a99993b8636: Download complete\nf2aa67a397c4: Verifying Checksum\nf2aa67a397c4: Download complete\n3c091c23e29d: Verifying Checksum\n3c091c23e29d: Download complete\nf2aa67a397c4: Pull complete\n3c091c23e29d: Pull complete\n4a99993b8636: Pull complete\nDigest: sha256:b1d09e9718890e6ebbbd2bc319ef1611559e30ce1b6f56b2e3b479d9da51dc35\nStatus: Downloaded newer image for nginx:1.13", "stdout_lines": ["1.13: Pulling from library/nginx", "f2aa67a397c4: Pulling fs layer", "3c091c23e29d: Pulling fs layer", "4a99993b8636: Pulling fs layer", "4a99993b8636: Verifying Checksum", "4a99993b8636: Download complete", "f2aa67a397c4: Verifying Checksum", "f2aa67a397c4: Download complete", "3c091c23e29d: Verifying Checksum", "3c091c23e29d: Download complete", "f2aa67a397c4: Pull complete", "3c091c23e29d: Pull complete", "4a99993b8636: Pull complete", "Digest: sha256:b1d09e9718890e6ebbbd2bc319ef1611559e30ce1b6f56b2e3b479d9da51dc35", "Status: Downloaded newer image for nginx:1.13"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:57:51 +0000 (0:00:13.791) 0:05:56.747 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:51 +0000 (0:00:00.429) 0:05:57.177 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:52 +0000 (0:00:00.251) 0:05:57.428 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "gcr.io/kubernetes-helm/tiller:v2.11.0"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "gcr.io/kubernetes-helm/tiller:v2.11.0"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:57:52 +0000 (0:00:00.331) 0:05:57.759 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:57:53 +0000 (0:00:00.960) 0:05:58.720 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:57:53 +0000 (0:00:00.256) 0:05:58.976 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:57:53 +0000 (0:00:00.167) 0:05:59.143 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:57:54 +0000 (0:00:00.116) 0:05:59.260 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "gcr.io/kubernetes-helm/tiller:v2.11.0"], "delta": "0:00:10.678156", "end": "2019-03-11 18:58:05.306000", "rc": 0, "start": "2019-03-11 18:57:54.627844", "stderr": "", "stderr_lines": [], "stdout": "v2.11.0: Pulling from kubernetes-helm/tiller\nc67f3896b22c: Pulling fs layer\nc12cb9af1ab6: Pulling fs layer\nc1946e757e66: Pulling fs layer\n9f15637d9e6c: Pulling fs layer\n9f15637d9e6c: Waiting\nc12cb9af1ab6: Verifying Checksum\nc12cb9af1ab6: Download complete\nc67f3896b22c: Verifying Checksum\nc67f3896b22c: Download complete\nc1946e757e66: Verifying Checksum\nc1946e757e66: Download complete\n9f15637d9e6c: Verifying Checksum\n9f15637d9e6c: Download complete\nc67f3896b22c: Pull complete\nc12cb9af1ab6: Pull complete\nc1946e757e66: Pull complete\n9f15637d9e6c: Pull complete\nDigest: sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1\nStatus: Downloaded newer image for gcr.io/kubernetes-helm/tiller:v2.11.0", "stdout_lines": ["v2.11.0: Pulling from kubernetes-helm/tiller", "c67f3896b22c: Pulling fs layer", "c12cb9af1ab6: Pulling fs layer", "c1946e757e66: Pulling fs layer", "9f15637d9e6c: Pulling fs layer", "9f15637d9e6c: Waiting", "c12cb9af1ab6: Verifying Checksum", "c12cb9af1ab6: Download complete", "c67f3896b22c: Verifying Checksum", "c67f3896b22c: Download complete", "c1946e757e66: Verifying Checksum", "c1946e757e66: Download complete", "9f15637d9e6c: Verifying Checksum", "9f15637d9e6c: Download complete", "c67f3896b22c: Pull complete", "c12cb9af1ab6: Pull complete", "c1946e757e66: Pull complete", "9f15637d9e6c: Pull complete", "Digest: sha256:f6d8f4ab9ba993b5f5b60a6edafe86352eabe474ffeb84cb6c79b8866dce45d1", "Status: Downloaded newer image for gcr.io/kubernetes-helm/tiller:v2.11.0"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:58:05 +0000 (0:00:11.498) 0:06:10.758 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:05 +0000 (0:00:00.432) 0:06:11.190 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:06 +0000 (0:00:00.332) 0:06:11.523 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "quay.io/coreos/flannel:v0.10.0"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "quay.io/coreos/flannel:v0.10.0"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:58:06 +0000 (0:00:00.342) 0:06:11.866 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:07 +0000 (0:00:00.963) 0:06:12.829 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:58:07 +0000 (0:00:00.328) 0:06:13.158 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:58:08 +0000 (0:00:00.205) 0:06:13.364 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:58:08 +0000 (0:00:00.126) 0:06:13.490 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "quay.io/coreos/flannel:v0.10.0"], "delta": "0:00:07.640683", "end": "2019-03-11 18:58:16.532768", "rc": 0, "start": "2019-03-11 18:58:08.892085", "stderr": "", "stderr_lines": [], "stdout": "v0.10.0: Pulling from coreos/flannel\nff3a5c916c92: Pulling fs layer\n8a8433d1d437: Pulling fs layer\n306dc0ee491a: Pulling fs layer\n856cbd0b7b9c: Pulling fs layer\naf6d1e4decc6: Pulling fs layer\n856cbd0b7b9c: Waiting\naf6d1e4decc6: Waiting\n306dc0ee491a: Download complete\n8a8433d1d437: Verifying Checksum\n8a8433d1d437: Download complete\nff3a5c916c92: Verifying Checksum\nff3a5c916c92: Download complete\naf6d1e4decc6: Verifying Checksum\naf6d1e4decc6: Download complete\n856cbd0b7b9c: Verifying Checksum\n856cbd0b7b9c: Download complete\nff3a5c916c92: Pull complete\n8a8433d1d437: Pull complete\n306dc0ee491a: Pull complete\n856cbd0b7b9c: Pull complete\naf6d1e4decc6: Pull complete\nDigest: sha256:6ecef07be35e5e861016ee557f986f89ad8244df47198de379a1bf4e580185df\nStatus: Downloaded newer image for quay.io/coreos/flannel:v0.10.0", "stdout_lines": ["v0.10.0: Pulling from coreos/flannel", "ff3a5c916c92: Pulling fs layer", "8a8433d1d437: Pulling fs layer", "306dc0ee491a: Pulling fs layer", "856cbd0b7b9c: Pulling fs layer", "af6d1e4decc6: Pulling fs layer", "856cbd0b7b9c: Waiting", "af6d1e4decc6: Waiting", "306dc0ee491a: Download complete", "8a8433d1d437: Verifying Checksum", "8a8433d1d437: Download complete", "ff3a5c916c92: Verifying Checksum", "ff3a5c916c92: Download complete", "af6d1e4decc6: Verifying Checksum", "af6d1e4decc6: Download complete", "856cbd0b7b9c: Verifying Checksum", "856cbd0b7b9c: Download complete", "ff3a5c916c92: Pull complete", "8a8433d1d437: Pull complete", "306dc0ee491a: Pull complete", "856cbd0b7b9c: Pull complete", "af6d1e4decc6: Pull complete", "Digest: sha256:6ecef07be35e5e861016ee557f986f89ad8244df47198de379a1bf4e580185df", "Status: Downloaded newer image for quay.io/coreos/flannel:v0.10.0"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:58:16 +0000 (0:00:08.498) 0:06:21.989 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:17 +0000 (0:00:00.450) 0:06:22.440 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:17 +0000 (0:00:00.259) 0:06:22.700 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "gcr.io/google_containers/kubernetes-dashboard-amd64:v1.10.0"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "gcr.io/google_containers/kubernetes-dashboard-amd64:v1.10.0"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:58:17 +0000 (0:00:00.266) 0:06:22.967 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:18 +0000 (0:00:00.904) 0:06:23.871 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:58:18 +0000 (0:00:00.270) 0:06:24.142 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:58:19 +0000 (0:00:00.199) 0:06:24.341 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:58:19 +0000 (0:00:00.123) 0:06:24.465 **********
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:58:19 +0000 (0:00:00.253) 0:06:24.718 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:19 +0000 (0:00:00.462) 0:06:25.181 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:20 +0000 (0:00:00.293) 0:06:25.475 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "quay.io/calico/kube-controllers:v3.1.3"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "quay.io/calico/kube-controllers:v3.1.3"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:58:20 +0000 (0:00:00.261) 0:06:25.736 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:21 +0000 (0:00:00.897) 0:06:26.634 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:58:21 +0000 (0:00:00.267) 0:06:26.902 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:58:21 +0000 (0:00:00.233) 0:06:27.135 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:58:22 +0000 (0:00:00.101) 0:06:27.236 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "quay.io/calico/kube-controllers:v3.1.3"], "delta": "0:00:02.600942", "end": "2019-03-11 18:58:25.174212", "rc": 0, "start": "2019-03-11 18:58:22.573270", "stderr": "", "stderr_lines": [], "stdout": "v3.1.3: Pulling from calico/kube-controllers\nff3a5c916c92: Already exists\n6efcdaa9abc7: Pulling fs layer\n6efcdaa9abc7: Verifying Checksum\n6efcdaa9abc7: Download complete\n6efcdaa9abc7: Pull complete\nDigest: sha256:16582e5add4849c18b4add4ccc63284a44c3093dbaf8e6e8fe0ae49c2bec6135\nStatus: Downloaded newer image for quay.io/calico/kube-controllers:v3.1.3", "stdout_lines": ["v3.1.3: Pulling from calico/kube-controllers", "ff3a5c916c92: Already exists", "6efcdaa9abc7: Pulling fs layer", "6efcdaa9abc7: Verifying Checksum", "6efcdaa9abc7: Download complete", "6efcdaa9abc7: Pull complete", "Digest: sha256:16582e5add4849c18b4add4ccc63284a44c3093dbaf8e6e8fe0ae49c2bec6135", "Status: Downloaded newer image for quay.io/calico/kube-controllers:v3.1.3"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:58:25 +0000 (0:00:03.344) 0:06:30.581 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:25 +0000 (0:00:00.513) 0:06:31.095 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:26 +0000 (0:00:00.231) 0:06:31.326 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "quay.io/jetstack/cert-manager-controller:v0.5.2"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "quay.io/jetstack/cert-manager-controller:v0.5.2"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:58:26 +0000 (0:00:00.266) 0:06:31.593 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:27 +0000 (0:00:00.890) 0:06:32.483 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:58:27 +0000 (0:00:00.268) 0:06:32.752 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:58:27 +0000 (0:00:00.172) 0:06:32.925 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:58:27 +0000 (0:00:00.129) 0:06:33.055 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "quay.io/jetstack/cert-manager-controller:v0.5.2"], "delta": "0:00:03.630408", "end": "2019-03-11 18:58:32.033926", "rc": 0, "start": "2019-03-11 18:58:28.403518", "stderr": "", "stderr_lines": [], "stdout": "v0.5.2: Pulling from jetstack/cert-manager-controller\n285795c7fa30: Pulling fs layer\n187827128c97: Pulling fs layer\nd442cca18ea8: Pulling fs layer\n187827128c97: Verifying Checksum\n187827128c97: Download complete\n285795c7fa30: Verifying Checksum\n285795c7fa30: Download complete\nd442cca18ea8: Verifying Checksum\nd442cca18ea8: Download complete\n285795c7fa30: Pull complete\n187827128c97: Pull complete\nd442cca18ea8: Pull complete\nDigest: sha256:958074178ed595cd6733ecf07b746e520bddae10c6264c70cb8b07ecb0083311\nStatus: Downloaded newer image for quay.io/jetstack/cert-manager-controller:v0.5.2", "stdout_lines": ["v0.5.2: Pulling from jetstack/cert-manager-controller", "285795c7fa30: Pulling fs layer", "187827128c97: Pulling fs layer", "d442cca18ea8: Pulling fs layer", "187827128c97: Verifying Checksum", "187827128c97: Download complete", "285795c7fa30: Verifying Checksum", "285795c7fa30: Download complete", "d442cca18ea8: Verifying Checksum", "d442cca18ea8: Download complete", "285795c7fa30: Pull complete", "187827128c97: Pull complete", "d442cca18ea8: Pull complete", "Digest: sha256:958074178ed595cd6733ecf07b746e520bddae10c6264c70cb8b07ecb0083311", "Status: Downloaded newer image for quay.io/jetstack/cert-manager-controller:v0.5.2"]}
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:58:32 +0000 (0:00:04.440) 0:06:37.495 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:32 +0000 (0:00:00.492) 0:06:37.988 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:33 +0000 (0:00:00.325) 0:06:38.314 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:58:33 +0000 (0:00:00.351) 0:06:38.665 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:58:34 +0000 (0:00:00.961) 0:06:39.627 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:58:34 +0000 (0:00:00.337) 0:06:39.964 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:58:34 +0000 (0:00:00.191) 0:06:40.156 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:58:35 +0000 (0:00:00.161) 0:06:40.317 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0"], "delta": "0:00:25.348599", "end": "2019-03-11 18:59:01.032476", "rc": 0, "start": "2019-03-11 18:58:35.683877", "stderr": "", "stderr_lines": [], "stdout": "0.21.0: Pulling from kubernetes-ingress-controller/nginx-ingress-controller\n5024a93a5754: Pulling fs layer\ne70292264e47: Pulling fs layer\nbe4ec9828bb3: Pulling fs layer\n26ae8f47b247: Pulling fs layer\n277954520d56: Pulling fs layer\n9a313a2e0c25: Pulling fs layer\n934cf96b97f2: Pulling fs layer\na07dba3e8ade: Pulling fs layer\n97e025fbb48d: Pulling fs layer\n11e868bba3c8: Pulling fs layer\ne949ecea995c: Pulling fs layer\n6fa5862d43bd: Pulling fs layer\na07dba3e8ade: Waiting\n97e025fbb48d: Waiting\n11e868bba3c8: Waiting\ne949ecea995c: Waiting\n6fa5862d43bd: Waiting\n26ae8f47b247: Waiting\n277954520d56: Waiting\n9a313a2e0c25: Waiting\n934cf96b97f2: Waiting\ne70292264e47: Download complete\nbe4ec9828bb3: Verifying Checksum\nbe4ec9828bb3: Download complete\n277954520d56: Download complete\n5024a93a5754: Download complete\n9a313a2e0c25: Verifying Checksum\n9a313a2e0c25: Download complete\n934cf96b97f2: Verifying Checksum\n934cf96b97f2: Download complete\na07dba3e8ade: Verifying Checksum\na07dba3e8ade: Download complete\ne949ecea995c: Verifying Checksum\ne949ecea995c: Download complete\n11e868bba3c8: Verifying Checksum\n11e868bba3c8: Download complete\n6fa5862d43bd: Verifying Checksum\n6fa5862d43bd: Download complete\n5024a93a5754: Pull complete\ne70292264e47: Pull complete\nbe4ec9828bb3: Pull complete\n26ae8f47b247: Verifying Checksum\n26ae8f47b247: Download complete\n26ae8f47b247: Pull complete\n277954520d56: Pull complete\n9a313a2e0c25: Pull complete\n934cf96b97f2: Pull complete\na07dba3e8ade: Pull complete\n97e025fbb48d: Pull complete\n11e868bba3c8: Pull complete\ne949ecea995c: Pull complete\n6fa5862d43bd: Pull complete\nDigest: sha256:617076c3e3d4d0638a4927702530d8456bda64c67194f6daed272a59e93b992f\nStatus: Downloaded newer image for quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0", "stdout_lines": ["0.21.0: Pulling from kubernetes-ingress-controller/nginx-ingress-controller", "5024a93a5754: Pulling fs layer", "e70292264e47: Pulling fs layer", "be4ec9828bb3: Pulling fs layer", "26ae8f47b247: Pulling fs layer", "277954520d56: Pulling fs layer", "9a313a2e0c25: Pulling fs layer", "934cf96b97f2: Pulling fs layer", "a07dba3e8ade: Pulling fs layer", "97e025fbb48d: Pulling fs layer", "11e868bba3c8: Pulling fs layer", "e949ecea995c: Pulling fs layer", "6fa5862d43bd: Pulling fs layer", "a07dba3e8ade: Waiting", "97e025fbb48d: Waiting", "11e868bba3c8: Waiting", "e949ecea995c: Waiting", "6fa5862d43bd: Waiting", "26ae8f47b247: Waiting", "277954520d56: Waiting", "9a313a2e0c25: Waiting", "934cf96b97f2: Waiting", "e70292264e47: Download complete", "be4ec9828bb3: Verifying Checksum", "be4ec9828bb3: Download complete", "277954520d56: Download complete", "5024a93a5754: Download complete", "9a313a2e0c25: Verifying Checksum", "9a313a2e0c25: Download complete", "934cf96b97f2: Verifying Checksum", "934cf96b97f2: Download complete", "a07dba3e8ade: Verifying Checksum", "a07dba3e8ade: Download complete", "e949ecea995c: Verifying Checksum", "e949ecea995c: Download complete", "11e868bba3c8: Verifying Checksum", "11e868bba3c8: Download complete", "6fa5862d43bd: Verifying Checksum", "6fa5862d43bd: Download complete", "5024a93a5754: Pull complete", "e70292264e47: Pull complete", "be4ec9828bb3: Pull complete", "26ae8f47b247: Verifying Checksum", "26ae8f47b247: Download complete", "26ae8f47b247: Pull complete", "277954520d56: Pull complete", "9a313a2e0c25: Pull complete", "934cf96b97f2: Pull complete", "a07dba3e8ade: Pull complete", "97e025fbb48d: Pull complete", "11e868bba3c8: Pull complete", "e949ecea995c: Pull complete", "6fa5862d43bd: Pull complete", "Digest: sha256:617076c3e3d4d0638a4927702530d8456bda64c67194f6daed272a59e93b992f", "Status: Downloaded newer image for quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0"]}
TASK [download : file_download | Downloading...] ***************************************************************************************
Monday 11 March 2019 18:59:01 +0000 (0:00:26.078) 0:07:06.396 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "msg": [
 "URL: https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/hyperkube", 
 "Dest: /tmp/releases/hyperkube"
 ]
}
ok: [kube-exp-k8s-node-nf-2] => {
 "msg": [
 "URL: https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/hyperkube", 
 "Dest: /tmp/releases/hyperkube"
 ]
}
TASK [download : file_download | Create dest directory] ********************************************************************************
Monday 11 March 2019 18:59:01 +0000 (0:00:00.261) 0:07:06.658 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases", "size": 4096, "state": "directory", "uid": 1000}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases", "size": 4096, "state": "directory", "uid": 1000}
TASK [download : file_download | Download item] ****************************************************************************************
Monday 11 March 2019 18:59:02 +0000 (0:00:00.739) 0:07:07.397 **********
ok: [kube-exp-k8s-node-nf-1] => {"attempts": 1, "changed": false, "dest": "/tmp/releases/hyperkube", "gid": 0, "group": "root", "mode": "0755", "msg": "file already exists", "owner": "root", "size": 248122280, "state": "file", "uid": 0, "url": "https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/hyperkube"}
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "26ca10c97011e96e5ca55deae3bce1f829e8d194", "dest": "/tmp/releases/hyperkube", "gid": 0, "group": "root", "md5sum": "eb3fcca3a6d45c460429cfc331392916", "mode": "0755", "msg": "OK (248122280 bytes)", "owner": "root", "size": 248122280, "src": "/root/.ansible/tmp/ansible-moduletmp-1552330742.84-EF6_LU/tmpupQD2k", "state": "file", "status_code": 200, "uid": 0, "url": "https://storage.googleapis.com/kubernetes-release/release/v1.12.5/bin/linux/amd64/hyperkube"}
TASK [download : file_download | Extract archives] *************************************************************************************
Monday 11 March 2019 18:59:07 +0000 (0:00:05.277) 0:07:12.674 **********
TASK [download : file_download | Downloading...] ***************************************************************************************
Monday 11 March 2019 18:59:07 +0000 (0:00:00.200) 0:07:12.875 **********
ok: [kube-exp-k8s-node-nf-1] => {
 "msg": [
 "URL: https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz", 
 "Dest: /tmp/releases/cni-plugins-amd64-v0.6.0.tgz"
 ]
}
ok: [kube-exp-k8s-node-nf-2] => {
 "msg": [
 "URL: https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz", 
 "Dest: /tmp/releases/cni-plugins-amd64-v0.6.0.tgz"
 ]
}
TASK [download : file_download | Create dest directory] ********************************************************************************
Monday 11 March 2019 18:59:07 +0000 (0:00:00.254) 0:07:13.129 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases", "size": 4096, "state": "directory", "uid": 1000}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "ubuntu", "path": "/tmp/releases", "size": 4096, "state": "directory", "uid": 1000}
TASK [download : file_download | Download item] ****************************************************************************************
Monday 11 March 2019 18:59:08 +0000 (0:00:00.710) 0:07:13.840 **********
ok: [kube-exp-k8s-node-nf-1] => {"attempts": 1, "changed": false, "dest": "/tmp/releases/cni-plugins-amd64-v0.6.0.tgz", "gid": 0, "group": "root", "mode": "0755", "msg": "file already exists", "owner": "root", "size": 15385105, "state": "file", "uid": 0, "url": "https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz"}
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "d595d3ded6499a64e8dac02466e2f5f2ce257c9f", "dest": "/tmp/releases/cni-plugins-amd64-v0.6.0.tgz", "gid": 0, "group": "root", "md5sum": "9534876fae7dbe813cdab404dc1f9219", "mode": "0755", "msg": "OK (15385105 bytes)", "owner": "root", "size": 15385105, "src": "/root/.ansible/tmp/ansible-moduletmp-1552330749.28-EerVRv/tmp3XpROg", "state": "file", "status_code": 200, "uid": 0, "url": "https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz"}
TASK [download : file_download | Extract archives] *************************************************************************************
Monday 11 March 2019 18:59:10 +0000 (0:00:02.351) 0:07:16.192 **********
TASK [download : container_download | Make download decision if pull is required by tag or sha256] *************************************
Monday 11 March 2019 18:59:11 +0000 (0:00:00.240) 0:07:16.432 **********
included: /home/openstack/jetstream_kubespray/roles/download/tasks/set_docker_image_facts.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:59:11 +0000 (0:00:00.478) 0:07:16.911 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_by_digest": false}, "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:59:11 +0000 (0:00:00.207) 0:07:17.119 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_args": "coredns/coredns:1.2.6"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_args": "coredns/coredns:1.2.6"}, "changed": false}
TASK [download : Register docker images info] ******************************************************************************************
Monday 11 March 2019 18:59:12 +0000 (0:00:00.257) 0:07:17.376 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [download : set_fact] *************************************************************************************************************
Monday 11 March 2019 18:59:13 +0000 (0:00:00.901) 0:07:18.278 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"pull_required": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"pull_required": true}, "changed": false}
TASK [download : Check the local digest sha256 corresponds to the given image tag] *****************************************************
Monday 11 March 2019 18:59:13 +0000 (0:00:00.262) 0:07:18.541 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (delegate)] ***********************
Monday 11 March 2019 18:59:13 +0000 (0:00:00.211) 0:07:18.752 **********
TASK [download : container_download | Download containers if pull is required or told to always pull (all nodes)] **********************
Monday 11 March 2019 18:59:13 +0000 (0:00:00.121) 0:07:18.874 **********
changed: [kube-exp-k8s-node-nf-2] => {"attempts": 1, "changed": true, "cmd": ["/usr/bin/docker", "pull", "coredns/coredns:1.2.6"], "delta": "0:00:11.931470", "end": "2019-03-11 18:59:26.156238", "rc": 0, "start": "2019-03-11 18:59:14.224768", "stderr": "", "stderr_lines": [], "stdout": "1.2.6: Pulling from coredns/coredns\n2796eccf0de2: Pulling fs layer\n6ad5128a7d32: Pulling fs layer\n2796eccf0de2: Verifying Checksum\n2796eccf0de2: Download complete\n6ad5128a7d32: Verifying Checksum\n6ad5128a7d32: Download complete\n2796eccf0de2: Pull complete\n6ad5128a7d32: Pull complete\nDigest: sha256:81936728011c0df9404cb70b95c17bbc8af922ec9a70d0561a5d01fefa6ffa51\nStatus: Downloaded newer image for coredns/coredns:1.2.6", "stdout_lines": ["1.2.6: Pulling from coredns/coredns", "2796eccf0de2: Pulling fs layer", "6ad5128a7d32: Pulling fs layer", "2796eccf0de2: Verifying Checksum", "2796eccf0de2: Download complete", "6ad5128a7d32: Verifying Checksum", "6ad5128a7d32: Download complete", "2796eccf0de2: Pull complete", "6ad5128a7d32: Pull complete", "Digest: sha256:81936728011c0df9404cb70b95c17bbc8af922ec9a70d0561a5d01fefa6ffa51", "Status: Downloaded newer image for coredns/coredns:1.2.6"]}
TASK [download : Sync container] *******************************************************************************************************
Monday 11 March 2019 18:59:26 +0000 (0:00:12.645) 0:07:31.520 **********
TASK [adduser : User | Create User Group] **********************************************************************************************
Monday 11 March 2019 18:59:27 +0000 (0:00:01.060) 0:07:32.581 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 998, "name": "etcd", "state": "present", "system": true}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 998, "name": "etcd", "state": "present", "system": true}
TASK [adduser : User | Create User] ****************************************************************************************************
Monday 11 March 2019 18:59:30 +0000 (0:00:03.526) 0:07:36.107 **********
ok: [kube-exp-k8s-node-nf-1] => {"append": false, "changed": false, "comment": "Etcd user", "group": 998, "home": "/var/lib/etcd", "move_home": false, "name": "etcd", "shell": "/bin/nologin", "state": "present", "uid": 998}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "comment": "Etcd user", "create_home": true, "group": 998, "home": "/var/lib/etcd", "name": "etcd", "shell": "/bin/nologin", "state": "present", "system": true, "uid": 998}
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:59:33 +0000 (0:00:02.364) 0:07:38.472 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/check_certs.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [etcd : Check_certs | check if all certs have already been generated on first master] *********************************************
Monday 11 March 2019 18:59:33 +0000 (0:00:00.255) 0:07:38.727 **********
ok: [kube-exp-k8s-node-nf-1 -> None] => {"changed": false, "examined": 14, "files": [{"atime": 1552267336.682097, "checksum": "a05d412fcc4abc60a6c5bd6acfae19a91ba990b4", "ctime": 1552330356.4951108, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 262099, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552261995.1492913, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-3-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1675, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "8dca8ff66af44a8c8e47944d60ebf6016bcb2457", "ctime": 1552330356.4951108, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051791, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.1281831, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-1.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "17a458c528b755673002e6281cf48bb87fa171f0", "ctime": 1552330356.4951108, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051789, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.116183, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-1-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1679, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "e9e8f5cf66de4efe979882dcd46889136b5d0d95", "ctime": 1552330356.4951108, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 262101, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552261995.1612911, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-3.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "825df5bb397229af9c8d0c2f544e68f4f705f535", "ctime": 1552330356.4951108, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051786, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.0321817, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-master-1-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1675, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552330357.8111134, "checksum": "bc7d8ca4ac0a7c2bc891d89601adfcc59f9d7aa2", "ctime": 1552330356.499111, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051778, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085290.7081766, "nlink": 1, "path": "/etc/ssl/etcd/ssl/ca.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1094, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "90d3c4f4f1de5a554002a135efd78786e2585aec", "ctime": 1552330356.499111, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 288934, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552089490.9037845, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-2-key.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1679, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552267336.682097, "checksum": "5298cfeb2b91a9886fe283660b7fd3fb21a89aef", "ctime": 1552330356.499111, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 288936, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552089490.9157844, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-2.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}, {"atime": 1552330358.687115, "checksum": "cef1b1c60308194126bb3b7f04c9883f57a6ad51", "ctime": 1552330356.499111, "dev": 2049, "gid": 0, "gr_name": "root", "inode": 1051788, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mode": "0640", "mtime": 1552085291.0401819, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-master-1.pem", "pw_name": "kube", "rgrp": true, "roth": false, "rusr": true, "size": 1411, "uid": 999, "wgrp": false, "woth": false, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}], "matched": 9, "msg": ""}
TASK [etcd : Check_certs | Set default value for 'sync_certs', 'gen_certs' and 'etcd_secret_changed' to false] *************************
Monday 11 March 2019 18:59:34 +0000 (0:00:00.684) 0:07:39.412 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"etcd_secret_changed": false, "gen_certs": false, "sync_certs": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"etcd_secret_changed": false, "gen_certs": false, "sync_certs": false}, "changed": false}
TASK [etcd : Check certs | check if a cert already exists on node] *********************************************************************
Monday 11 March 2019 18:59:34 +0000 (0:00:00.324) 0:07:39.736 **********
ok: [kube-exp-k8s-node-nf-1] => (item=ca.pem) => {"changed": false, "item": "ca.pem", "stat": {"atime": 1552267344.6204011, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "bc7d8ca4ac0a7c2bc891d89601adfcc59f9d7aa2", "ctime": 1552267342.7724018, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1042983, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0640", "mtime": 1552085290.0, "nlink": 1, "path": "/etc/ssl/etcd/ssl/ca.pem", "pw_name": "kube", "readable": true, "rgrp": true, "roth": false, "rusr": true, "size": 1094, "uid": 999, "version": "2855679780", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
ok: [kube-exp-k8s-node-nf-2] => (item=ca.pem) => {"changed": false, "item": "ca.pem", "stat": {"exists": false}}
ok: [kube-exp-k8s-node-nf-2] => (item=node-kube-exp-k8s-node-nf-2-key.pem) => {"changed": false, "item": "node-kube-exp-k8s-node-nf-2-key.pem", "stat": {"exists": false}}
ok: [kube-exp-k8s-node-nf-1] => (item=node-kube-exp-k8s-node-nf-1-key.pem) => {"changed": false, "item": "node-kube-exp-k8s-node-nf-1-key.pem", "stat": {"atime": 1552267342.7724018, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "17a458c528b755673002e6281cf48bb87fa171f0", "ctime": 1552267342.7724018, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1042985, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0640", "mtime": 1552085291.0, "nlink": 1, "path": "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-1-key.pem", "pw_name": "kube", "readable": true, "rgrp": true, "roth": false, "rusr": true, "size": 1679, "uid": 999, "version": "3550602281", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
TASK [etcd : Check_certs | Set 'gen_certs' to true] ************************************************************************************
Monday 11 March 2019 18:59:35 +0000 (0:00:01.177) 0:07:40.913 **********
TASK [etcd : Check_certs | Set 'gen_node_certs' to true] *******************************************************************************
Monday 11 March 2019 18:59:35 +0000 (0:00:00.211) 0:07:41.125 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"gen_node_certs": {"kube-exp-k8s-master-1": false, "kube-exp-k8s-node-nf-1": false, "kube-exp-k8s-node-nf-2": false, "kube-exp-k8s-node-nf-3": false}}, "changed": false}
TASK [etcd : Check_certs | Set 'sync_certs' to true] ***********************************************************************************
Monday 11 March 2019 18:59:36 +0000 (0:00:00.275) 0:07:41.401 **********
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"sync_certs": true}, "changed": false}
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:59:36 +0000 (0:00:00.325) 0:07:41.727 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/gen_certs_script.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [etcd : Gen_certs | create etcd cert dir] *****************************************************************************************
Monday 11 March 2019 18:59:36 +0000 (0:00:00.279) 0:07:42.006 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "gid": 0, "group": "root", "mode": "0700", "owner": "kube", "path": "/etc/ssl/etcd/ssl", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 0, "group": "root", "mode": "0700", "owner": "kube", "path": "/etc/ssl/etcd/ssl", "size": 4096, "state": "directory", "uid": 999}
TASK [etcd : Gen_certs | create etcd script dir (on kube-exp-k8s-master-1)] ************************************************************
Monday 11 March 2019 18:59:37 +0000 (0:00:00.858) 0:07:42.864 **********
TASK [etcd : Gen_certs | create etcd cert dir (on kube-exp-k8s-master-1)] **************************************************************
Monday 11 March 2019 18:59:37 +0000 (0:00:00.194) 0:07:43.059 **********
TASK [etcd : Gen_certs | write openssl config] *****************************************************************************************
Monday 11 March 2019 18:59:38 +0000 (0:00:00.183) 0:07:43.243 **********
TASK [etcd : Gen_certs | copy certs generation script] *********************************************************************************
Monday 11 March 2019 18:59:38 +0000 (0:00:00.173) 0:07:43.416 **********
TASK [etcd : Gen_certs | run cert generation script] ***********************************************************************************
Monday 11 March 2019 18:59:38 +0000 (0:00:00.146) 0:07:43.563 **********
TASK [etcd : Gen_certs | Gather etcd master certs] *************************************************************************************
Monday 11 March 2019 18:59:38 +0000 (0:00:00.153) 0:07:43.717 **********
TASK [etcd : Gen_certs | Write etcd master certs] **************************************************************************************
Monday 11 March 2019 18:59:38 +0000 (0:00:00.417) 0:07:44.134 **********
TASK [etcd : set_fact] *****************************************************************************************************************
Monday 11 March 2019 18:59:39 +0000 (0:00:00.325) 0:07:44.460 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"my_etcd_node_certs": ["ca.pem", "node-kube-exp-k8s-node-nf-1.pem", "node-kube-exp-k8s-node-nf-1-key.pem"]}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"my_etcd_node_certs": ["ca.pem", "node-kube-exp-k8s-node-nf-2.pem", "node-kube-exp-k8s-node-nf-2-key.pem"]}, "changed": false}
TASK [etcd : Check_certs | Set 'sync_certs' to true on nodes] **************************************************************************
Monday 11 March 2019 18:59:39 +0000 (0:00:00.251) 0:07:44.711 **********
ok: [kube-exp-k8s-node-nf-1] => (item=ca.pem) => {"ansible_facts": {"sync_certs": true}, "changed": false, "item": "ca.pem"}
ok: [kube-exp-k8s-node-nf-1] => (item=node-kube-exp-k8s-node-nf-1.pem) => {"ansible_facts": {"sync_certs": true}, "changed": false, "item": "node-kube-exp-k8s-node-nf-1.pem"}
ok: [kube-exp-k8s-node-nf-2] => (item=ca.pem) => {"ansible_facts": {"sync_certs": true}, "changed": false, "item": "ca.pem"}
ok: [kube-exp-k8s-node-nf-1] => (item=node-kube-exp-k8s-node-nf-1-key.pem) => {"ansible_facts": {"sync_certs": true}, "changed": false, "item": "node-kube-exp-k8s-node-nf-1-key.pem"}
ok: [kube-exp-k8s-node-nf-2] => (item=node-kube-exp-k8s-node-nf-2.pem) => {"ansible_facts": {"sync_certs": true}, "changed": false, "item": "node-kube-exp-k8s-node-nf-2.pem"}
ok: [kube-exp-k8s-node-nf-2] => (item=node-kube-exp-k8s-node-nf-2-key.pem) => {"ansible_facts": {"sync_certs": true}, "changed": false, "item": "node-kube-exp-k8s-node-nf-2-key.pem"}
TASK [etcd : Gen_certs | Gather node certs] ********************************************************************************************
Monday 11 March 2019 18:59:39 +0000 (0:00:00.402) 0:07:45.114 **********
changed: [kube-exp-k8s-node-nf-1 -> None] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true}
changed: [kube-exp-k8s-node-nf-2 -> None] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true}
TASK [etcd : Gen_certs | Copy certs on nodes] ******************************************************************************************
Monday 11 March 2019 18:59:40 +0000 (0:00:00.676) 0:07:45.791 **********
ok: [kube-exp-k8s-node-nf-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
TASK [etcd : Gen_certs | check certificate permissions] ********************************************************************************
Monday 11 March 2019 18:59:41 +0000 (0:00:00.705) 0:07:46.496 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "gid": 0, "group": "root", "mode": "0640", "owner": "kube", "path": "/etc/ssl/etcd/ssl", "size": 4096, "state": "directory", "uid": 999}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 0, "group": "root", "mode": "0640", "owner": "kube", "path": "/etc/ssl/etcd/ssl", "size": 4096, "state": "directory", "uid": 999}
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:59:41 +0000 (0:00:00.636) 0:07:47.133 **********
included: /home/openstack/jetstream_kubespray/roles/etcd/tasks/upd_ca_trust.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [etcd : Gen_certs | target ca-certificate store file] *****************************************************************************
Monday 11 March 2019 18:59:42 +0000 (0:00:00.248) 0:07:47.381 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"ca_cert_path": "/usr/local/share/ca-certificates/etcd-ca.crt"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"ca_cert_path": "/usr/local/share/ca-certificates/etcd-ca.crt"}, "changed": false}
TASK [etcd : Gen_certs | add CA to trusted CA dir] *************************************************************************************
Monday 11 March 2019 18:59:42 +0000 (0:00:00.230) 0:07:47.612 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "bc7d8ca4ac0a7c2bc891d89601adfcc59f9d7aa2", "dest": "/usr/local/share/ca-certificates/etcd-ca.crt", "gid": 0, "group": "root", "md5sum": "cae985594200f5cb749dd2dcb934ac92", "mode": "0644", "owner": "root", "size": 1094, "src": "/etc/ssl/etcd/ssl/ca.pem", "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "bc7d8ca4ac0a7c2bc891d89601adfcc59f9d7aa2", "dest": "/usr/local/share/ca-certificates/etcd-ca.crt", "gid": 0, "group": "root", "md5sum": "cae985594200f5cb749dd2dcb934ac92", "mode": "0644", "owner": "root", "size": 1094, "src": "/etc/ssl/etcd/ssl/ca.pem", "state": "file", "uid": 0}
TASK [etcd : Gen_certs | update ca-certificates (Debian/Ubuntu/SUSE/Container Linux by CoreOS)] ****************************************
Monday 11 March 2019 18:59:43 +0000 (0:00:01.052) 0:07:48.664 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["update-ca-certificates"], "delta": "0:00:00.867553", "end": "2019-03-11 18:59:44.819903", "rc": 0, "start": "2019-03-11 18:59:43.952350", "stderr": "", "stderr_lines": [], "stdout": "Updating certificates in /etc/ssl/certs...\n1 added, 0 removed; done.\nRunning hooks in /etc/ca-certificates/update.d...\ndone.", "stdout_lines": ["Updating certificates in /etc/ssl/certs...", "1 added, 0 removed; done.", "Running hooks in /etc/ca-certificates/update.d...", "done."]}
TASK [etcd : Gen_certs | update ca-certificates (RedHat)] ******************************************************************************
Monday 11 March 2019 18:59:44 +0000 (0:00:01.505) 0:07:50.170 **********
TASK [etcd : Gen_certs | Get etcd certificate serials] *********************************************************************************
Monday 11 March 2019 18:59:45 +0000 (0:00:00.160) 0:07:50.330 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": ["openssl", "x509", "-in", "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-1.pem", "-noout", "-serial"], "delta": "0:00:00.009722", "end": "2019-03-11 18:59:45.635033", "rc": 0, "start": "2019-03-11 18:59:45.625311", "stderr": "", "stderr_lines": [], "stdout": "serial=821A7D37763BBD02", "stdout_lines": ["serial=821A7D37763BBD02"]}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": ["openssl", "x509", "-in", "/etc/ssl/etcd/ssl/node-kube-exp-k8s-node-nf-2.pem", "-noout", "-serial"], "delta": "0:00:00.009339", "end": "2019-03-11 18:59:45.655655", "rc": 0, "start": "2019-03-11 18:59:45.646316", "stderr": "", "stderr_lines": [], "stdout": "serial=C94DA6102610A291", "stdout_lines": ["serial=C94DA6102610A291"]}
TASK [etcd : Set etcd_client_cert_serial] **********************************************************************************************
Monday 11 March 2019 18:59:45 +0000 (0:00:00.677) 0:07:51.008 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"etcd_client_cert_serial": "821A7D37763BBD02"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"etcd_client_cert_serial": "C94DA6102610A291"}, "changed": false}
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:59:46 +0000 (0:00:00.294) 0:07:51.302 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:59:46 +0000 (0:00:00.151) 0:07:51.454 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:59:46 +0000 (0:00:00.121) 0:07:51.575 **********
TASK [etcd : Restart etcd if certs changed] ********************************************************************************************
Monday 11 March 2019 18:59:46 +0000 (0:00:00.140) 0:07:51.716 **********
TASK [etcd : Restart etcd-events if certs changed] *************************************************************************************
Monday 11 March 2019 18:59:46 +0000 (0:00:00.152) 0:07:51.868 **********
TASK [etcd : include_tasks] ************************************************************************************************************
Monday 11 March 2019 18:59:46 +0000 (0:00:00.124) 0:07:51.993 **********
TASK [kubernetes/secrets : Check_certs | check if the certs have already been generated on first master] *******************************
Monday 11 March 2019 18:59:46 +0000 (0:00:00.185) 0:07:52.178 **********
TASK [kubernetes/secrets : Check_certs | Set default value for 'sync_certs', 'gen_certs', and 'secret_changed' to false] ***************
Monday 11 March 2019 18:59:47 +0000 (0:00:00.130) 0:07:52.308 **********
TASK [kubernetes/secrets : Check_certs | Set 'gen_certs' to true] **********************************************************************
Monday 11 March 2019 18:59:47 +0000 (0:00:00.210) 0:07:52.519 **********
TASK [kubernetes/secrets : Check_certs | Set 'gen_master_certs' to true] ***************************************************************
Monday 11 March 2019 18:59:47 +0000 (0:00:00.396) 0:07:52.916 **********
TASK [kubernetes/secrets : Check_certs | Set 'gen_node_certs' to true] *****************************************************************
Monday 11 March 2019 18:59:47 +0000 (0:00:00.115) 0:07:53.032 **********
TASK [kubernetes/secrets : Make sure the certificate directory exits] ******************************************************************
Monday 11 March 2019 18:59:47 +0000 (0:00:00.113) 0:07:53.145 **********
TASK [kubernetes/secrets : Gen_certs | Create kubernetes config directory (on kube-exp-k8s-master-1)] **********************************
Monday 11 March 2019 18:59:48 +0000 (0:00:00.247) 0:07:53.392 **********
TASK [kubernetes/secrets : Gen_certs | Create kubernetes script directory (on kube-exp-k8s-master-1)] **********************************
Monday 11 March 2019 18:59:48 +0000 (0:00:00.179) 0:07:53.572 **********
TASK [kubernetes/secrets : include_tasks] **********************************************************************************************
Monday 11 March 2019 18:59:48 +0000 (0:00:00.104) 0:07:53.676 **********
TASK [kubernetes/secrets : Gen_certs | target ca-certificates path] ********************************************************************
Monday 11 March 2019 18:59:48 +0000 (0:00:00.117) 0:07:53.794 **********
TASK [kubernetes/secrets : Gen_certs | add CA to trusted CA dir] ***********************************************************************
Monday 11 March 2019 18:59:48 +0000 (0:00:00.145) 0:07:53.939 **********
TASK [kubernetes/secrets : Gen_certs | update ca-certificates (Debian/Ubuntu/SUSE/Container Linux by CoreOS)] **************************
Monday 11 March 2019 18:59:48 +0000 (0:00:00.169) 0:07:54.109 **********
TASK [kubernetes/secrets : Gen_certs | update ca-certificates (RedHat)] ****************************************************************
Monday 11 March 2019 18:59:49 +0000 (0:00:00.133) 0:07:54.242 **********
TASK [kubernetes/secrets : Gen_certs | Get certificate serials on kube masters] ********************************************************
Monday 11 March 2019 18:59:49 +0000 (0:00:00.145) 0:07:54.387 **********
TASK [kubernetes/secrets : Gen_certs | set kube master certificate serial facts] *******************************************************
Monday 11 March 2019 18:59:49 +0000 (0:00:00.217) 0:07:54.605 **********
TASK [kubernetes/secrets : Gen_certs | Get certificate serials on kube nodes] **********************************************************
Monday 11 March 2019 18:59:49 +0000 (0:00:00.129) 0:07:54.735 **********
TASK [kubernetes/secrets : Gen_certs | set kube node certificate serial facts] *********************************************************
Monday 11 March 2019 18:59:49 +0000 (0:00:00.178) 0:07:54.913 **********
TASK [kubernetes/node : look up docker cgroup driver] **********************************************************************************
Monday 11 March 2019 18:59:49 +0000 (0:00:00.159) 0:07:55.073 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": "docker info | grep 'Cgroup Driver' | awk -F': ' '{ print $2; }'", "delta": "0:00:00.119347", "end": "2019-03-11 18:59:50.448028", "rc": 0, "start": "2019-03-11 18:59:50.328681", "stderr": "WARNING: No swap limit support", "stderr_lines": ["WARNING: No swap limit support"], "stdout": "cgroupfs", "stdout_lines": ["cgroupfs"]}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": "docker info | grep 'Cgroup Driver' | awk -F': ' '{ print $2; }'", "delta": "0:00:00.132033", "end": "2019-03-11 18:59:50.528534", "rc": 0, "start": "2019-03-11 18:59:50.396501", "stderr": "WARNING: No swap limit support", "stderr_lines": ["WARNING: No swap limit support"], "stdout": "cgroupfs", "stdout_lines": ["cgroupfs"]}
TASK [kubernetes/node : set_fact] ******************************************************************************************************
Monday 11 March 2019 18:59:50 +0000 (0:00:00.805) 0:07:55.878 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"kubelet_cgroup_driver_detected": "cgroupfs", "standalone_kubelet": false}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"kubelet_cgroup_driver_detected": "cgroupfs", "standalone_kubelet": false}, "changed": false}
TASK [kubernetes/node : os specific vars] **********************************************************************************************
Monday 11 March 2019 18:59:51 +0000 (0:00:00.356) 0:07:56.235 **********
ok: [kube-exp-k8s-node-nf-1] => (item=/home/openstack/jetstream_kubespray/roles/kubernetes/node/vars/ubuntu-18.yml) => {"ansible_facts": {"kube_resolv_conf": "/run/systemd/resolve/resolv.conf"}, "ansible_included_var_files": ["/home/openstack/jetstream_kubespray/roles/kubernetes/node/vars/ubuntu-18.yml"], "changed": false, "item": "/home/openstack/jetstream_kubespray/roles/kubernetes/node/vars/ubuntu-18.yml"}
ok: [kube-exp-k8s-node-nf-2] => (item=/home/openstack/jetstream_kubespray/roles/kubernetes/node/vars/ubuntu-18.yml) => {"ansible_facts": {"kube_resolv_conf": "/run/systemd/resolve/resolv.conf"}, "ansible_included_var_files": ["/home/openstack/jetstream_kubespray/roles/kubernetes/node/vars/ubuntu-18.yml"], "changed": false, "item": "/home/openstack/jetstream_kubespray/roles/kubernetes/node/vars/ubuntu-18.yml"}
TASK [kubernetes/node : Pre-upgrade | check if kubelet container exists] ***************************************************************
Monday 11 March 2019 18:59:51 +0000 (0:00:00.345) 0:07:56.580 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": "docker ps -af name=kubelet | grep kubelet", "delta": "0:00:00.119183", "end": "2019-03-11 18:59:52.038728", "failed_when_result": false, "msg": "non-zero return code", "rc": 1, "start": "2019-03-11 18:59:51.919545", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": "docker ps -af name=kubelet | grep kubelet", "delta": "0:00:00.103873", "end": "2019-03-11 18:59:52.084118", "failed_when_result": false, "msg": "non-zero return code", "rc": 1, "start": "2019-03-11 18:59:51.980245", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
TASK [kubernetes/node : Pre-upgrade | copy /var/lib/cni from kubelet] ******************************************************************
Monday 11 March 2019 18:59:52 +0000 (0:00:00.894) 0:07:57.475 **********
TASK [kubernetes/node : Pre-upgrade | ensure kubelet container service is stopped if using host deployment] ****************************
Monday 11 March 2019 18:59:52 +0000 (0:00:00.134) 0:07:57.610 **********
TASK [kubernetes/node : Pre-upgrade | ensure kubelet container is removed if using host deployment] ************************************
Monday 11 March 2019 18:59:52 +0000 (0:00:00.140) 0:07:57.750 **********
TASK [kubernetes/node : Ensure /var/lib/cni exists] ************************************************************************************
Monday 11 March 2019 18:59:52 +0000 (0:00:00.133) 0:07:57.884 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/cni", "size": 4096, "state": "directory", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/cni", "size": 4096, "state": "directory", "uid": 0}
TASK [kubernetes/node : Set kubelet deployment to host if kubeadm is enabled] **********************************************************
Monday 11 March 2019 18:59:53 +0000 (0:00:00.740) 0:07:58.625 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"kubelet_deployment_type": "host"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"kubelet_deployment_type": "host"}, "changed": false}
TASK [kubernetes/node : install | Copy kubeadm binary from download dir] ***************************************************************
Monday 11 March 2019 18:59:53 +0000 (0:00:00.387) 0:07:59.013 **********
ok: [kube-exp-k8s-node-nf-1 -> None] => {"changed": false, "cmd": "/usr/bin/rsync --delay-updates -F --archive --no-owner --no-group --out-format=<<CHANGED>>%i %n%L /tmp/releases/kubeadm /usr/local/bin/kubeadm", "msg": "", "rc": 0, "stdout_lines": []}
changed: [kube-exp-k8s-node-nf-2 -> None] => {"changed": true, "cmd": "/usr/bin/rsync --delay-updates -F --archive --no-owner --no-group --out-format=<<CHANGED>>%i %n%L /tmp/releases/kubeadm /usr/local/bin/kubeadm", "msg": ">f+++++++++ kubeadm\n", "rc": 0, "stdout_lines": [">f+++++++++ kubeadm"]}
TASK [kubernetes/node : install | Set kubeadm binary permissions] **********************************************************************
Monday 11 March 2019 18:59:54 +0000 (0:00:01.151) 0:08:00.164 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/local/bin/kubeadm", "size": 54042659, "state": "file", "uid": 0}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/local/bin/kubeadm", "size": 54042659, "state": "file", "uid": 0}
TASK [kubernetes/node : include_tasks] *************************************************************************************************
Monday 11 March 2019 18:59:55 +0000 (0:00:00.680) 0:08:00.845 **********
included: /home/openstack/jetstream_kubespray/roles/kubernetes/node/tasks/install_host.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [kubernetes/node : install | Copy kubelet binary from download dir] ***************************************************************
Monday 11 March 2019 18:59:55 +0000 (0:00:00.279) 0:08:01.124 **********
ok: [kube-exp-k8s-node-nf-1 -> None] => {"changed": false, "cmd": "/usr/bin/rsync --delay-updates -F --archive --no-owner --no-group --out-format=<<CHANGED>>%i %n%L /tmp/releases/hyperkube /usr/local/bin/kubelet", "msg": "", "rc": 0, "stdout_lines": []}
changed: [kube-exp-k8s-node-nf-2 -> None] => {"changed": true, "cmd": "/usr/bin/rsync --delay-updates -F --archive --no-owner --no-group --out-format=<<CHANGED>>%i %n%L /tmp/releases/hyperkube /usr/local/bin/kubelet", "msg": ">f+++++++++ hyperkube\n", "rc": 0, "stdout_lines": [">f+++++++++ hyperkube"]}
TASK [kubernetes/node : install | Set kubelet binary permissions] **********************************************************************
Monday 11 March 2019 18:59:57 +0000 (0:00:01.984) 0:08:03.109 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/local/bin/kubelet", "size": 248122280, "state": "file", "uid": 0}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/local/bin/kubelet", "size": 248122280, "state": "file", "uid": 0}
TASK [kubernetes/node : install | Copy socat wrapper for Container Linux] **************************************************************
Monday 11 March 2019 18:59:58 +0000 (0:00:00.666) 0:08:03.776 **********
TASK [kubernetes/node : install | Write kubelet systemd init file] *********************************************************************
Monday 11 March 2019 18:59:58 +0000 (0:00:00.151) 0:08:03.928 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "6776d5c1dc7ceb83b0ae25cbc09694a8a8a18f01", "dest": "/etc/systemd/system/kubelet.service", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/systemd/system/kubelet.service", "size": 644, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "6776d5c1dc7ceb83b0ae25cbc09694a8a8a18f01", "dest": "/etc/systemd/system/kubelet.service", "gid": 0, "group": "root", "md5sum": "e3c5e62170c77b726e611dc1de802c43", "mode": "0644", "owner": "root", "size": 644, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330798.89-268604641710229/source", "state": "file", "uid": 0}
TASK [kubernetes/node : nginx-proxy | Write static pod] ********************************************************************************
Monday 11 March 2019 19:00:01 +0000 (0:00:02.379) 0:08:06.308 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "1f763f76d91513e3356df191a08bd025d46919b5", "dest": "/etc/kubernetes/manifests/nginx-proxy.yml", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/kubernetes/manifests/nginx-proxy.yml", "size": 645, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "1f763f76d91513e3356df191a08bd025d46919b5", "dest": "/etc/kubernetes/manifests/nginx-proxy.yml", "gid": 0, "group": "root", "md5sum": "a7c075faad4021dc7c133923a6132014", "mode": "0644", "owner": "root", "size": 645, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330801.27-197342738349411/source", "state": "file", "uid": 0}
TASK [kubernetes/node : nginx-proxy | Make nginx directory] ****************************************************************************
Monday 11 March 2019 19:00:03 +0000 (0:00:02.054) 0:08:08.362 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "gid": 0, "group": "root", "mode": "0700", "owner": "root", "path": "/etc/nginx", "size": 4096, "state": "directory", "uid": 0}
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "gid": 0, "group": "root", "mode": "0700", "owner": "root", "path": "/etc/nginx", "size": 4096, "state": "directory", "uid": 0}
TASK [kubernetes/node : nginx-proxy | Write nginx-proxy configuration] *****************************************************************
Monday 11 March 2019 19:00:03 +0000 (0:00:00.629) 0:08:08.992 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "fa8693a7e01485de403effa0c72aee0c46890b1f", "dest": "/etc/nginx/nginx.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/nginx/nginx.conf", "size": 426, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "fa8693a7e01485de403effa0c72aee0c46890b1f", "dest": "/etc/nginx/nginx.conf", "gid": 0, "group": "root", "md5sum": "c5953b180722cd5f362a3360801029a9", "mode": "0755", "owner": "root", "size": 426, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330803.97-136374233040914/source", "state": "file", "uid": 0}
TASK [kubernetes/node : Write kubelet config file (non-kubeadm)] ***********************************************************************
Monday 11 March 2019 19:00:05 +0000 (0:00:02.201) 0:08:11.193 **********
TASK [kubernetes/node : Make sure dynamic kubelet configuration directory is writeable] ************************************************
Monday 11 March 2019 19:00:06 +0000 (0:00:00.144) 0:08:11.338 **********
TASK [kubernetes/node : Write kubelet config file (kubeadm)] ***************************************************************************
Monday 11 March 2019 19:00:06 +0000 (0:00:00.164) 0:08:11.504 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "ddebca211f87999ae4bca1faa4fec6bdde14aa9c", "dest": "/etc/kubernetes/kubelet.env", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/kubernetes/kubelet.env", "size": 1822, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "0d2a06e3be194f6171ee0a2fc15938ddb05411d4", "dest": "/etc/kubernetes/kubelet.env", "gid": 0, "group": "root", "md5sum": "41da8592b0af2017ad9efeaf1364aad2", "mode": "0644", "owner": "root", "size": 1822, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330806.5-45239841603556/source", "state": "file", "uid": 0}
TASK [kubernetes/node : write the kubecfg (auth) file for kubelet] *********************************************************************
Monday 11 March 2019 19:00:08 +0000 (0:00:02.324) 0:08:13.828 **********
TASK [kubernetes/node : Ensure nodePort range is reserved] *****************************************************************************
Monday 11 March 2019 19:00:08 +0000 (0:00:00.186) 0:08:14.015 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true}
TASK [kubernetes/node : Verify if br_netfilter module exists] **************************************************************************
Monday 11 March 2019 19:00:10 +0000 (0:00:01.557) 0:08:15.572 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": "modinfo br_netfilter", "delta": "0:00:00.005006", "end": "2019-03-11 19:00:10.826686", "failed_when_result": false, "rc": 0, "start": "2019-03-11 19:00:10.821680", "stderr": "", "stderr_lines": [], "stdout": "filename: /lib/modules/4.15.0-45-generic/kernel/net/bridge/br_netfilter.ko\ndescription: Linux ethernet netfilter firewall bridge\nauthor: Bart De Schuymer <bdschuym@pandora.be>\nauthor: Lennert Buytenhek <buytenh@gnu.org>\nlicense: GPL\nsrcversion: 037C978AF8D3C061B00020A\ndepends: bridge\nretpoline: Y\nintree: Y\nname: br_netfilter\nvermagic: 4.15.0-45-generic SMP mod_unload \nsignat: PKCS#7\nsigner: \nsig_key: \nsig_hashalgo: md4", "stdout_lines": ["filename: /lib/modules/4.15.0-45-generic/kernel/net/bridge/br_netfilter.ko", "description: Linux ethernet netfilter firewall bridge", "author: Bart De Schuymer <bdschuym@pandora.be>", "author: Lennert Buytenhek <buytenh@gnu.org>", "license: GPL", "srcversion: 037C978AF8D3C061B00020A", "depends: bridge", "retpoline: Y", "intree: Y", "name: br_netfilter", "vermagic: 4.15.0-45-generic SMP mod_unload ", "signat: PKCS#7", "signer: ", "sig_key: ", "sig_hashalgo: md4"]}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": "modinfo br_netfilter", "delta": "0:00:00.005341", "end": "2019-03-11 19:00:10.891521", "failed_when_result": false, "rc": 0, "start": "2019-03-11 19:00:10.886180", "stderr": "", "stderr_lines": [], "stdout": "filename: /lib/modules/4.15.0-45-generic/kernel/net/bridge/br_netfilter.ko\ndescription: Linux ethernet netfilter firewall bridge\nauthor: Bart De Schuymer <bdschuym@pandora.be>\nauthor: Lennert Buytenhek <buytenh@gnu.org>\nlicense: GPL\nsrcversion: 037C978AF8D3C061B00020A\ndepends: bridge\nretpoline: Y\nintree: Y\nname: br_netfilter\nvermagic: 4.15.0-45-generic SMP mod_unload \nsignat: PKCS#7\nsigner: \nsig_key: \nsig_hashalgo: md4", "stdout_lines": ["filename: /lib/modules/4.15.0-45-generic/kernel/net/bridge/br_netfilter.ko", "description: Linux ethernet netfilter firewall bridge", "author: Bart De Schuymer <bdschuym@pandora.be>", "author: Lennert Buytenhek <buytenh@gnu.org>", "license: GPL", "srcversion: 037C978AF8D3C061B00020A", "depends: bridge", "retpoline: Y", "intree: Y", "name: br_netfilter", "vermagic: 4.15.0-45-generic SMP mod_unload ", "signat: PKCS#7", "signer: ", "sig_key: ", "sig_hashalgo: md4"]}
TASK [kubernetes/node : Enable br_netfilter module] ************************************************************************************
Monday 11 March 2019 19:00:11 +0000 (0:00:00.669) 0:08:16.241 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "name": "br_netfilter", "params": "", "state": "present"}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "name": "br_netfilter", "params": "", "state": "present"}
TASK [kubernetes/node : Persist br_netfilter module] ***********************************************************************************
Monday 11 March 2019 19:00:11 +0000 (0:00:00.787) 0:08:17.029 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "c3394aff3e3a3e3920e68205b8e839b3d725648e", "dest": "/etc/modules-load.d/kubespray-br_netfilter.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules-load.d/kubespray-br_netfilter.conf", "size": 12, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "c3394aff3e3a3e3920e68205b8e839b3d725648e", "dest": "/etc/modules-load.d/kubespray-br_netfilter.conf", "gid": 0, "group": "root", "md5sum": "6f034a1d190cd9ba928c0c4df2a4aad4", "mode": "0644", "owner": "root", "size": 12, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330812.08-260452979482065/source", "state": "file", "uid": 0}
TASK [kubernetes/node : Check if bridge-nf-call-iptables key exists] *******************************************************************
Monday 11 March 2019 19:00:13 +0000 (0:00:02.124) 0:08:19.154 **********
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "cmd": ["sysctl", "net.bridge.bridge-nf-call-iptables"], "delta": "0:00:00.004457", "end": "2019-03-11 19:00:14.501593", "failed_when_result": false, "rc": 0, "start": "2019-03-11 19:00:14.497136", "stderr": "", "stderr_lines": [], "stdout": "net.bridge.bridge-nf-call-iptables = 1", "stdout_lines": ["net.bridge.bridge-nf-call-iptables = 1"]}
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "cmd": ["sysctl", "net.bridge.bridge-nf-call-iptables"], "delta": "0:00:00.004178", "end": "2019-03-11 19:00:14.487306", "failed_when_result": false, "rc": 0, "start": "2019-03-11 19:00:14.483128", "stderr": "", "stderr_lines": [], "stdout": "net.bridge.bridge-nf-call-iptables = 1", "stdout_lines": ["net.bridge.bridge-nf-call-iptables = 1"]}
TASK [kubernetes/node : Enable bridge-nf-call tables] **********************************************************************************
Monday 11 March 2019 19:00:14 +0000 (0:00:00.722) 0:08:19.876 **********
ok: [kube-exp-k8s-node-nf-1] => (item=net.bridge.bridge-nf-call-iptables) => {"changed": false, "item": "net.bridge.bridge-nf-call-iptables"}
changed: [kube-exp-k8s-node-nf-2] => (item=net.bridge.bridge-nf-call-iptables) => {"changed": true, "item": "net.bridge.bridge-nf-call-iptables"}
ok: [kube-exp-k8s-node-nf-1] => (item=net.bridge.bridge-nf-call-arptables) => {"changed": false, "item": "net.bridge.bridge-nf-call-arptables"}
changed: [kube-exp-k8s-node-nf-2] => (item=net.bridge.bridge-nf-call-arptables) => {"changed": true, "item": "net.bridge.bridge-nf-call-arptables"}
ok: [kube-exp-k8s-node-nf-1] => (item=net.bridge.bridge-nf-call-ip6tables) => {"changed": false, "item": "net.bridge.bridge-nf-call-ip6tables"}
changed: [kube-exp-k8s-node-nf-2] => (item=net.bridge.bridge-nf-call-ip6tables) => {"changed": true, "item": "net.bridge.bridge-nf-call-ip6tables"}
TASK [kubernetes/node : Modprode Kernel Module for IPVS] *******************************************************************************
Monday 11 March 2019 19:00:16 +0000 (0:00:01.729) 0:08:21.605 **********
ok: [kube-exp-k8s-node-nf-1] => (item=ip_vs) => {"changed": false, "item": "ip_vs", "name": "ip_vs", "params": "", "state": "present"}
changed: [kube-exp-k8s-node-nf-2] => (item=ip_vs) => {"changed": true, "item": "ip_vs", "name": "ip_vs", "params": "", "state": "present"}
ok: [kube-exp-k8s-node-nf-1] => (item=ip_vs_rr) => {"changed": false, "item": "ip_vs_rr", "name": "ip_vs_rr", "params": "", "state": "present"}
ok: [kube-exp-k8s-node-nf-1] => (item=ip_vs_wrr) => {"changed": false, "item": "ip_vs_wrr", "name": "ip_vs_wrr", "params": "", "state": "present"}
changed: [kube-exp-k8s-node-nf-2] => (item=ip_vs_rr) => {"changed": true, "item": "ip_vs_rr", "name": "ip_vs_rr", "params": "", "state": "present"}
ok: [kube-exp-k8s-node-nf-1] => (item=ip_vs_sh) => {"changed": false, "item": "ip_vs_sh", "name": "ip_vs_sh", "params": "", "state": "present"}
changed: [kube-exp-k8s-node-nf-2] => (item=ip_vs_wrr) => {"changed": true, "item": "ip_vs_wrr", "name": "ip_vs_wrr", "params": "", "state": "present"}
ok: [kube-exp-k8s-node-nf-1] => (item=nf_conntrack_ipv4) => {"changed": false, "item": "nf_conntrack_ipv4", "name": "nf_conntrack_ipv4", "params": "", "state": "present"}
changed: [kube-exp-k8s-node-nf-2] => (item=ip_vs_sh) => {"changed": true, "item": "ip_vs_sh", "name": "ip_vs_sh", "params": "", "state": "present"}
ok: [kube-exp-k8s-node-nf-2] => (item=nf_conntrack_ipv4) => {"changed": false, "item": "nf_conntrack_ipv4", "name": "nf_conntrack_ipv4", "params": "", "state": "present"}
TASK [kubernetes/node : Persist ip_vs modules] *****************************************************************************************
Monday 11 March 2019 19:00:19 +0000 (0:00:02.771) 0:08:24.376 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "fb666e350805b04493805c3b11187436eb0a0e31", "dest": "/etc/modules-load.d/kube_proxy-ipvs.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules-load.d/kube_proxy-ipvs.conf", "size": 52, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "fb666e350805b04493805c3b11187436eb0a0e31", "dest": "/etc/modules-load.d/kube_proxy-ipvs.conf", "gid": 0, "group": "root", "md5sum": "d9cc4491b5121715fca6283f5790775c", "mode": "0644", "owner": "root", "size": 52, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330819.44-12758984176105/source", "state": "file", "uid": 0}
TASK [kubernetes/node : Write proxy manifest] ******************************************************************************************
Monday 11 March 2019 19:00:21 +0000 (0:00:02.178) 0:08:26.554 **********
TASK [kubernetes/node : Purge proxy manifest for kubeadm or if proxy services being provided by other means, e.g. network_plugin] ******
Monday 11 March 2019 19:00:21 +0000 (0:00:00.142) 0:08:26.697 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "path": "/etc/kubernetes/manifests/kube-proxy.manifest", "state": "absent"}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "path": "/etc/kubernetes/manifests/kube-proxy.manifest", "state": "absent"}
TASK [kubernetes/node : Cleanup kube-proxy leftovers from node] ************************************************************************
Monday 11 March 2019 19:00:22 +0000 (0:00:00.702) 0:08:27.400 **********
TASK [kubernetes/node : include_tasks] *************************************************************************************************
Monday 11 March 2019 19:00:22 +0000 (0:00:00.181) 0:08:27.582 **********
included: /home/openstack/jetstream_kubespray/roles/kubernetes/node/tasks/openstack-credential-check.yml for kube-exp-k8s-node-nf-1, kube-exp-k8s-node-nf-2
TASK [kubernetes/node : check openstack_auth_url value] ********************************************************************************
Monday 11 March 2019 19:00:22 +0000 (0:00:00.246) 0:08:27.829 **********
TASK [kubernetes/node : check openstack_username value] ********************************************************************************
Monday 11 March 2019 19:00:22 +0000 (0:00:00.141) 0:08:27.971 **********
TASK [kubernetes/node : check openstack_password value] ********************************************************************************
Monday 11 March 2019 19:00:22 +0000 (0:00:00.135) 0:08:28.106 **********
TASK [kubernetes/node : check openstack_region value] **********************************************************************************
Monday 11 March 2019 19:00:23 +0000 (0:00:00.154) 0:08:28.260 **********
TASK [kubernetes/node : check openstack_tenant_id value] *******************************************************************************
Monday 11 March 2019 19:00:23 +0000 (0:00:00.126) 0:08:28.387 **********
TASK [kubernetes/node : check openstack_trust_id value] ********************************************************************************
Monday 11 March 2019 19:00:23 +0000 (0:00:00.164) 0:08:28.552 **********
TASK [kubernetes/node : Write cacert file] *********************************************************************************************
Monday 11 March 2019 19:00:23 +0000 (0:00:00.140) 0:08:28.693 **********
TASK [kubernetes/node : Write cloud-config] ********************************************************************************************
Monday 11 March 2019 19:00:23 +0000 (0:00:00.339) 0:08:29.032 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "checksum": "9626eeffd302e7cf55490d366e220a26c9c5bc89", "dest": "/etc/kubernetes/cloud_config", "gid": 999, "group": "kube-cert", "mode": "0640", "owner": "root", "path": "/etc/kubernetes/cloud_config", "size": 233, "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "9626eeffd302e7cf55490d366e220a26c9c5bc89", "dest": "/etc/kubernetes/cloud_config", "gid": 999, "group": "kube-cert", "md5sum": "238916d20bd8a2fd60298b6c756bf63c", "mode": "0640", "owner": "root", "size": 233, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330824.0-264857282454388/source", "state": "file", "uid": 0}
RUNNING HANDLER [kubernetes/node : restart kubelet] ************************************************************************************
Monday 11 March 2019 19:00:26 +0000 (0:00:02.223) 0:08:31.256 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["/bin/true"], "delta": "0:00:00.003786", "end": "2019-03-11 19:00:26.488509", "rc": 0, "start": "2019-03-11 19:00:26.484723", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [kubernetes/node : Kubelet | reload systemd] ***************************************************************************
Monday 11 March 2019 19:00:26 +0000 (0:00:00.775) 0:08:32.031 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["systemctl", "daemon-reload"], "delta": "0:00:00.202467", "end": "2019-03-11 19:00:27.463741", "rc": 0, "start": "2019-03-11 19:00:27.261274", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [kubernetes/node : Kubelet | reload kubelet] ***************************************************************************
Monday 11 March 2019 19:00:27 +0000 (0:00:00.707) 0:08:32.739 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "name": "kubelet", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target systemd-journald.socket sysinit.target system.slice docker.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Kubernetes Kubelet Server", "DevicePolicy": "auto", "Documentation": "https://github.com/GoogleCloudPlatform/kubernetes", "DynamicUser": "no", "EnvironmentFile": "/etc/kubernetes/kubelet.env (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/local/bin/kubelet ; argv[]=/usr/local/bin/kubelet $KUBE_LOGTOSTDERR $KUBE_LOG_LEVEL $KUBELET_API_SERVER $KUBELET_ADDRESS $KUBELET_PORT $KUBELET_HOSTNAME $KUBE_ALLOW_PRIV $KUBELET_ARGS $DOCKER_SOCKET $KUBELET_NETWORK_PLUGIN $KUBELET_VOLUME_PLUGIN $KUBELET_CLOUDPROVIDER ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/bin/mkdir ; argv[]=/bin/mkdir -p /var/lib/kubelet/volume-plugins ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/kubelet.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "kubelet.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "120504", "LimitNPROCSoft": "120504", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "kubelet.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "always", "RestartUSec": "10s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "User": "root", "UtmpMode": "init", "Wants": "docker.socket", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}}
TASK [kubernetes/node : Enable kubelet] ************************************************************************************************
Monday 11 March 2019 19:00:29 +0000 (0:00:01.766) 0:08:34.505 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "enabled": true, "name": "kubelet", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 18:54:34 UTC", "ActiveEnterTimestampMonotonic": "246522652825", "ActiveExitTimestamp": "Mon 2019-03-11 18:54:34 UTC", "ActiveExitTimestampMonotonic": "246522589536", "ActiveState": "active", "After": "docker.service sysinit.target systemd-journald.socket basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 18:54:34 UTC", "AssertTimestampMonotonic": "246522644443", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 18:54:34 UTC", "ConditionTimestampMonotonic": "246522644442", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/kubelet.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Kubernetes Kubelet Server", "DevicePolicy": "auto", "Documentation": "https://github.com/GoogleCloudPlatform/kubernetes", "DynamicUser": "no", "EnvironmentFile": "/etc/kubernetes/kubelet.env (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "30973", "ExecMainStartTimestamp": "Mon 2019-03-11 18:54:34 UTC", "ExecMainStartTimestampMonotonic": "246522652745", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/local/bin/kubelet ; argv[]=/usr/local/bin/kubelet $KUBE_LOGTOSTDERR $KUBE_LOG_LEVEL $KUBELET_API_SERVER $KUBELET_ADDRESS $KUBELET_PORT $KUBELET_HOSTNAME $KUBE_ALLOW_PRIV $KUBELET_ARGS $DOCKER_SOCKET $KUBELET_NETWORK_PLUGIN $KUBELET_VOLUME_PLUGIN $KUBELET_CLOUDPROVIDER ; ignore_errors=no ; start_time=[Mon 2019-03-11 18:54:34 UTC] ; stop_time=[n/a] ; pid=30973 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/bin/mkdir ; argv[]=/bin/mkdir -p /var/lib/kubelet/volume-plugins ; ignore_errors=yes ; start_time=[Mon 2019-03-11 18:54:34 UTC] ; stop_time=[Mon 2019-03-11 18:54:34 UTC] ; pid=30971 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/kubelet.service", "GID": "0", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "kubelet.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2019-03-11 18:54:34 UTC", "InactiveEnterTimestampMonotonic": "246522640840", "InactiveExitTimestamp": "Mon 2019-03-11 18:54:34 UTC", "InactiveExitTimestampMonotonic": "246522647388", "InvocationID": "92512d9e52d44fe6b34e0e6061a9ce02", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "120504", "LimitNPROCSoft": "120504", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "30973", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "kubelet.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "always", "RestartUSec": "10s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 18:54:34 UTC", "StateChangeTimestampMonotonic": "246522652825", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "0", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "0", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "root", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "docker.socket", "WatchdogTimestamp": "Mon 2019-03-11 18:54:34 UTC", "WatchdogTimestampMonotonic": "246522652823", "WatchdogUSec": "0"}}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "enabled": true, "name": "kubelet", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 19:00:29 UTC", "ActiveEnterTimestampMonotonic": "1366365659", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "docker.service sysinit.target systemd-journald.socket basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 19:00:29 UTC", "AssertTimestampMonotonic": "1366357773", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 19:00:29 UTC", "ConditionTimestampMonotonic": "1366357772", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/kubelet.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Kubernetes Kubelet Server", "DevicePolicy": "auto", "Documentation": "https://github.com/GoogleCloudPlatform/kubernetes", "DynamicUser": "no", "EnvironmentFile": "/etc/kubernetes/kubelet.env (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "17182", "ExecMainStartTimestamp": "Mon 2019-03-11 19:00:29 UTC", "ExecMainStartTimestampMonotonic": "1366365564", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/local/bin/kubelet ; argv[]=/usr/local/bin/kubelet $KUBE_LOGTOSTDERR $KUBE_LOG_LEVEL $KUBELET_API_SERVER $KUBELET_ADDRESS $KUBELET_PORT $KUBELET_HOSTNAME $KUBE_ALLOW_PRIV $KUBELET_ARGS $DOCKER_SOCKET $KUBELET_NETWORK_PLUGIN $KUBELET_VOLUME_PLUGIN $KUBELET_CLOUDPROVIDER ; ignore_errors=no ; start_time=[Mon 2019-03-11 19:00:29 UTC] ; stop_time=[n/a] ; pid=17182 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/bin/mkdir ; argv[]=/bin/mkdir -p /var/lib/kubelet/volume-plugins ; ignore_errors=yes ; start_time=[Mon 2019-03-11 19:00:29 UTC] ; stop_time=[Mon 2019-03-11 19:00:29 UTC] ; pid=17181 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/kubelet.service", "GID": "0", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "kubelet.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-03-11 19:00:29 UTC", "InactiveExitTimestampMonotonic": "1366360250", "InvocationID": "ede0e5ee1a794b4bbc35b630fdc4ee8b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "120504", "LimitNPROCSoft": "120504", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "17182", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "kubelet.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target", "Restart": "always", "RestartUSec": "10s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 19:00:29 UTC", "StateChangeTimestampMonotonic": "1366365659", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "0", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "User": "root", "UtmpMode": "init", "Wants": "docker.socket", "WatchdogTimestamp": "Mon 2019-03-11 19:00:29 UTC", "WatchdogTimestampMonotonic": "1366365657", "WatchdogUSec": "0"}}
TASK [kubernetes/kubeadm : Set kubeadm_discovery_address] ******************************************************************************
Monday 11 March 2019 19:00:30 +0000 (0:00:01.016) 0:08:35.522 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"kubeadm_discovery_address": "10.0.0.12:6443"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"kubeadm_discovery_address": "10.0.0.12:6443"}, "changed": false}
TASK [kubernetes/kubeadm : Check if kubelet.conf exists] *******************************************************************************
Monday 11 March 2019 19:00:30 +0000 (0:00:00.382) 0:08:35.904 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "stat": {"atime": 1552262084.254439, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "52cb83c55918062c8a215c08a50cf642a468aa20", "ctime": 1552086020.0155678, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 7262, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0600", "mtime": 1552086019.6195676, "nlink": 1, "path": "/etc/kubernetes/kubelet.conf", "pw_name": "root", "readable": true, "rgrp": false, "roth": false, "rusr": true, "size": 1850, "uid": 0, "version": "2214715267", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "stat": {"exists": false}}
TASK [kubernetes/kubeadm : Calculate kubeadm CA cert hash] *****************************************************************************
Monday 11 March 2019 19:00:31 +0000 (0:00:00.684) 0:08:36.588 **********
changed: [kube-exp-k8s-node-nf-1 -> None] => {"changed": true, "cmd": "openssl x509 -pubkey -in /etc/kubernetes/ssl/ca.crt | openssl rsa -pubin -outform der 2>/dev/null | openssl dgst -sha256 -hex | sed 's/^.* //'", "delta": "0:00:00.019200", "end": "2019-03-11 19:00:31.850267", "rc": 0, "start": "2019-03-11 19:00:31.831067", "stderr": "", "stderr_lines": [], "stdout": "4d1b15981a294580b45ca9fbdefab75d488f347d5e881fcca2482e55d975507d", "stdout_lines": ["4d1b15981a294580b45ca9fbdefab75d488f347d5e881fcca2482e55d975507d"]}
TASK [kubernetes/kubeadm : Create kubeadm token for joining nodes with 24h expiration (default)] ***************************************
Monday 11 March 2019 19:00:32 +0000 (0:00:00.631) 0:08:37.220 **********
changed: [kube-exp-k8s-node-nf-1 -> None] => {"changed": true, "cmd": ["/usr/local/bin/kubeadm", "token", "create"], "delta": "0:00:00.781696", "end": "2019-03-11 19:00:33.180116", "rc": 0, "start": "2019-03-11 19:00:32.398420", "stderr": "I0311 19:00:32.949634 7133 version.go:236] remote version is much newer: v1.13.4; falling back to: stable-1.12", "stderr_lines": ["I0311 19:00:32.949634 7133 version.go:236] remote version is much newer: v1.13.4; falling back to: stable-1.12"], "stdout": "9i98jz.b0764dr8jiqilpmm", "stdout_lines": ["9i98jz.b0764dr8jiqilpmm"]}
TASK [kubernetes/kubeadm : gets the kubeadm version] ***********************************************************************************
Monday 11 March 2019 19:00:33 +0000 (0:00:01.300) 0:08:38.520 **********
changed: [kube-exp-k8s-node-nf-1] => {"changed": true, "cmd": ["/usr/local/bin/kubeadm", "version", "-o", "short"], "delta": "0:00:00.070058", "end": "2019-03-11 19:00:33.855098", "rc": 0, "start": "2019-03-11 19:00:33.785040", "stderr": "", "stderr_lines": [], "stdout": "v1.12.5", "stdout_lines": ["v1.12.5"]}
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["/usr/local/bin/kubeadm", "version", "-o", "short"], "delta": "0:00:00.050439", "end": "2019-03-11 19:00:33.893138", "rc": 0, "start": "2019-03-11 19:00:33.842699", "stderr": "", "stderr_lines": [], "stdout": "v1.12.5", "stdout_lines": ["v1.12.5"]}
TASK [kubernetes/kubeadm : sets kubeadm api version to v1alpha1] ***********************************************************************
Monday 11 March 2019 19:00:34 +0000 (0:00:00.762) 0:08:39.283 **********
TASK [kubernetes/kubeadm : sets kubeadm api version to v1alpha2] ***********************************************************************
Monday 11 March 2019 19:00:34 +0000 (0:00:00.142) 0:08:39.425 **********
TASK [kubernetes/kubeadm : sets kubeadm api version to v1alpha3] ***********************************************************************
Monday 11 March 2019 19:00:34 +0000 (0:00:00.184) 0:08:39.610 **********
ok: [kube-exp-k8s-node-nf-1] => {"ansible_facts": {"kubeadmConfig_api_version": "v1alpha3"}, "changed": false}
ok: [kube-exp-k8s-node-nf-2] => {"ansible_facts": {"kubeadmConfig_api_version": "v1alpha3"}, "changed": false}
TASK [kubernetes/kubeadm : Create kubeadm client config] *******************************************************************************
Monday 11 March 2019 19:00:34 +0000 (0:00:00.273) 0:08:39.883 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "checksum": "cdb34aeded9d7274f8ab09896510d167e97f1a4c", "dest": "/etc/kubernetes/kubeadm-client.v1alpha3.conf", "gid": 0, "group": "root", "md5sum": "cd63c3dffb54f959db9f9311d20e7102", "mode": "0644", "owner": "root", "size": 456, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330834.86-21000489186605/source", "state": "file", "uid": 0}
changed: [kube-exp-k8s-node-nf-1] => {"backup_file": "/etc/kubernetes/kubeadm-client.v1alpha3.conf.2018.2019-03-11@19:00:37~", "changed": true, "checksum": "a59e75ef08c824c2c8a84d8e79e36dbe5c8d4da6", "dest": "/etc/kubernetes/kubeadm-client.v1alpha3.conf", "gid": 0, "group": "root", "md5sum": "e743f07351f7b960a418bf5bf3fbbf6a", "mode": "0644", "owner": "root", "size": 456, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1552330834.8-60838686043223/source", "state": "file", "uid": 0}
TASK [kubernetes/kubeadm : Join to cluster if needed] **********************************************************************************
Monday 11 March 2019 19:00:37 +0000 (0:00:02.902) 0:08:42.786 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["/usr/local/bin/kubeadm", "join", "--config", "/etc/kubernetes/kubeadm-client.v1alpha3.conf", "--ignore-preflight-errors=all"], "delta": "0:00:09.091821", "end": "2019-03-11 19:00:47.200545", "rc": 0, "start": "2019-03-11 19:00:38.108724", "stderr": "\t[WARNING DirAvailable--etc-kubernetes-manifests]: /etc/kubernetes/manifests is not empty", "stderr_lines": ["\t[WARNING DirAvailable--etc-kubernetes-manifests]: /etc/kubernetes/manifests is not empty"], "stdout": "[preflight] running pre-flight checks\n[discovery] Trying to connect to API Server \"10.0.0.12:6443\"\n[discovery] Created cluster-info discovery client, requesting info from \"https://10.0.0.12:6443\"\n[discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server \"10.0.0.12:6443\"\n[discovery] Successfully established connection with API Server \"10.0.0.12:6443\"\n[kubelet] Downloading configuration for the kubelet from the \"kubelet-config-1.12\" ConfigMap in the kube-system namespace\n[kubelet] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"\n[kubelet] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"\n[preflight] Activating the kubelet service\n[tlsbootstrap] Waiting for the kubelet to perform the TLS Bootstrap...\n[patchnode] Uploading the CRI Socket information \"/var/run/dockershim.sock\" to the Node API object \"kube-exp-k8s-node-nf-2\" as an annotation\n\nThis node has joined the cluster:\n* Certificate signing request was sent to apiserver and a response was received.\n* The Kubelet was informed of the new secure connection details.\n\nRun 'kubectl get nodes' on the master to see this node join the cluster.", "stdout_lines": ["[preflight] running pre-flight checks", "[discovery] Trying to connect to API Server \"10.0.0.12:6443\"", "[discovery] Created cluster-info discovery client, requesting info from \"https://10.0.0.12:6443\"", "[discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server \"10.0.0.12:6443\"", "[discovery] Successfully established connection with API Server \"10.0.0.12:6443\"", "[kubelet] Downloading configuration for the kubelet from the \"kubelet-config-1.12\" ConfigMap in the kube-system namespace", "[kubelet] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"", "[kubelet] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"", "[preflight] Activating the kubelet service", "[tlsbootstrap] Waiting for the kubelet to perform the TLS Bootstrap...", "[patchnode] Uploading the CRI Socket information \"/var/run/dockershim.sock\" to the Node API object \"kube-exp-k8s-node-nf-2\" as an annotation", "", "This node has joined the cluster:", "* Certificate signing request was sent to apiserver and a response was received.", "* The Kubelet was informed of the new secure connection details.", "", "Run 'kubectl get nodes' on the master to see this node join the cluster."]}
TASK [kubernetes/kubeadm : Wait for kubelet bootstrap to create config] ****************************************************************
Monday 11 March 2019 19:00:47 +0000 (0:00:09.781) 0:08:52.568 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "elapsed": 1, "gid": 0, "group": "root", "mode": "0600", "owner": "root", "path": "/etc/kubernetes/kubelet.conf", "port": null, "search_regex": null, "size": 1850, "state": "file", "uid": 0}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "elapsed": 1, "gid": 0, "group": "root", "mode": "0600", "owner": "root", "path": "/etc/kubernetes/kubelet.conf", "port": null, "search_regex": null, "size": 1850, "state": "file", "uid": 0}
TASK [kubernetes/kubeadm : Update server field in kubelet kubeconfig] ******************************************************************
Monday 11 March 2019 19:00:49 +0000 (0:00:01.850) 0:08:54.418 **********
ok: [kube-exp-k8s-node-nf-1] => {"backup": "", "changed": false, "msg": ""}
changed: [kube-exp-k8s-node-nf-2] => {"backup": "/etc/kubernetes/kubelet.conf.17578.2019-03-11@19:00:49~", "changed": true, "msg": "line replaced"}
TASK [kubernetes/kubeadm : Update server field in kube-proxy kubeconfig] ***************************************************************
Monday 11 March 2019 19:00:50 +0000 (0:00:01.142) 0:08:55.561 **********
TASK [kubernetes/kubeadm : Symlink kubelet kubeconfig for calico/canal] ****************************************************************
Monday 11 March 2019 19:00:50 +0000 (0:00:00.132) 0:08:55.694 **********
TASK [kubernetes/kubeadm : Restart all kube-proxy pods to ensure that they load the new configmap] *************************************
Monday 11 March 2019 19:00:50 +0000 (0:00:00.169) 0:08:55.863 **********
TASK [kubernetes/kubeadm : Delete kube-proxy daemonset if kube_proxy_remove set, e.g. kube_network_plugin providing proxy services] ****
Monday 11 March 2019 19:00:50 +0000 (0:00:00.188) 0:08:56.052 **********
TASK [network_plugin/cilium : Cilium | Ensure BFPFS mounted] ***************************************************************************
Monday 11 March 2019 19:00:50 +0000 (0:00:00.134) 0:08:56.186 **********
TASK [network_plugin/cilium : Cilium | Create Cilium certs directory] ******************************************************************
Monday 11 March 2019 19:00:51 +0000 (0:00:00.186) 0:08:56.373 **********
TASK [network_plugin/cilium : Cilium | Link etcd certificates for cilium] **************************************************************
Monday 11 March 2019 19:00:51 +0000 (0:00:00.140) 0:08:56.514 **********
TASK [network_plugin/cilium : Cilium | Create Cilium node manifests] *******************************************************************
Monday 11 March 2019 19:00:51 +0000 (0:00:00.203) 0:08:56.718 **********
TASK [network_plugin/cilium : Cilium | Set CNI directory permissions] ******************************************************************
Monday 11 March 2019 19:00:51 +0000 (0:00:00.232) 0:08:56.951 **********
TASK [network_plugin/cilium : Cilium | Create network policy directory] ****************************************************************
Monday 11 March 2019 19:00:51 +0000 (0:00:00.156) 0:08:57.108 **********
TASK [network_plugin/calico : include_tasks] *******************************************************************************************
Monday 11 March 2019 19:00:52 +0000 (0:00:00.139) 0:08:57.247 **********
TASK [network_plugin/calico : include_tasks] *******************************************************************************************
Monday 11 March 2019 19:00:52 +0000 (0:00:00.133) 0:08:57.380 **********
TASK [network_plugin/calico : Download calico-upgrade tool (force version)] ************************************************************
Monday 11 March 2019 19:00:52 +0000 (0:00:00.169) 0:08:57.550 **********
TASK [network_plugin/calico : Create etcdv2 and etcdv3 calicoApiConfig] ****************************************************************
Monday 11 March 2019 19:00:52 +0000 (0:00:00.148) 0:08:57.698 **********
TASK [network_plugin/calico : Tests data migration (dry-run)] **************************************************************************
Monday 11 March 2019 19:00:52 +0000 (0:00:00.193) 0:08:57.892 **********
TASK [network_plugin/calico : If test migration is success continue with calico data real migration] ***********************************
Monday 11 March 2019 19:00:52 +0000 (0:00:00.150) 0:08:58.042 **********
TASK [network_plugin/calico : include_tasks] *******************************************************************************************
Monday 11 March 2019 19:00:52 +0000 (0:00:00.110) 0:08:58.152 **********
TASK [network_plugin/flannel : Flannel pre-upgrade | Purge legacy flannel systemd unit file] *******************************************
Monday 11 March 2019 19:00:53 +0000 (0:00:00.132) 0:08:58.284 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "path": "/etc/systemd/system/docker.service.d/flannel-options.conf", "state": "absent"}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "path": "/etc/systemd/system/docker.service.d/flannel-options.conf", "state": "absent"}
TASK [network_plugin/flannel : Flannel pre-upgrade | Purge legacy Flannel static pod manifest] *****************************************
Monday 11 March 2019 19:00:53 +0000 (0:00:00.744) 0:08:59.029 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "path": "/etc/kubernetes/manifests/flannel-pod.manifest", "state": "absent"}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "path": "/etc/kubernetes/manifests/flannel-pod.manifest", "state": "absent"}
TASK [network_plugin/flannel : Flannel pre-upgrade | Remove Flannel's certificate directory not required by CNI] ***********************
Monday 11 March 2019 19:00:54 +0000 (0:00:00.687) 0:08:59.716 **********
ok: [kube-exp-k8s-node-nf-1] => {"changed": false, "path": "/etc/flannel/certs", "state": "absent"}
ok: [kube-exp-k8s-node-nf-2] => {"changed": false, "path": "/etc/flannel/certs", "state": "absent"}
TASK [network_plugin/flannel : Flannel | Create Flannel manifests] *********************************************************************
Monday 11 March 2019 19:00:55 +0000 (0:00:00.706) 0:09:00.423 **********
TASK [network_plugin/weave : Weave | Set cni directory permissions] ********************************************************************
Monday 11 March 2019 19:00:55 +0000 (0:00:00.210) 0:09:00.634 **********
TASK [network_plugin/weave : Weave | Copy cni plugins] *********************************************************************************
Monday 11 March 2019 19:00:55 +0000 (0:00:00.138) 0:09:00.773 **********
TASK [network_plugin/weave : Weave | Create manifest] **********************************************************************************
Monday 11 March 2019 19:00:55 +0000 (0:00:00.121) 0:09:00.894 **********
TASK [network_plugin/weave : Weave | Fix nodePort for Weave] ***************************************************************************
Monday 11 March 2019 19:00:55 +0000 (0:00:00.143) 0:09:01.037 **********
TASK [network_plugin/canal : Canal | Write Canal cni config] ***************************************************************************
Monday 11 March 2019 19:00:55 +0000 (0:00:00.121) 0:09:01.159 **********
TASK [network_plugin/canal : Canal | Create canal certs directory] *********************************************************************
Monday 11 March 2019 19:00:56 +0000 (0:00:00.126) 0:09:01.286 **********
TASK [network_plugin/canal : Canal | Link etcd certificates for canal-node] ************************************************************
Monday 11 March 2019 19:00:56 +0000 (0:00:00.134) 0:09:01.421 **********
TASK [network_plugin/canal : Canal | Set Flannel etcd configuration] *******************************************************************
Monday 11 March 2019 19:00:56 +0000 (0:00:00.261) 0:09:01.682 **********
TASK [network_plugin/canal : Canal | Create canal node manifests] **********************************************************************
Monday 11 March 2019 19:00:56 +0000 (0:00:00.117) 0:09:01.800 **********
TASK [network_plugin/canal : Canal | Set cni directory permissions] ********************************************************************
Monday 11 March 2019 19:00:56 +0000 (0:00:00.261) 0:09:02.062 **********
TASK [network_plugin/canal : Canal | Copy cni plugins] *********************************************************************************
Monday 11 March 2019 19:00:57 +0000 (0:00:00.138) 0:09:02.200 **********
TASK [network_plugin/canal : Canal | Copy cni plugins from calico/cni] *****************************************************************
Monday 11 March 2019 19:00:57 +0000 (0:00:00.188) 0:09:02.389 **********
TASK [network_plugin/canal : Canal | Set cni directory permissions] ********************************************************************
Monday 11 March 2019 19:00:57 +0000 (0:00:00.169) 0:09:02.558 **********
TASK [network_plugin/canal : Canal | Install calicoctl container script] ***************************************************************
Monday 11 March 2019 19:00:57 +0000 (0:00:00.168) 0:09:02.726 **********
TASK [network_plugin/canal : Canal | Create network policy directory] ******************************************************************
Monday 11 March 2019 19:00:57 +0000 (0:00:00.150) 0:09:02.877 **********
TASK [network_plugin/contiv : Contiv | Load openvswitch kernel module] *****************************************************************
Monday 11 March 2019 19:00:57 +0000 (0:00:00.117) 0:09:02.995 **********
TASK [network_plugin/contiv : Contiv | Create contiv etcd directories] *****************************************************************
Monday 11 March 2019 19:00:57 +0000 (0:00:00.136) 0:09:03.131 **********
TASK [network_plugin/contiv : Contiv | Workaround https://github.com/contiv/netplugin/issues/1152] *************************************
Monday 11 March 2019 19:00:58 +0000 (0:00:00.225) 0:09:03.356 **********
TASK [network_plugin/contiv : Contiv | Set necessary facts] ****************************************************************************
Monday 11 March 2019 19:00:58 +0000 (0:00:00.161) 0:09:03.518 **********
TASK [network_plugin/contiv : set_fact] ************************************************************************************************
Monday 11 March 2019 19:00:58 +0000 (0:00:00.161) 0:09:03.680 **********
TASK [network_plugin/contiv : Contiv | Create /var/contiv] *****************************************************************************
Monday 11 March 2019 19:00:58 +0000 (0:00:00.194) 0:09:03.874 **********
TASK [network_plugin/contiv : Contiv | Create contiv config directory] *****************************************************************
Monday 11 March 2019 19:00:58 +0000 (0:00:00.134) 0:09:04.009 **********
TASK [network_plugin/contiv : Contiv | Install all Kubernetes resources] ***************************************************************
Monday 11 March 2019 19:00:58 +0000 (0:00:00.152) 0:09:04.161 **********
TASK [network_plugin/contiv : Contiv | Copy certs generation script] *******************************************************************
Monday 11 March 2019 19:00:59 +0000 (0:00:00.254) 0:09:04.415 **********
TASK [network_plugin/contiv : Contiv | Check for cert key existence] *******************************************************************
Monday 11 March 2019 19:00:59 +0000 (0:00:00.172) 0:09:04.588 **********
TASK [network_plugin/contiv : Contiv | Generate contiv-api-proxy certificates] *********************************************************
Monday 11 March 2019 19:00:59 +0000 (0:00:00.198) 0:09:04.786 **********
TASK [network_plugin/contiv : Contiv | Fetch the generated certificate] ****************************************************************
Monday 11 March 2019 19:00:59 +0000 (0:00:00.173) 0:09:04.959 **********
TASK [network_plugin/contiv : Contiv | Copy the generated certificate on nodes] ********************************************************
Monday 11 March 2019 19:00:59 +0000 (0:00:00.156) 0:09:05.115 **********
TASK [network_plugin/contiv : Contiv | Set cni directory permissions] ******************************************************************
Monday 11 March 2019 19:01:00 +0000 (0:00:00.191) 0:09:05.307 **********
TASK [network_plugin/contiv : Contiv | Copy cni plugins] *******************************************************************************
Monday 11 March 2019 19:01:00 +0000 (0:00:00.153) 0:09:05.461 **********
TASK [network_plugin/contiv : Contiv | Copy netctl binary from docker container] *******************************************************
Monday 11 March 2019 19:01:00 +0000 (0:00:00.165) 0:09:05.626 **********
TASK [network_plugin/kube-router : kube-router | Add annotations on kube-master] *******************************************************
Monday 11 March 2019 19:01:00 +0000 (0:00:00.210) 0:09:05.837 **********
TASK [network_plugin/kube-router : kube-router | Add annotations on kube-node] *********************************************************
Monday 11 March 2019 19:01:00 +0000 (0:00:00.219) 0:09:06.056 **********
TASK [network_plugin/kube-router : kube-router | Add common annotations on all servers] ************************************************
Monday 11 March 2019 19:01:01 +0000 (0:00:00.193) 0:09:06.249 **********
TASK [network_plugin/kube-router : kube-roter | Set cni directory permissions] *********************************************************
Monday 11 March 2019 19:01:01 +0000 (0:00:00.127) 0:09:06.377 **********
TASK [network_plugin/kube-router : kube-router | Copy cni plugins] *********************************************************************
Monday 11 March 2019 19:01:01 +0000 (0:00:00.203) 0:09:06.580 **********
TASK [network_plugin/kube-router : kube-router | Create manifest] **********************************************************************
Monday 11 March 2019 19:01:01 +0000 (0:00:00.148) 0:09:06.729 **********
TASK [network_plugin/cloud : Cloud | Set cni directory permissions] ********************************************************************
Monday 11 March 2019 19:01:01 +0000 (0:00:00.148) 0:09:06.878 **********
TASK [network_plugin/cloud : Canal | Copy cni plugins] *********************************************************************************
Monday 11 March 2019 19:01:01 +0000 (0:00:00.150) 0:09:07.028 **********
TASK [network_plugin/multus : Multus | Copy manifest files] ****************************************************************************
Monday 11 March 2019 19:01:01 +0000 (0:00:00.136) 0:09:07.164 **********
TASK [network_plugin/multus : Multus | Copy manifest templates] ************************************************************************
Monday 11 March 2019 19:01:02 +0000 (0:00:00.213) 0:09:07.377 **********
RUNNING HANDLER [kubernetes/node : restart kubelet] ************************************************************************************
Monday 11 March 2019 19:01:02 +0000 (0:00:00.121) 0:09:07.499 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["/bin/true"], "delta": "0:00:00.003558", "end": "2019-03-11 19:01:02.989349", "rc": 0, "start": "2019-03-11 19:01:02.985791", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [kubernetes/node : Kubelet | reload systemd] ***************************************************************************
Monday 11 March 2019 19:01:03 +0000 (0:00:00.989) 0:09:08.488 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "cmd": ["systemctl", "daemon-reload"], "delta": "0:00:00.169269", "end": "2019-03-11 19:01:03.948510", "rc": 0, "start": "2019-03-11 19:01:03.779241", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
RUNNING HANDLER [kubernetes/node : Kubelet | reload kubelet] ***************************************************************************
Monday 11 March 2019 19:01:04 +0000 (0:00:00.769) 0:09:09.258 **********
changed: [kube-exp-k8s-node-nf-2] => {"changed": true, "name": "kubelet", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-03-11 19:00:41 UTC", "ActiveEnterTimestampMonotonic": "1378388454", "ActiveExitTimestamp": "Mon 2019-03-11 19:00:30 UTC", "ActiveExitTimestampMonotonic": "1367877726", "ActiveState": "active", "After": "basic.target system.slice docker.service systemd-journald.socket sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-03-11 19:00:41 UTC", "AssertTimestampMonotonic": "1378382247", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-03-11 19:00:41 UTC", "ConditionTimestampMonotonic": "1378382247", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/kubelet.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Kubernetes Kubelet Server", "DevicePolicy": "auto", "Documentation": "https://github.com/GoogleCloudPlatform/kubernetes", "DynamicUser": "no", "EnvironmentFile": "/etc/kubernetes/kubelet.env (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "17440", "ExecMainStartTimestamp": "Mon 2019-03-11 19:00:41 UTC", "ExecMainStartTimestampMonotonic": "1378388399", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/local/bin/kubelet ; argv[]=/usr/local/bin/kubelet $KUBE_LOGTOSTDERR $KUBE_LOG_LEVEL $KUBELET_API_SERVER $KUBELET_ADDRESS $KUBELET_PORT $KUBELET_HOSTNAME $KUBE_ALLOW_PRIV $KUBELET_ARGS $DOCKER_SOCKET $KUBELET_NETWORK_PLUGIN $KUBELET_VOLUME_PLUGIN $KUBELET_CLOUDPROVIDER ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPre": "{ path=/bin/mkdir ; argv[]=/bin/mkdir -p /var/lib/kubelet/volume-plugins ; ignore_errors=yes ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/etc/systemd/system/kubelet.service", "GID": "0", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "kubelet.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2019-03-11 19:00:40 UTC", "InactiveEnterTimestampMonotonic": "1377491150", "InactiveExitTimestamp": "Mon 2019-03-11 19:00:41 UTC", "InactiveExitTimestampMonotonic": "1378383379", "InvocationID": "645f625b98bb49fab093d1745e5466e2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "120504", "LimitNPROCSoft": "120504", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "120504", "LimitSIGPENDINGSoft": "120504", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "17440", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "kubelet.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice", "Restart": "always", "RestartUSec": "10s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-03-11 19:00:41 UTC", "StateChangeTimestampMonotonic": "1378388454", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "28", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "0", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "root", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "docker.socket", "WatchdogTimestamp": "Mon 2019-03-11 19:00:41 UTC", "WatchdogTimestampMonotonic": "1378388449", "WatchdogUSec": "0"}}
to retry, use: --limit @/home/openstack/jetstream_kubespray/scale.retry
PLAY RECAP *****************************************************************************************************************************
kube-exp-k8s-master-1 : ok=25  changed=3  unreachable=0 failed=0
kube-exp-k8s-node-nf-1 : ok=247  changed=16  unreachable=0 failed=0
kube-exp-k8s-node-nf-2 : ok=259  changed=80  unreachable=0 failed=0
kube-exp-k8s-node-nf-3 : ok=22  changed=4  unreachable=0 failed=1 
localhost : ok=1  changed=0 unreachable=0 failed=0
Monday 11 March 2019 19:01:04 +0000 (0:00:00.900) 0:09:10.159 **********
===============================================================================
kubernetes/preinstall : Install packages requirements -------------------------------------------------------------------------- 45.33s
container-engine/docker : ensure docker packages are installed ----------------------------------------------------------------- 33.93s
download : container_download | Download containers if pull is required or told to always pull (all nodes) --------------------- 26.08s
download : container_download | Download containers if pull is required or told to always pull (all nodes) --------------------- 24.44s
container-engine/docker : Ensure old versions of Docker are not installed. | Debian -------------------------------------------- 16.85s
download : container_download | Download containers if pull is required or told to always pull (all nodes) --------------------- 13.79s
kubernetes/preinstall : Update package management cache (APT) ------------------------------------------------------------------ 13.69s
download : container_download | Download containers if pull is required or told to always pull (all nodes) --------------------- 12.65s
download : container_download | Download containers if pull is required or told to always pull (all nodes) --------------------- 11.50s
bootstrap-os : Bootstrap | Install python 2.x and pip -------------------------------------------------------------------------- 11.20s
container-engine/docker : Docker | pause while Docker restarts ----------------------------------------------------------------- 10.20s
kubernetes/kubeadm : Join to cluster if needed ---------------------------------------------------------------------------------- 9.78s
container-engine/docker : ensure docker-ce repository is enabled ---------------------------------------------------------------- 9.02s
download : container_download | Download containers if pull is required or told to always pull (all nodes) ---------------------- 8.50s
container-engine/docker : Docker | reload docker -------------------------------------------------------------------------------- 6.38s
bootstrap-os : Fetch /etc/os-release -------------------------------------------------------------------------------------------- 5.29s
download : file_download | Download item ---------------------------------------------------------------------------------------- 5.28s
download : container_download | Download containers if pull is required or told to always pull (all nodes) ---------------------- 4.80s
download : container_download | Download containers if pull is required or told to always pull (all nodes) ---------------------- 4.44s
adduser : User | Create User Group ---------------------------------------------------------------------------------------------- 3.53s
sh-4.2$ exit
exit
Script done on Mon Mar 11 19:01:39 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment