Skip to content

Instantly share code, notes, and snippets.

@alexchiri
Created December 1, 2019 15:13
Show Gist options
  • Save alexchiri/8aae6cb84fdf99d914d023c2add245d5 to your computer and use it in GitHub Desktop.
Save alexchiri/8aae6cb84fdf99d914d023c2add245d5 to your computer and use it in GitHub Desktop.
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:36.770044437Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:36.770081115Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:36.77340601Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:36.773433909Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:36.878662578Z"}
{"log":"I1201 13:58:36.878671 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:36.878770754Z"}
{"log":"I1201 13:58:36.878911 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:36.879031742Z"}
{"log":"F1201 13:58:37.239940 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:37.240104408Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:37.900360954Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:37.900397863Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:37.900938509Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:37.901011275Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:38.009951976Z"}
{"log":"I1201 13:58:38.010017 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:38.010140078Z"}
{"log":"I1201 13:58:38.010311 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:38.010391559Z"}
{"log":"F1201 13:58:38.603510 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:38.603650443Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:39.379952728Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:39.380010505Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:39.380494498Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:39.380577215Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:39.492801805Z"}
{"log":"I1201 13:58:39.492882 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:39.493005537Z"}
{"log":"I1201 13:58:39.493164 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:39.493232119Z"}
{"log":"F1201 13:58:40.043865 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:40.044000665Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:41.003883662Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:41.003922841Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:41.006748573Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:41.006766322Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:41.119023443Z"}
{"log":"I1201 13:58:41.119114 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:41.119239226Z"}
{"log":"I1201 13:58:41.119333 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:41.11941293Z"}
{"log":"F1201 13:58:41.676874 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:41.677019456Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:43.051273234Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:43.051315663Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:43.05261139Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:43.052947741Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:43.167494541Z"}
{"log":"I1201 13:58:43.167515 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:43.167609077Z"}
{"log":"I1201 13:58:43.167755 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:43.167825392Z"}
{"log":"F1201 13:58:43.529645 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:43.529783774Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:45.687615634Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:45.687653443Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:45.689703231Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:45.689724092Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:45.80088653Z"}
{"log":"I1201 13:58:45.800954 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:45.801083235Z"}
{"log":"I1201 13:58:45.801225 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:45.801308721Z"}
{"log":"F1201 13:58:46.161188 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:46.161339497Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:49.916297276Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:49.916334685Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:49.918762289Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:49.91877723Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:50.028610473Z"}
{"log":"I1201 13:58:50.028635 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:50.028741422Z"}
{"log":"I1201 13:58:50.028883 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:50.028986131Z"}
{"log":"F1201 13:58:51.100601 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:51.100766189Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:58:58.073139345Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:58.073183085Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:58:58.073684648Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:58:58.07377623Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:58:58.188951088Z"}
{"log":"I1201 13:58:58.188998 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:58:58.189120779Z"}
{"log":"I1201 13:58:58.189223 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:58:58.1892638Z"}
{"log":"F1201 13:58:59.002203 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:58:59.002343222Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:12.367098748Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:12.367128618Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:12.367141459Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:12.367146919Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:12.477853389Z"}
{"log":"I1201 13:59:12.477902 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:12.478021504Z"}
{"log":"I1201 13:59:12.478167 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:12.478271181Z"}
{"log":"F1201 13:59:12.815762 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:59:12.815928509Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:38.977265577Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:38.97731953Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:38.978727223Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:38.978910182Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:39.100629522Z"}
{"log":"I1201 13:59:39.100736 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:39.100847113Z"}
{"log":"I1201 13:59:39.101007 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:39.101098783Z"}
{"log":"F1201 13:59:39.707099 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:59:39.707242738Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:50.67290072Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:50.672933242Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:50.672986404Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:50.67450758Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:50.792413851Z"}
{"log":"I1201 13:59:50.792435 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:50.79258054Z"}
{"log":"I1201 13:59:50.792709 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:50.79279291Z"}
{"log":"F1201 13:59:51.252210 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:59:51.252369249Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:51.972687037Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:51.972730649Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:51.972736499Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:51.972742809Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:52.090738668Z"}
{"log":"I1201 13:59:52.090823 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:52.090948259Z"}
{"log":"I1201 13:59:52.091146 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:52.091211633Z"}
{"log":"F1201 13:59:52.488181 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:59:52.488337504Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:53.265235172Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:53.265280474Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:53.265287074Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:53.265293456Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:53.379682719Z"}
{"log":"I1201 13:59:53.379724 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:53.379878119Z"}
{"log":"I1201 13:59:53.380049 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:53.380127142Z"}
{"log":"F1201 13:59:53.947700 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:59:53.947841195Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:54.939926906Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:54.939983729Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:54.94117203Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:54.941190001Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:55.056315949Z"}
{"log":"I1201 13:59:55.056366 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:55.056494338Z"}
{"log":"I1201 13:59:55.056649 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:55.056689888Z"}
{"log":"F1201 13:59:55.431375 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:59:55.431517267Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:56.807605927Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:56.807634288Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:56.80766306Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:56.8076706Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:56.927891532Z"}
{"log":"I1201 13:59:56.927974 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:56.928101242Z"}
{"log":"I1201 13:59:56.928323 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:56.928382697Z"}
{"log":"F1201 13:59:57.344630 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T13:59:57.344749542Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T13:59:59.525065865Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:59.525104997Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T13:59:59.52762394Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T13:59:59.527648451Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T13:59:59.644510187Z"}
{"log":"I1201 13:59:59.644588 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T13:59:59.644704857Z"}
{"log":"I1201 13:59:59.644880 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T13:59:59.64495443Z"}
{"log":"F1201 14:00:00.319255 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:00:00.319383097Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:00:04.128941982Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:04.128993805Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:00:04.129571876Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:04.12964056Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:00:04.250550748Z"}
{"log":"I1201 14:00:04.250654 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:00:04.250765169Z"}
{"log":"I1201 14:00:04.250944 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:00:04.251016613Z"}
{"log":"F1201 14:00:05.317944 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:00:05.318104526Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:00:12.30388665Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:12.303927443Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:00:12.307203313Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:12.307232225Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:00:12.423485929Z"}
{"log":"I1201 14:00:12.423540 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:00:12.423664839Z"}
{"log":"I1201 14:00:12.423806 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:00:12.423859859Z"}
{"log":"F1201 14:00:12.856767 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:00:12.856896082Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:26.232917046Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:00:26.232960159Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:00:26.234300275Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:26.234503417Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:00:26.351115894Z"}
{"log":"I1201 14:00:26.351194 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:00:26.351339706Z"}
{"log":"I1201 14:00:26.351475 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:00:26.35157541Z"}
{"log":"F1201 14:00:27.101554 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:00:27.101689305Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:53.288953525Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:00:53.288996253Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:00:53.290633352Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:00:53.290655051Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:00:53.405120444Z"}
{"log":"I1201 14:00:53.405189 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:00:53.405332377Z"}
{"log":"I1201 14:00:53.405479 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:00:53.405569018Z"}
{"log":"F1201 14:00:53.756426 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:00:53.75661554Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:01:45.552008848Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:01:45.552044199Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:01:45.552068818Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:01:45.552918547Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:01:45.675778204Z"}
{"log":"I1201 14:01:45.675840 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:01:45.675961647Z"}
{"log":"I1201 14:01:45.676093 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:01:45.676132598Z"}
{"log":"F1201 14:01:46.815790 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:01:46.815889632Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:05.317125787Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:05.317173878Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:05.317180378Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:05.317187048Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:05.441404755Z"}
{"log":"I1201 14:02:05.441487 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:05.441594648Z"}
{"log":"I1201 14:02:05.441800 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:05.441881224Z"}
{"log":"F1201 14:02:06.262437 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:06.262587354Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:07.096780615Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:07.096822426Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:07.096837567Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:07.096843327Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:07.210445553Z"}
{"log":"I1201 14:02:07.210518 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:07.210651037Z"}
{"log":"I1201 14:02:07.210794 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:07.210871111Z"}
{"log":"F1201 14:02:08.090551 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:08.090693684Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:08.882821744Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:08.882898906Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:08.884400088Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:08.8844938Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:09.007139182Z"}
{"log":"I1201 14:02:09.007180 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:09.007291655Z"}
{"log":"I1201 14:02:09.007428 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:09.007475739Z"}
{"log":"F1201 14:02:09.628003 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:09.628146784Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:10.608097691Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:10.608148202Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:10.610795882Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:10.610820973Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:10.731831726Z"}
{"log":"I1201 14:02:10.731876 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:10.732031811Z"}
{"log":"I1201 14:02:10.732232 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:10.732328547Z"}
{"log":"F1201 14:02:11.305269 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:11.305440133Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:12.683931202Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:12.683992104Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:12.685483379Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:12.685562711Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:12.801624594Z"}
{"log":"I1201 14:02:12.801675 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:12.801792337Z"}
{"log":"I1201 14:02:12.801941 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:12.802008932Z"}
{"log":"F1201 14:02:13.386631 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:13.386749088Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:15.631379286Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:15.631424967Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:15.636761087Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:15.636798238Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:15.753114519Z"}
{"log":"I1201 14:02:15.753210 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:15.753319633Z"}
{"log":"I1201 14:02:15.753475 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:15.753546439Z"}
{"log":"F1201 14:02:16.344879 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:16.345045105Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:20.164614647Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:20.164671728Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:20.165796668Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:20.16587313Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:20.287698932Z"}
{"log":"I1201 14:02:20.287785 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:20.287912278Z"}
{"log":"I1201 14:02:20.288056 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:20.288137534Z"}
{"log":"F1201 14:02:21.372635 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:21.372780002Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:28.490418292Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:28.490473633Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:28.490481034Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:28.490486864Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:28.614641007Z"}
{"log":"I1201 14:02:28.614770 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:28.614869653Z"}
{"log":"I1201 14:02:28.615024 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:28.61511209Z"}
{"log":"F1201 14:02:29.376749 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:29.376892962Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:42.792029467Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:02:42.792075018Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:02:42.793597357Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:02:42.793802334Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:02:42.913623136Z"}
{"log":"I1201 14:02:42.913652 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:02:42.913723659Z"}
{"log":"I1201 14:02:42.913882 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:02:42.913943876Z"}
{"log":"F1201 14:02:43.758604 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:02:43.758735755Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:03:09.938122743Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:03:09.938196015Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:03:09.94546054Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:03:09.945487612Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:03:10.052934111Z"}
{"log":"I1201 14:03:10.053033 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:03:10.053137558Z"}
{"log":"I1201 14:03:10.053281 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:03:10.053355377Z"}
{"log":"F1201 14:03:10.728130 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:03:10.728254669Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:04:02.523121567Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:04:02.52317949Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:04:02.527262697Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:04:02.527291039Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:04:02.636783048Z"}
{"log":"I1201 14:04:02.636871 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:04:02.637014868Z"}
{"log":"I1201 14:04:02.637159 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:04:02.637228238Z"}
{"log":"F1201 14:04:03.030051 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:04:03.030195178Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:03.824401046Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:03.824440305Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:03.824467324Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:03.824473803Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:03.974879957Z"}
{"log":"I1201 14:05:03.975036 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:03.97515278Z"}
{"log":"I1201 14:05:03.975462 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:03.975557689Z"}
{"log":"Error: failed to create listener: failed to listen on 0.0.0.0:6443: listen tcp 0.0.0.0:6443: bind: address already in use\n","stream":"stderr","time":"2019-12-01T14:05:03.975819071Z"}
{"log":"Usage:\n","stream":"stderr","time":"2019-12-01T14:05:03.976798304Z"}
{"log":" kube-apiserver [flags]\n","stream":"stderr","time":"2019-12-01T14:05:03.976812584Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.976817884Z"}
{"log":"Generic flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.976822364Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.976827073Z"}
{"log":" --advertise-address ip The IP address on which to advertise the apiserver to members of the cluster. This address must be reachable by the rest of the cluster. If blank, the --bind-address will be used. If --bind-address is unspecified, the host's default interface will be used.\n","stream":"stderr","time":"2019-12-01T14:05:03.976831743Z"}
{"log":" --cors-allowed-origins strings List of allowed origins for CORS, comma separated. An allowed origin can be a regular expression to support subdomain matching. If this list is empty CORS will not be enabled.\n","stream":"stderr","time":"2019-12-01T14:05:03.976837223Z"}
{"log":" --default-not-ready-toleration-seconds int Indicates the tolerationSeconds of the toleration for notReady:NoExecute that is added by default to every pod that does not already have such a toleration. (default 300)\n","stream":"stderr","time":"2019-12-01T14:05:03.976842713Z"}
{"log":" --default-unreachable-toleration-seconds int Indicates the tolerationSeconds of the toleration for unreachable:NoExecute that is added by default to every pod that does not already have such a toleration. (default 300)\n","stream":"stderr","time":"2019-12-01T14:05:03.976847082Z"}
{"log":" --enable-inflight-quota-handler If true, replace the max-in-flight handler with an enhanced one that queues and dispatches with priority and fairness\n","stream":"stderr","time":"2019-12-01T14:05:03.976851162Z"}
{"log":" --external-hostname string The hostname to use when generating externalized URLs for this master (e.g. Swagger API Docs).\n","stream":"stderr","time":"2019-12-01T14:05:03.976854713Z"}
{"log":" --feature-gates mapStringBool A set of key=value pairs that describe feature gates for alpha/experimental features. Options are:\n","stream":"stderr","time":"2019-12-01T14:05:03.976858373Z"}
{"log":" APIListChunking=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976861893Z"}
{"log":" APIResponseCompression=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976865203Z"}
{"log":" AllAlpha=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976868522Z"}
{"log":" AppArmor=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976871842Z"}
{"log":" AttachVolumeLimit=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976875192Z"}
{"log":" BalanceAttachedNodeVolumes=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976879522Z"}
{"log":" BlockVolume=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976883032Z"}
{"log":" BoundServiceAccountTokenVolume=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976886381Z"}
{"log":" CPUManager=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976898171Z"}
{"log":" CRIContainerLogRotation=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976901922Z"}
{"log":" CSIBlockVolume=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976905352Z"}
{"log":" CSIDriverRegistry=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976909521Z"}
{"log":" CSIInlineVolume=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976913891Z"}
{"log":" CSIMigration=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976918371Z"}
{"log":" CSIMigrationAWS=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976922761Z"}
{"log":" CSIMigrationAzureDisk=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.97692749Z"}
{"log":" CSIMigrationAzureFile=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.97693224Z"}
{"log":" CSIMigrationGCE=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.97693683Z"}
{"log":" CSIMigrationOpenStack=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.97694074Z"}
{"log":" CSINodeInfo=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976944241Z"}
{"log":" CustomCPUCFSQuotaPeriod=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.9769476Z"}
{"log":" CustomResourceDefaulting=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976951Z"}
{"log":" DevicePlugins=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.97695435Z"}
{"log":" DryRun=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.97695767Z"}
{"log":" DynamicAuditing=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.97696152Z"}
{"log":" DynamicKubeletConfig=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.97696492Z"}
{"log":" EndpointSlice=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976968359Z"}
{"log":" EphemeralContainers=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976971719Z"}
{"log":" EvenPodsSpread=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976975049Z"}
{"log":" ExpandCSIVolumes=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976978429Z"}
{"log":" ExpandInUsePersistentVolumes=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976981739Z"}
{"log":" ExpandPersistentVolumes=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.976989169Z"}
{"log":" ExperimentalHostUserNamespaceDefaulting=true|false (BETA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976992889Z"}
{"log":" HPAScaleToZero=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.976996309Z"}
{"log":" HyperVContainer=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977000119Z"}
{"log":" IPv6DualStack=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977004519Z"}
{"log":" KubeletPodResources=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977008868Z"}
{"log":" LegacyNodeRoleBehavior=true|false (ALPHA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977013248Z"}
{"log":" LocalStorageCapacityIsolation=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977017768Z"}
{"log":" LocalStorageCapacityIsolationFSQuotaMonitoring=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977022328Z"}
{"log":" MountContainers=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977026688Z"}
{"log":" NodeDisruptionExclusion=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977030687Z"}
{"log":" NodeLease=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977034108Z"}
{"log":" NonPreemptingPriority=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977038178Z"}
{"log":" PodOverhead=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977041568Z"}
{"log":" PodShareProcessNamespace=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977044918Z"}
{"log":" ProcMountType=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977048267Z"}
{"log":" QOSReserved=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977051587Z"}
{"log":" RemainingItemCount=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977054887Z"}
{"log":" RemoveSelfLink=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977058217Z"}
{"log":" RequestManagement=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977061527Z"}
{"log":" ResourceLimitsPriorityFunction=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977064857Z"}
{"log":" ResourceQuotaScopeSelectors=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977068196Z"}
{"log":" RotateKubeletClientCertificate=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977071516Z"}
{"log":" RotateKubeletServerCertificate=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977080167Z"}
{"log":" RunAsGroup=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977083827Z"}
{"log":" RuntimeClass=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977087186Z"}
{"log":" SCTPSupport=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977090976Z"}
{"log":" ScheduleDaemonSetPods=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977095386Z"}
{"log":" ServerSideApply=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977099736Z"}
{"log":" ServiceLoadBalancerFinalizer=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977103936Z"}
{"log":" ServiceNodeExclusion=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977108625Z"}
{"log":" StartupProbe=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977120755Z"}
{"log":" StorageVersionHash=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977124426Z"}
{"log":" StreamingProxyRedirects=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977127755Z"}
{"log":" SupportNodePidsLimit=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977131145Z"}
{"log":" SupportPodPidsLimit=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977134475Z"}
{"log":" Sysctls=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977137845Z"}
{"log":" TTLAfterFinished=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977141155Z"}
{"log":" TaintBasedEvictions=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977144465Z"}
{"log":" TaintNodesByCondition=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977147764Z"}
{"log":" TokenRequest=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977151084Z"}
{"log":" TokenRequestProjection=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977154374Z"}
{"log":" TopologyManager=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977162444Z"}
{"log":" ValidateProxyRedirects=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977165934Z"}
{"log":" VolumePVCDataSource=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977169264Z"}
{"log":" VolumeSnapshotDataSource=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977172544Z"}
{"log":" VolumeSubpathEnvExpansion=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977180034Z"}
{"log":" WatchBookmark=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977184744Z"}
{"log":" WinDSR=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977189183Z"}
{"log":" WinOverlay=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977193663Z"}
{"log":" WindowsGMSA=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977198203Z"}
{"log":" WindowsRunAsUserName=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:05:03.977203323Z"}
{"log":" --livez-grace-period duration This option represents the maximum amount of time it should take for apiserver to complete its startup sequence and become live. From apiserver's start time to when this amount of time has elapsed, /livez will assume that unfinished post-start hooks will complete successfully and therefore return true.\n","stream":"stderr","time":"2019-12-01T14:05:03.977208112Z"}
{"log":" --master-service-namespace string DEPRECATED: the namespace from which the kubernetes master services should be injected into pods. (default \"default\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977212852Z"}
{"log":" --max-mutating-requests-inflight int The maximum number of mutating requests in flight at a given time. When the server exceeds this, it rejects requests. Zero for no limit. (default 200)\n","stream":"stderr","time":"2019-12-01T14:05:03.977216813Z"}
{"log":" --max-requests-inflight int The maximum number of non-mutating requests in flight at a given time. When the server exceeds this, it rejects requests. Zero for no limit. (default 400)\n","stream":"stderr","time":"2019-12-01T14:05:03.977220493Z"}
{"log":" --min-request-timeout int An optional field indicating the minimum number of seconds a handler must keep a request open before timing it out. Currently only honored by the watch request handler, which picks a randomized value above this number as the connection timeout, to spread out load. (default 1800)\n","stream":"stderr","time":"2019-12-01T14:05:03.977224233Z"}
{"log":" --request-timeout duration An optional field indicating the duration a handler must keep a request open before timing it out. This is the default request timeout for requests but may be overridden by flags such as --min-request-timeout for specific types of requests. (default 1m0s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977228142Z"}
{"log":" --shutdown-delay-duration duration Time to delay the termination. During that time the server keeps serving requests normally and /healthz returns success, but /readzy immediately returns failure. Graceful termination starts after this delay has elapsed. This can be used to allow load balancer to stop sending traffic to this server.\n","stream":"stderr","time":"2019-12-01T14:05:03.977232002Z"}
{"log":" --target-ram-mb int Memory limit for apiserver in MB (used to configure sizes of caches, etc.)\n","stream":"stderr","time":"2019-12-01T14:05:03.977236192Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977239672Z"}
{"log":"Etcd flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977242802Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977245982Z"}
{"log":" --default-watch-cache-size int Default watch cache size. If zero, watch cache will be disabled for resources that do not have a default watch size set. (default 100)\n","stream":"stderr","time":"2019-12-01T14:05:03.977249071Z"}
{"log":" --delete-collection-workers int Number of workers spawned for DeleteCollection call. These are used to speed up namespace cleanup. (default 1)\n","stream":"stderr","time":"2019-12-01T14:05:03.977256681Z"}
{"log":" --enable-garbage-collector Enables the generic garbage collector. MUST be synced with the corresponding flag of the kube-controller-manager. (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977260392Z"}
{"log":" --encryption-provider-config string The file containing configuration for encryption providers to be used for storing secrets in etcd\n","stream":"stderr","time":"2019-12-01T14:05:03.977263882Z"}
{"log":" --etcd-cafile string SSL Certificate Authority file used to secure etcd communication.\n","stream":"stderr","time":"2019-12-01T14:05:03.977267232Z"}
{"log":" --etcd-certfile string SSL certification file used to secure etcd communication.\n","stream":"stderr","time":"2019-12-01T14:05:03.977270541Z"}
{"log":" --etcd-compaction-interval duration The interval of compaction requests. If 0, the compaction request from apiserver is disabled. (default 5m0s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977274651Z"}
{"log":" --etcd-count-metric-poll-period duration Frequency of polling etcd for number of resources per type. 0 disables the metric collection. (default 1m0s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977279101Z"}
{"log":" --etcd-keyfile string SSL key file used to secure etcd communication.\n","stream":"stderr","time":"2019-12-01T14:05:03.977283531Z"}
{"log":" --etcd-prefix string The prefix to prepend to all resource paths in etcd. (default \"/registry\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977287971Z"}
{"log":" --etcd-servers strings List of etcd servers to connect with (scheme://ip:port), comma separated.\n","stream":"stderr","time":"2019-12-01T14:05:03.97729297Z"}
{"log":" --etcd-servers-overrides strings Per-resource etcd servers overrides, comma separated. The individual override format: group/resource#servers, where servers are URLs, semicolon separated.\n","stream":"stderr","time":"2019-12-01T14:05:03.97729774Z"}
{"log":" --storage-backend string The storage backend for persistence. Options: 'etcd3' (default).\n","stream":"stderr","time":"2019-12-01T14:05:03.97730251Z"}
{"log":" --storage-media-type string The media type to use to store objects in storage. Some resources or storage backends may only support a specific media type and will ignore this setting. (default \"application/vnd.kubernetes.protobuf\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977306951Z"}
{"log":" --watch-cache Enable watch caching in the apiserver (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.9773109Z"}
{"log":" --watch-cache-sizes strings Watch cache size settings for some resources (pods, nodes, etc.), comma separated. The individual setting format: resource[.group]#size, where resource is lowercase plural (no version), group is omitted for resources of apiVersion v1 (the legacy core API) and included for others, and size is a number. It takes effect when watch-cache is enabled. Some resources (replicationcontrollers, endpoints, nodes, pods, services, apiservices.apiregistration.k8s.io) have system defaults set by heuristics, others default to default-watch-cache-size\n","stream":"stderr","time":"2019-12-01T14:05:03.97731469Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.97731908Z"}
{"log":"Secure serving flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.97732215Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.97732533Z"}
{"log":" --bind-address ip The IP address on which to listen for the --secure-port port. The associated interface(s) must be reachable by the rest of the cluster, and by CLI/web clients. If blank, all interfaces will be used (0.0.0.0 for all IPv4 interfaces and :: for all IPv6 interfaces). (default 0.0.0.0)\n","stream":"stderr","time":"2019-12-01T14:05:03.97732846Z"}
{"log":" --cert-dir string The directory where the TLS certs are located. If --tls-cert-file and --tls-private-key-file are provided, this flag will be ignored. (default \"/var/run/kubernetes\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977338199Z"}
{"log":" --http2-max-streams-per-connection int The limit that the server gives to clients for the maximum number of streams in an HTTP/2 connection. Zero means to use golang's default.\n","stream":"stderr","time":"2019-12-01T14:05:03.977342219Z"}
{"log":" --secure-port int The port on which to serve HTTPS with authentication and authorization.It cannot be switched off with 0. (default 6443)\n","stream":"stderr","time":"2019-12-01T14:05:03.977345769Z"}
{"log":" --tls-cert-file string File containing the default x509 Certificate for HTTPS. (CA cert, if any, concatenated after server cert). If HTTPS serving is enabled, and --tls-cert-file and --tls-private-key-file are not provided, a self-signed certificate and key are generated for the public address and saved to the directory specified by --cert-dir.\n","stream":"stderr","time":"2019-12-01T14:05:03.977349679Z"}
{"log":" --tls-cipher-suites strings Comma-separated list of cipher suites for the server. If omitted, the default Go cipher suites will be use. Possible values: TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_ECDSA_WITH_RC4_128_SHA,TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_RC4_128_SHA,TLS_RSA_WITH_3DES_EDE_CBC_SHA,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_128_CBC_SHA256,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_RC4_128_SHA\n","stream":"stderr","time":"2019-12-01T14:05:03.977353829Z"}
{"log":" --tls-min-version string Minimum TLS version supported. Possible values: VersionTLS10, VersionTLS11, VersionTLS12, VersionTLS13\n","stream":"stderr","time":"2019-12-01T14:05:03.977358959Z"}
{"log":" --tls-private-key-file string File containing the default x509 private key matching --tls-cert-file.\n","stream":"stderr","time":"2019-12-01T14:05:03.977362389Z"}
{"log":" --tls-sni-cert-key namedCertKey A pair of x509 certificate and private key file paths, optionally suffixed with a list of domain patterns which are fully qualified domain names, possibly with prefixed wildcard segments. If no domain patterns are provided, the names of the certificate are extracted. Non-wildcard matches trump over wildcard matches, explicit domain patterns trump over extracted names. For multiple key/certificate pairs, use the --tls-sni-cert-key multiple times. Examples: \"example.crt,example.key\" or \"foo.crt,foo.key:*.foo.com,foo.com\". (default [])\n","stream":"stderr","time":"2019-12-01T14:05:03.977366679Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977372888Z"}
{"log":"Insecure serving flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977376928Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977381408Z"}
{"log":" --address ip The IP address on which to serve the insecure --port (set to 0.0.0.0 for all IPv4 interfaces and :: for all IPv6 interfaces). (default 127.0.0.1) (DEPRECATED: see --bind-address instead.)\n","stream":"stderr","time":"2019-12-01T14:05:03.977385988Z"}
{"log":" --insecure-bind-address ip The IP address on which to serve the --insecure-port (set to 0.0.0.0 for all IPv4 interfaces and :: for all IPv6 interfaces). (default 127.0.0.1) (DEPRECATED: This flag will be removed in a future version.)\n","stream":"stderr","time":"2019-12-01T14:05:03.977394968Z"}
{"log":" --insecure-port int The port on which to serve unsecured, unauthenticated access. (default 8080) (DEPRECATED: This flag will be removed in a future version.)\n","stream":"stderr","time":"2019-12-01T14:05:03.977399068Z"}
{"log":" --port int The port on which to serve unsecured, unauthenticated access. Set to 0 to disable. (default 8080) (DEPRECATED: see --secure-port instead.)\n","stream":"stderr","time":"2019-12-01T14:05:03.977402578Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977406148Z"}
{"log":"Auditing flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977409247Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977412387Z"}
{"log":" --audit-dynamic-configuration Enables dynamic audit configuration. This feature also requires the DynamicAuditing feature flag\n","stream":"stderr","time":"2019-12-01T14:05:03.977415517Z"}
{"log":" --audit-log-batch-buffer-size int The size of the buffer to store events before batching and writing. Only used in batch mode. (default 10000)\n","stream":"stderr","time":"2019-12-01T14:05:03.977418997Z"}
{"log":" --audit-log-batch-max-size int The maximum size of a batch. Only used in batch mode. (default 1)\n","stream":"stderr","time":"2019-12-01T14:05:03.977422477Z"}
{"log":" --audit-log-batch-max-wait duration The amount of time to wait before force writing the batch that hadn't reached the max size. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:05:03.977425847Z"}
{"log":" --audit-log-batch-throttle-burst int Maximum number of requests sent at the same moment if ThrottleQPS was not utilized before. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:05:03.977429286Z"}
{"log":" --audit-log-batch-throttle-enable Whether batching throttling is enabled. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:05:03.977432746Z"}
{"log":" --audit-log-batch-throttle-qps float32 Maximum average number of batches per second. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:05:03.977436156Z"}
{"log":" --audit-log-format string Format of saved audits. \"legacy\" indicates 1-line text format for each event. \"json\" indicates structured json format. Known formats are legacy,json. (default \"json\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977439597Z"}
{"log":" --audit-log-maxage int The maximum number of days to retain old audit log files based on the timestamp encoded in their filename.\n","stream":"stderr","time":"2019-12-01T14:05:03.977443927Z"}
{"log":" --audit-log-maxbackup int The maximum number of old audit log files to retain.\n","stream":"stderr","time":"2019-12-01T14:05:03.977447487Z"}
{"log":" --audit-log-maxsize int The maximum size in megabytes of the audit log file before it gets rotated.\n","stream":"stderr","time":"2019-12-01T14:05:03.977450856Z"}
{"log":" --audit-log-mode string Strategy for sending audit events. Blocking indicates sending events should block server responses. Batch causes the backend to buffer and write events asynchronously. Known modes are batch,blocking,blocking-strict. (default \"blocking\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977454446Z"}
{"log":" --audit-log-path string If set, all requests coming to the apiserver will be logged to this file. '-' means standard out.\n","stream":"stderr","time":"2019-12-01T14:05:03.977459636Z"}
{"log":" --audit-log-truncate-enabled Whether event and batch truncating is enabled.\n","stream":"stderr","time":"2019-12-01T14:05:03.977464126Z"}
{"log":" --audit-log-truncate-max-batch-size int Maximum size of the batch sent to the underlying backend. Actual serialized size can be several hundreds of bytes greater. If a batch exceeds this limit, it is split into several batches of smaller size. (default 10485760)\n","stream":"stderr","time":"2019-12-01T14:05:03.977478675Z"}
{"log":" --audit-log-truncate-max-event-size int Maximum size of the audit event sent to the underlying backend. If the size of an event is greater than this number, first request and response are removed, and if this doesn't reduce the size enough, event is discarded. (default 102400)\n","stream":"stderr","time":"2019-12-01T14:05:03.977484976Z"}
{"log":" --audit-log-version string API group and version used for serializing audit events written to log. (default \"audit.k8s.io/v1\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977488926Z"}
{"log":" --audit-policy-file string Path to the file that defines the audit policy configuration.\n","stream":"stderr","time":"2019-12-01T14:05:03.977492575Z"}
{"log":" --audit-webhook-batch-buffer-size int The size of the buffer to store events before batching and writing. Only used in batch mode. (default 10000)\n","stream":"stderr","time":"2019-12-01T14:05:03.977496015Z"}
{"log":" --audit-webhook-batch-max-size int The maximum size of a batch. Only used in batch mode. (default 400)\n","stream":"stderr","time":"2019-12-01T14:05:03.977499485Z"}
{"log":" --audit-webhook-batch-max-wait duration The amount of time to wait before force writing the batch that hadn't reached the max size. Only used in batch mode. (default 30s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977503255Z"}
{"log":" --audit-webhook-batch-throttle-burst int Maximum number of requests sent at the same moment if ThrottleQPS was not utilized before. Only used in batch mode. (default 15)\n","stream":"stderr","time":"2019-12-01T14:05:03.977506845Z"}
{"log":" --audit-webhook-batch-throttle-enable Whether batching throttling is enabled. Only used in batch mode. (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977510354Z"}
{"log":" --audit-webhook-batch-throttle-qps float32 Maximum average number of batches per second. Only used in batch mode. (default 10)\n","stream":"stderr","time":"2019-12-01T14:05:03.977513764Z"}
{"log":" --audit-webhook-config-file string Path to a kubeconfig formatted file that defines the audit webhook configuration.\n","stream":"stderr","time":"2019-12-01T14:05:03.977517154Z"}
{"log":" --audit-webhook-initial-backoff duration The amount of time to wait before retrying the first failed request. (default 10s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977525344Z"}
{"log":" --audit-webhook-mode string Strategy for sending audit events. Blocking indicates sending events should block server responses. Batch causes the backend to buffer and write events asynchronously. Known modes are batch,blocking,blocking-strict. (default \"batch\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977528815Z"}
{"log":" --audit-webhook-truncate-enabled Whether event and batch truncating is enabled.\n","stream":"stderr","time":"2019-12-01T14:05:03.977532664Z"}
{"log":" --audit-webhook-truncate-max-batch-size int Maximum size of the batch sent to the underlying backend. Actual serialized size can be several hundreds of bytes greater. If a batch exceeds this limit, it is split into several batches of smaller size. (default 10485760)\n","stream":"stderr","time":"2019-12-01T14:05:03.977536004Z"}
{"log":" --audit-webhook-truncate-max-event-size int Maximum size of the audit event sent to the underlying backend. If the size of an event is greater than this number, first request and response are removed, and if this doesn't reduce the size enough, event is discarded. (default 102400)\n","stream":"stderr","time":"2019-12-01T14:05:03.977539734Z"}
{"log":" --audit-webhook-version string API group and version used for serializing audit events written to webhook. (default \"audit.k8s.io/v1\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977546994Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977551893Z"}
{"log":"Features flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977556023Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977559983Z"}
{"log":" --contention-profiling Enable lock contention profiling, if profiling is enabled\n","stream":"stderr","time":"2019-12-01T14:05:03.977564153Z"}
{"log":" --profiling Enable profiling via web interface host:port/debug/pprof/ (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977569113Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977573643Z"}
{"log":"Authentication flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977577413Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977580673Z"}
{"log":" --anonymous-auth Enables anonymous requests to the secure port of the API server. Requests that are not rejected by another authentication method are treated as anonymous requests. Anonymous requests have a username of system:anonymous, and a group name of system:unauthenticated. (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977583883Z"}
{"log":" --api-audiences strings Identifiers of the API. The service account token authenticator will validate that tokens used against the API are bound to at least one of these audiences. If the --service-account-issuer flag is configured and this flag is not, this field defaults to a single element list containing the issuer URL .\n","stream":"stderr","time":"2019-12-01T14:05:03.977587813Z"}
{"log":" --authentication-token-webhook-cache-ttl duration The duration to cache responses from the webhook token authenticator. (default 2m0s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977591742Z"}
{"log":" --authentication-token-webhook-config-file string File with webhook configuration for token authentication in kubeconfig format. The API server will query the remote service to determine authentication for bearer tokens.\n","stream":"stderr","time":"2019-12-01T14:05:03.977595212Z"}
{"log":" --client-ca-file string If set, any request presenting a client certificate signed by one of the authorities in the client-ca-file is authenticated with an identity corresponding to the CommonName of the client certificate.\n","stream":"stderr","time":"2019-12-01T14:05:03.977603442Z"}
{"log":" --enable-bootstrap-token-auth Enable to allow secrets of type 'bootstrap.kubernetes.io/token' in the 'kube-system' namespace to be used for TLS bootstrapping authentication.\n","stream":"stderr","time":"2019-12-01T14:05:03.977607252Z"}
{"log":" --oidc-ca-file string If set, the OpenID server's certificate will be verified by one of the authorities in the oidc-ca-file, otherwise the host's root CA set will be used.\n","stream":"stderr","time":"2019-12-01T14:05:03.977610841Z"}
{"log":" --oidc-client-id string The client ID for the OpenID Connect client, must be set if oidc-issuer-url is set.\n","stream":"stderr","time":"2019-12-01T14:05:03.977614441Z"}
{"log":" --oidc-groups-claim string If provided, the name of a custom OpenID Connect claim for specifying user groups. The claim value is expected to be a string or array of strings. This flag is experimental, please see the authentication documentation for further details.\n","stream":"stderr","time":"2019-12-01T14:05:03.977618242Z"}
{"log":" --oidc-groups-prefix string If provided, all groups will be prefixed with this value to prevent conflicts with other authentication strategies.\n","stream":"stderr","time":"2019-12-01T14:05:03.977622092Z"}
{"log":" --oidc-issuer-url string The URL of the OpenID issuer, only HTTPS scheme will be accepted. If set, it will be used to verify the OIDC JSON Web Token (JWT).\n","stream":"stderr","time":"2019-12-01T14:05:03.977629312Z"}
{"log":" --oidc-required-claim mapStringString A key=value pair that describes a required claim in the ID Token. If set, the claim is verified to be present in the ID Token with a matching value. Repeat this flag to specify multiple claims.\n","stream":"stderr","time":"2019-12-01T14:05:03.977633081Z"}
{"log":" --oidc-signing-algs strings Comma-separated list of allowed JOSE asymmetric signing algorithms. JWTs with a 'alg' header value not in this list will be rejected. Values are defined by RFC 7518 https://tools.ietf.org/html/rfc7518#section-3.1. (default [RS256])\n","stream":"stderr","time":"2019-12-01T14:05:03.977636931Z"}
{"log":" --oidc-username-claim string The OpenID claim to use as the user name. Note that claims other than the default ('sub') is not guaranteed to be unique and immutable. This flag is experimental, please see the authentication documentation for further details. (default \"sub\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977641771Z"}
{"log":" --oidc-username-prefix string If provided, all usernames will be prefixed with this value. If not provided, username claims other than 'email' are prefixed by the issuer URL to avoid clashes. To skip any prefixing, provide the value '-'.\n","stream":"stderr","time":"2019-12-01T14:05:03.977646891Z"}
{"log":" --requestheader-allowed-names strings List of client certificate common names to allow to provide usernames in headers specified by --requestheader-username-headers. If empty, any client certificate validated by the authorities in --requestheader-client-ca-file is allowed.\n","stream":"stderr","time":"2019-12-01T14:05:03.97765201Z"}
{"log":" --requestheader-client-ca-file string Root certificate bundle to use to verify client certificates on incoming requests before trusting usernames in headers specified by --requestheader-username-headers. WARNING: generally do not depend on authorization being already done for incoming requests.\n","stream":"stderr","time":"2019-12-01T14:05:03.977664081Z"}
{"log":" --requestheader-extra-headers-prefix strings List of request header prefixes to inspect. X-Remote-Extra- is suggested.\n","stream":"stderr","time":"2019-12-01T14:05:03.977669271Z"}
{"log":" --requestheader-group-headers strings List of request headers to inspect for groups. X-Remote-Group is suggested.\n","stream":"stderr","time":"2019-12-01T14:05:03.97767332Z"}
{"log":" --requestheader-username-headers strings List of request headers to inspect for usernames. X-Remote-User is common.\n","stream":"stderr","time":"2019-12-01T14:05:03.9776768Z"}
{"log":" --service-account-issuer string Identifier of the service account token issuer. The issuer will assert this identifier in \"iss\" claim of issued tokens. This value is a string or URI.\n","stream":"stderr","time":"2019-12-01T14:05:03.97768031Z"}
{"log":" --service-account-key-file stringArray File containing PEM-encoded x509 RSA or ECDSA private or public keys, used to verify ServiceAccount tokens. The specified file can contain multiple keys, and the flag can be specified multiple times with different files. If unspecified, --tls-private-key-file is used. Must be specified when --service-account-signing-key is provided\n","stream":"stderr","time":"2019-12-01T14:05:03.97768422Z"}
{"log":" --service-account-lookup If true, validate ServiceAccount tokens exist in etcd as part of authentication. (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.97768831Z"}
{"log":" --service-account-max-token-expiration duration The maximum validity duration of a token created by the service account token issuer. If an otherwise valid TokenRequest with a validity duration larger than this value is requested, a token will be issued with a validity duration of this value.\n","stream":"stderr","time":"2019-12-01T14:05:03.977691779Z"}
{"log":" --token-auth-file string If set, the file that will be used to secure the secure port of the API server via token authentication.\n","stream":"stderr","time":"2019-12-01T14:05:03.977699419Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977703169Z"}
{"log":"Authorization flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977706389Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.97770956Z"}
{"log":" --authorization-mode strings Ordered list of plug-ins to do authorization on secure port. Comma-delimited list of: AlwaysAllow,AlwaysDeny,ABAC,Webhook,RBAC,Node. (default [AlwaysAllow])\n","stream":"stderr","time":"2019-12-01T14:05:03.977713519Z"}
{"log":" --authorization-policy-file string File with authorization policy in json line by line format, used with --authorization-mode=ABAC, on the secure port.\n","stream":"stderr","time":"2019-12-01T14:05:03.977717159Z"}
{"log":" --authorization-webhook-cache-authorized-ttl duration The duration to cache 'authorized' responses from the webhook authorizer. (default 5m0s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977720719Z"}
{"log":" --authorization-webhook-cache-unauthorized-ttl duration The duration to cache 'unauthorized' responses from the webhook authorizer. (default 30s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977724149Z"}
{"log":" --authorization-webhook-config-file string File with webhook configuration in kubeconfig format, used with --authorization-mode=Webhook. The API server will query the remote service to determine access on the API server's secure port.\n","stream":"stderr","time":"2019-12-01T14:05:03.977727579Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977731848Z"}
{"log":"Cloud provider flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977736148Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977740268Z"}
{"log":" --cloud-config string The path to the cloud provider configuration file. Empty string for no configuration file.\n","stream":"stderr","time":"2019-12-01T14:05:03.977744198Z"}
{"log":" --cloud-provider string The provider for cloud services. Empty string for no provider.\n","stream":"stderr","time":"2019-12-01T14:05:03.977748928Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977753258Z"}
{"log":"Api enablement flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977757598Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977761388Z"}
{"log":" --runtime-config mapStringString A set of key=value pairs that describe runtime configuration that may be passed to apiserver. \u003cgroup\u003e/\u003cversion\u003e (or \u003cversion\u003e for the core group) key can be used to turn on/off specific api versions. api/all is special key to control all api versions, be careful setting it false, unless you know what you do. api/legacy is deprecated, we will remove it in the future, so stop using it. (default )\n","stream":"stderr","time":"2019-12-01T14:05:03.977764788Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977769648Z"}
{"log":"Egress selector flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977772757Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977775977Z"}
{"log":" --egress-selector-config-file string File with apiserver egress selector configuration.\n","stream":"stderr","time":"2019-12-01T14:05:03.977779097Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977782357Z"}
{"log":"Admission flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977785417Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977788537Z"}
{"log":" --admission-control strings Admission is divided into two phases. In the first phase, only mutating admission plugins run. In the second phase, only validating admission plugins run. The names in the below list may represent a validating plugin, a mutating plugin, or both. The order of plugins in which they are passed to this flag does not matter. Comma-delimited list of: AlwaysAdmit, AlwaysDeny, AlwaysPullImages, DefaultStorageClass, DefaultTolerationSeconds, DenyEscalatingExec, DenyExecOnPrivileged, EventRateLimit, ExtendedResourceToleration, ImagePolicyWebhook, LimitPodHardAntiAffinityTopology, LimitRanger, MutatingAdmissionWebhook, NamespaceAutoProvision, NamespaceExists, NamespaceLifecycle, NodeRestriction, OwnerReferencesPermissionEnforcement, PersistentVolumeClaimResize, PersistentVolumeLabel, PodNodeSelector, PodPreset, PodSecurityPolicy, PodTolerationRestriction, Priority, ResourceQuota, RuntimeClass, SecurityContextDeny, ServiceAccount, StorageObjectInUseProtection, TaintNodesByCondition, ValidatingAdmissionWebhook. (DEPRECATED: Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version.)\n","stream":"stderr","time":"2019-12-01T14:05:03.977865555Z"}
{"log":" --admission-control-config-file string File with admission control configuration.\n","stream":"stderr","time":"2019-12-01T14:05:03.977889685Z"}
{"log":" --disable-admission-plugins strings admission plugins that should be disabled although they are in the default enabled plugins list (NamespaceLifecycle, LimitRanger, ServiceAccount, TaintNodesByCondition, Priority, DefaultTolerationSeconds, DefaultStorageClass, StorageObjectInUseProtection, PersistentVolumeClaimResize, MutatingAdmissionWebhook, ValidatingAdmissionWebhook, RuntimeClass, ResourceQuota). Comma-delimited list of admission plugins: AlwaysAdmit, AlwaysDeny, AlwaysPullImages, DefaultStorageClass, DefaultTolerationSeconds, DenyEscalatingExec, DenyExecOnPrivileged, EventRateLimit, ExtendedResourceToleration, ImagePolicyWebhook, LimitPodHardAntiAffinityTopology, LimitRanger, MutatingAdmissionWebhook, NamespaceAutoProvision, NamespaceExists, NamespaceLifecycle, NodeRestriction, OwnerReferencesPermissionEnforcement, PersistentVolumeClaimResize, PersistentVolumeLabel, PodNodeSelector, PodPreset, PodSecurityPolicy, PodTolerationRestriction, Priority, ResourceQuota, RuntimeClass, SecurityContextDeny, ServiceAccount, StorageObjectInUseProtection, TaintNodesByCondition, ValidatingAdmissionWebhook. The order of plugins in this flag does not matter.\n","stream":"stderr","time":"2019-12-01T14:05:03.977896014Z"}
{"log":" --enable-admission-plugins strings admission plugins that should be enabled in addition to default enabled ones (NamespaceLifecycle, LimitRanger, ServiceAccount, TaintNodesByCondition, Priority, DefaultTolerationSeconds, DefaultStorageClass, StorageObjectInUseProtection, PersistentVolumeClaimResize, MutatingAdmissionWebhook, ValidatingAdmissionWebhook, RuntimeClass, ResourceQuota). Comma-delimited list of admission plugins: AlwaysAdmit, AlwaysDeny, AlwaysPullImages, DefaultStorageClass, DefaultTolerationSeconds, DenyEscalatingExec, DenyExecOnPrivileged, EventRateLimit, ExtendedResourceToleration, ImagePolicyWebhook, LimitPodHardAntiAffinityTopology, LimitRanger, MutatingAdmissionWebhook, NamespaceAutoProvision, NamespaceExists, NamespaceLifecycle, NodeRestriction, OwnerReferencesPermissionEnforcement, PersistentVolumeClaimResize, PersistentVolumeLabel, PodNodeSelector, PodPreset, PodSecurityPolicy, PodTolerationRestriction, Priority, ResourceQuota, RuntimeClass, SecurityContextDeny, ServiceAccount, StorageObjectInUseProtection, TaintNodesByCondition, ValidatingAdmissionWebhook. The order of plugins in this flag does not matter.\n","stream":"stderr","time":"2019-12-01T14:05:03.977905174Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977913533Z"}
{"log":"Misc flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.977917413Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.977921233Z"}
{"log":" --allow-privileged If true, allow privileged containers. [default=false]\n","stream":"stderr","time":"2019-12-01T14:05:03.977928723Z"}
{"log":" --apiserver-count int The number of apiservers running in the cluster, must be a positive number. (In use when --endpoint-reconciler-type=master-count is enabled.) (default 1)\n","stream":"stderr","time":"2019-12-01T14:05:03.977933513Z"}
{"log":" --enable-aggregator-routing Turns on aggregator routing requests to endpoints IP rather than cluster IP.\n","stream":"stderr","time":"2019-12-01T14:05:03.977938233Z"}
{"log":" --endpoint-reconciler-type string Use an endpoint reconciler (master-count, lease, none) (default \"lease\")\n","stream":"stderr","time":"2019-12-01T14:05:03.977942473Z"}
{"log":" --event-ttl duration Amount of time to retain events. (default 1h0m0s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977946883Z"}
{"log":" --kubelet-certificate-authority string Path to a cert file for the certificate authority.\n","stream":"stderr","time":"2019-12-01T14:05:03.977951183Z"}
{"log":" --kubelet-client-certificate string Path to a client cert file for TLS.\n","stream":"stderr","time":"2019-12-01T14:05:03.977955362Z"}
{"log":" --kubelet-client-key string Path to a client key file for TLS.\n","stream":"stderr","time":"2019-12-01T14:05:03.977960102Z"}
{"log":" --kubelet-https Use https for kubelet connections. (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.977964612Z"}
{"log":" --kubelet-preferred-address-types strings List of the preferred NodeAddressTypes to use for kubelet connections. (default [Hostname,InternalDNS,InternalIP,ExternalDNS,ExternalIP])\n","stream":"stderr","time":"2019-12-01T14:05:03.977968992Z"}
{"log":" --kubelet-timeout duration Timeout for kubelet operations. (default 5s)\n","stream":"stderr","time":"2019-12-01T14:05:03.977973511Z"}
{"log":" --kubernetes-service-node-port int If non-zero, the Kubernetes master service (which apiserver creates/maintains) will be of type NodePort, using this as the value of the port. If zero, the Kubernetes master service will be of type ClusterIP.\n","stream":"stderr","time":"2019-12-01T14:05:03.977977832Z"}
{"log":" --max-connection-bytes-per-sec int If non-zero, throttle each user connection to this number of bytes/sec. Currently only applies to long-running requests.\n","stream":"stderr","time":"2019-12-01T14:05:03.977982642Z"}
{"log":" --proxy-client-cert-file string Client certificate used to prove the identity of the aggregator or kube-apiserver when it must call out during a request. This includes proxying requests to a user api-server and calling out to webhook admission plugins. It is expected that this cert includes a signature from the CA in the --requestheader-client-ca-file flag. That CA is published in the 'extension-apiserver-authentication' configmap in the kube-system namespace. Components receiving calls from kube-aggregator should use that CA to perform their half of the mutual TLS verification.\n","stream":"stderr","time":"2019-12-01T14:05:03.977987172Z"}
{"log":" --proxy-client-key-file string Private key for the client certificate used to prove the identity of the aggregator or kube-apiserver when it must call out during a request. This includes proxying requests to a user api-server and calling out to webhook admission plugins.\n","stream":"stderr","time":"2019-12-01T14:05:03.977993501Z"}
{"log":" --service-account-signing-key-file string Path to the file that contains the current private key of the service account token issuer. The issuer will sign issued ID tokens with this private key. (Requires the 'TokenRequest' feature gate.)\n","stream":"stderr","time":"2019-12-01T14:05:03.977998341Z"}
{"log":" --service-cluster-ip-range string A CIDR notation IP range from which to assign service cluster IPs. This must not overlap with any IP ranges assigned to nodes for pods. (default \"10.0.0.0/24\")\n","stream":"stderr","time":"2019-12-01T14:05:03.978003871Z"}
{"log":" --service-node-port-range portRange A port range to reserve for services with NodePort visibility. Example: '30000-32767'. Inclusive at both ends of the range. (default 30000-32767)\n","stream":"stderr","time":"2019-12-01T14:05:03.978012371Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.97801726Z"}
{"log":"Global flags:\n","stream":"stderr","time":"2019-12-01T14:05:03.978021291Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.978025171Z"}
{"log":" --add-dir-header If true, adds the file directory to the header\n","stream":"stderr","time":"2019-12-01T14:05:03.978029051Z"}
{"log":" --alsologtostderr log to standard error as well as files\n","stream":"stderr","time":"2019-12-01T14:05:03.97803333Z"}
{"log":" -h, --help help for kube-apiserver\n","stream":"stderr","time":"2019-12-01T14:05:03.97803775Z"}
{"log":" --log-backtrace-at traceLocation when logging hits line file:N, emit a stack trace (default :0)\n","stream":"stderr","time":"2019-12-01T14:05:03.97804232Z"}
{"log":" --log-dir string If non-empty, write log files in this directory\n","stream":"stderr","time":"2019-12-01T14:05:03.9780469Z"}
{"log":" --log-file string If non-empty, use this log file\n","stream":"stderr","time":"2019-12-01T14:05:03.97805127Z"}
{"log":" --log-file-max-size uint Defines the maximum size a log file can grow to. Unit is megabytes. If the value is 0, the maximum file size is unlimited. (default 1800)\n","stream":"stderr","time":"2019-12-01T14:05:03.978055429Z"}
{"log":" --log-flush-frequency duration Maximum number of seconds between log flushes (default 5s)\n","stream":"stderr","time":"2019-12-01T14:05:03.978059919Z"}
{"log":" --logtostderr log to standard error instead of files (default true)\n","stream":"stderr","time":"2019-12-01T14:05:03.978064069Z"}
{"log":" --skip-headers If true, avoid header prefixes in the log messages\n","stream":"stderr","time":"2019-12-01T14:05:03.97806868Z"}
{"log":" --skip-log-headers If true, avoid headers when opening log files\n","stream":"stderr","time":"2019-12-01T14:05:03.978073069Z"}
{"log":" --stderrthreshold severity logs at or above this threshold go to stderr (default 2)\n","stream":"stderr","time":"2019-12-01T14:05:03.978077589Z"}
{"log":" -v, --v Level number for the log level verbosity\n","stream":"stderr","time":"2019-12-01T14:05:03.978081679Z"}
{"log":" --version version[=true] Print version information and quit\n","stream":"stderr","time":"2019-12-01T14:05:03.978085659Z"}
{"log":" --vmodule moduleSpec comma-separated list of pattern=N settings for file-filtered logging\n","stream":"stderr","time":"2019-12-01T14:05:03.978090269Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:05:03.978094698Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:21.082447927Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:21.082485036Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:21.084179415Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:21.084205945Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:21.203752398Z"}
{"log":"I1201 14:05:21.203804 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:21.203950325Z"}
{"log":"I1201 14:05:21.204146 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:21.20423026Z"}
{"log":"F1201 14:05:21.601471 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:21.601631171Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:22.3029264Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:22.302961359Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:22.304571999Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:22.304661198Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:22.425234731Z"}
{"log":"I1201 14:05:22.425289 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:22.425436007Z"}
{"log":"I1201 14:05:22.425590 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:22.425680233Z"}
{"log":"F1201 14:05:22.738287 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:22.7384071Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:23.500132767Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:23.500181716Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:23.500676797Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:23.500849044Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:23.613553593Z"}
{"log":"I1201 14:05:23.613646 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:23.613757649Z"}
{"log":"I1201 14:05:23.613938 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:23.613997796Z"}
{"log":"F1201 14:05:24.302785 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:24.302912472Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:25.288586239Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:25.288613178Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:25.288772306Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:25.288960332Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:25.408453537Z"}
{"log":"I1201 14:05:25.408551 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:25.408660073Z"}
{"log":"I1201 14:05:25.408863 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:25.408923269Z"}
{"log":"F1201 14:05:25.695942 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:25.696067618Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:27.077966213Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:27.078022482Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:27.078029092Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:27.078038092Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:27.194117685Z"}
{"log":"I1201 14:05:27.194194 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:27.194310312Z"}
{"log":"I1201 14:05:27.194499 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:27.194593138Z"}
{"log":"F1201 14:05:27.606857 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:27.606981554Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:29.803633527Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:29.803673237Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:29.804307627Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:29.804386996Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:29.923479162Z"}
{"log":"I1201 14:05:29.923561 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:29.923667439Z"}
{"log":"I1201 14:05:29.923800 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:29.923883066Z"}
{"log":"F1201 14:05:30.348802 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:30.348940893Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:34.13849665Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:34.13854593Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:34.14468506Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:34.1447281Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:34.260159295Z"}
{"log":"I1201 14:05:34.260182 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:34.260255424Z"}
{"log":"I1201 14:05:34.260399 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:34.260466931Z"}
{"log":"F1201 14:05:34.643276 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:34.643402072Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:41.621059506Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:41.621120995Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:41.621127145Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:41.621132545Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:41.73700667Z"}
{"log":"I1201 14:05:41.737032 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:41.737111259Z"}
{"log":"I1201 14:05:41.737267 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:41.737365526Z"}
{"log":"F1201 14:05:42.271027 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:42.271177757Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:05:55.650614658Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:55.650642689Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:05:55.651616943Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:05:55.651633654Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:05:55.761218137Z"}
{"log":"I1201 14:05:55.761296 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:05:55.761453947Z"}
{"log":"I1201 14:05:55.761571 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:05:55.761630506Z"}
{"log":"F1201 14:05:55.983059 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:05:55.983191221Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:06:22.16870089Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:06:22.16874369Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:06:22.170176555Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:06:22.170352096Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:06:22.289656312Z"}
{"log":"I1201 14:06:22.289743 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:06:22.289840022Z"}
{"log":"I1201 14:06:22.290025 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:06:22.290091984Z"}
{"log":"F1201 14:06:22.879402 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:06:22.879537123Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:07:14.692668289Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:07:14.6927042Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:07:14.69530455Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:07:14.695327371Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:07:14.811375324Z"}
{"log":"I1201 14:07:14.811419 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:07:14.811574488Z"}
{"log":"I1201 14:07:14.811710 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:07:14.811802991Z"}
{"log":"F1201 14:07:15.404681 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:07:15.404803718Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:08:15.979001952Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:08:15.980614602Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:08:15.981654187Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:08:15.981916394Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:08:16.108199436Z"}
{"log":"I1201 14:08:16.108309 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:08:16.108419382Z"}
{"log":"I1201 14:08:16.108590 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:08:16.108676847Z"}
{"log":"F1201 14:08:17.055754 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:08:17.055880168Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:09:17.740051449Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:09:17.74009217Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:09:17.740791592Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:09:17.740808362Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:09:17.867068361Z"}
{"log":"I1201 14:09:17.867115 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:09:17.867240727Z"}
{"log":"I1201 14:09:17.867420 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:09:17.867482165Z"}
{"log":"F1201 14:09:18.563615 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:09:18.563754898Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:19.312700556Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:19.312747468Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:19.320597473Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:19.320636515Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:19.500901791Z"}
{"log":"I1201 14:10:19.501155 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:19.501234562Z"}
{"log":"I1201 14:10:19.501470 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:19.501522662Z"}
{"log":"Error: failed to create listener: failed to listen on 0.0.0.0:6443: listen tcp 0.0.0.0:6443: bind: address already in use\n","stream":"stderr","time":"2019-12-01T14:10:19.501888544Z"}
{"log":"Usage:\n","stream":"stderr","time":"2019-12-01T14:10:19.503400546Z"}
{"log":" kube-apiserver [flags]\n","stream":"stderr","time":"2019-12-01T14:10:19.503420176Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.503425506Z"}
{"log":"Generic flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.503430046Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.503434666Z"}
{"log":" --advertise-address ip The IP address on which to advertise the apiserver to members of the cluster. This address must be reachable by the rest of the cluster. If blank, the --bind-address will be used. If --bind-address is unspecified, the host's default interface will be used.\n","stream":"stderr","time":"2019-12-01T14:10:19.503439016Z"}
{"log":" --cors-allowed-origins strings List of allowed origins for CORS, comma separated. An allowed origin can be a regular expression to support subdomain matching. If this list is empty CORS will not be enabled.\n","stream":"stderr","time":"2019-12-01T14:10:19.503444167Z"}
{"log":" --default-not-ready-toleration-seconds int Indicates the tolerationSeconds of the toleration for notReady:NoExecute that is added by default to every pod that does not already have such a toleration. (default 300)\n","stream":"stderr","time":"2019-12-01T14:10:19.503449097Z"}
{"log":" --default-unreachable-toleration-seconds int Indicates the tolerationSeconds of the toleration for unreachable:NoExecute that is added by default to every pod that does not already have such a toleration. (default 300)\n","stream":"stderr","time":"2019-12-01T14:10:19.503453887Z"}
{"log":" --enable-inflight-quota-handler If true, replace the max-in-flight handler with an enhanced one that queues and dispatches with priority and fairness\n","stream":"stderr","time":"2019-12-01T14:10:19.503469247Z"}
{"log":" --external-hostname string The hostname to use when generating externalized URLs for this master (e.g. Swagger API Docs).\n","stream":"stderr","time":"2019-12-01T14:10:19.503474167Z"}
{"log":" --feature-gates mapStringBool A set of key=value pairs that describe feature gates for alpha/experimental features. Options are:\n","stream":"stderr","time":"2019-12-01T14:10:19.503478777Z"}
{"log":" APIListChunking=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503483188Z"}
{"log":" APIResponseCompression=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503487549Z"}
{"log":" AllAlpha=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503491929Z"}
{"log":" AppArmor=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503496309Z"}
{"log":" AttachVolumeLimit=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503500539Z"}
{"log":" BalanceAttachedNodeVolumes=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503506149Z"}
{"log":" BlockVolume=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503511289Z"}
{"log":" BoundServiceAccountTokenVolume=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503515439Z"}
{"log":" CPUManager=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503519629Z"}
{"log":" CRIContainerLogRotation=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503523849Z"}
{"log":" CSIBlockVolume=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503528069Z"}
{"log":" CSIDriverRegistry=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.50354025Z"}
{"log":" CSIInlineVolume=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.50354542Z"}
{"log":" CSIMigration=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.50354994Z"}
{"log":" CSIMigrationAWS=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.50355441Z"}
{"log":" CSIMigrationAzureDisk=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.50355871Z"}
{"log":" CSIMigrationAzureFile=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.50356278Z"}
{"log":" CSIMigrationGCE=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503567131Z"}
{"log":" CSIMigrationOpenStack=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503571921Z"}
{"log":" CSINodeInfo=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503580872Z"}
{"log":" CustomCPUCFSQuotaPeriod=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503585212Z"}
{"log":" CustomResourceDefaulting=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503589602Z"}
{"log":" DevicePlugins=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503593882Z"}
{"log":" DryRun=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503598232Z"}
{"log":" DynamicAuditing=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503602682Z"}
{"log":" DynamicKubeletConfig=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503607832Z"}
{"log":" EndpointSlice=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503612222Z"}
{"log":" EphemeralContainers=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503623523Z"}
{"log":" EvenPodsSpread=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503627603Z"}
{"log":" ExpandCSIVolumes=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503631993Z"}
{"log":" ExpandInUsePersistentVolumes=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503635993Z"}
{"log":" ExpandPersistentVolumes=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503640393Z"}
{"log":" ExperimentalHostUserNamespaceDefaulting=true|false (BETA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503644733Z"}
{"log":" HPAScaleToZero=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503649223Z"}
{"log":" HyperVContainer=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503653734Z"}
{"log":" IPv6DualStack=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503658524Z"}
{"log":" KubeletPodResources=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503662584Z"}
{"log":" LegacyNodeRoleBehavior=true|false (ALPHA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503667175Z"}
{"log":" LocalStorageCapacityIsolation=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503671285Z"}
{"log":" LocalStorageCapacityIsolationFSQuotaMonitoring=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503676005Z"}
{"log":" MountContainers=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503680715Z"}
{"log":" NodeDisruptionExclusion=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503685045Z"}
{"log":" NodeLease=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503693115Z"}
{"log":" NonPreemptingPriority=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503698715Z"}
{"log":" PodOverhead=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503702875Z"}
{"log":" PodShareProcessNamespace=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503707075Z"}
{"log":" ProcMountType=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503711766Z"}
{"log":" QOSReserved=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503716356Z"}
{"log":" RemainingItemCount=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503720406Z"}
{"log":" RemoveSelfLink=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503725536Z"}
{"log":" RequestManagement=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503730266Z"}
{"log":" ResourceLimitsPriorityFunction=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503734866Z"}
{"log":" ResourceQuotaScopeSelectors=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503739287Z"}
{"log":" RotateKubeletClientCertificate=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503743327Z"}
{"log":" RotateKubeletServerCertificate=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503755348Z"}
{"log":" RunAsGroup=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503759838Z"}
{"log":" RuntimeClass=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503763998Z"}
{"log":" SCTPSupport=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503768258Z"}
{"log":" ScheduleDaemonSetPods=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503772538Z"}
{"log":" ServerSideApply=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503776838Z"}
{"log":" ServiceLoadBalancerFinalizer=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503780938Z"}
{"log":" ServiceNodeExclusion=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503785188Z"}
{"log":" StartupProbe=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503789888Z"}
{"log":" StorageVersionHash=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503793988Z"}
{"log":" StreamingProxyRedirects=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503798108Z"}
{"log":" SupportNodePidsLimit=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503806789Z"}
{"log":" SupportPodPidsLimit=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503811189Z"}
{"log":" Sysctls=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503816149Z"}
{"log":" TTLAfterFinished=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503820149Z"}
{"log":" TaintBasedEvictions=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503824519Z"}
{"log":" TaintNodesByCondition=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.5038342Z"}
{"log":" TokenRequest=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.5038388Z"}
{"log":" TokenRequestProjection=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.50384333Z"}
{"log":" TopologyManager=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503848111Z"}
{"log":" ValidateProxyRedirects=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503853121Z"}
{"log":" VolumePVCDataSource=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503858041Z"}
{"log":" VolumeSnapshotDataSource=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503862871Z"}
{"log":" VolumeSubpathEnvExpansion=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503867371Z"}
{"log":" WatchBookmark=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503871371Z"}
{"log":" WinDSR=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503876201Z"}
{"log":" WinOverlay=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503880151Z"}
{"log":" WindowsGMSA=true|false (BETA - default=true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503885101Z"}
{"log":" WindowsRunAsUserName=true|false (ALPHA - default=false)\n","stream":"stderr","time":"2019-12-01T14:10:19.503889581Z"}
{"log":" --livez-grace-period duration This option represents the maximum amount of time it should take for apiserver to complete its startup sequence and become live. From apiserver's start time to when this amount of time has elapsed, /livez will assume that unfinished post-start hooks will complete successfully and therefore return true.\n","stream":"stderr","time":"2019-12-01T14:10:19.503894182Z"}
{"log":" --master-service-namespace string DEPRECATED: the namespace from which the kubernetes master services should be injected into pods. (default \"default\")\n","stream":"stderr","time":"2019-12-01T14:10:19.503899602Z"}
{"log":" --max-mutating-requests-inflight int The maximum number of mutating requests in flight at a given time. When the server exceeds this, it rejects requests. Zero for no limit. (default 200)\n","stream":"stderr","time":"2019-12-01T14:10:19.503904832Z"}
{"log":" --max-requests-inflight int The maximum number of non-mutating requests in flight at a given time. When the server exceeds this, it rejects requests. Zero for no limit. (default 400)\n","stream":"stderr","time":"2019-12-01T14:10:19.503914213Z"}
{"log":" --min-request-timeout int An optional field indicating the minimum number of seconds a handler must keep a request open before timing it out. Currently only honored by the watch request handler, which picks a randomized value above this number as the connection timeout, to spread out load. (default 1800)\n","stream":"stderr","time":"2019-12-01T14:10:19.503920993Z"}
{"log":" --request-timeout duration An optional field indicating the duration a handler must keep a request open before timing it out. This is the default request timeout for requests but may be overridden by flags such as --min-request-timeout for specific types of requests. (default 1m0s)\n","stream":"stderr","time":"2019-12-01T14:10:19.503926653Z"}
{"log":" --shutdown-delay-duration duration Time to delay the termination. During that time the server keeps serving requests normally and /healthz returns success, but /readzy immediately returns failure. Graceful termination starts after this delay has elapsed. This can be used to allow load balancer to stop sending traffic to this server.\n","stream":"stderr","time":"2019-12-01T14:10:19.503932083Z"}
{"log":" --target-ram-mb int Memory limit for apiserver in MB (used to configure sizes of caches, etc.)\n","stream":"stderr","time":"2019-12-01T14:10:19.503937504Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.503942504Z"}
{"log":"Etcd flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.503946664Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.503950754Z"}
{"log":" --default-watch-cache-size int Default watch cache size. If zero, watch cache will be disabled for resources that do not have a default watch size set. (default 100)\n","stream":"stderr","time":"2019-12-01T14:10:19.503954394Z"}
{"log":" --delete-collection-workers int Number of workers spawned for DeleteCollection call. These are used to speed up namespace cleanup. (default 1)\n","stream":"stderr","time":"2019-12-01T14:10:19.503958624Z"}
{"log":" --enable-garbage-collector Enables the generic garbage collector. MUST be synced with the corresponding flag of the kube-controller-manager. (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.503962904Z"}
{"log":" --encryption-provider-config string The file containing configuration for encryption providers to be used for storing secrets in etcd\n","stream":"stderr","time":"2019-12-01T14:10:19.503967584Z"}
{"log":" --etcd-cafile string SSL Certificate Authority file used to secure etcd communication.\n","stream":"stderr","time":"2019-12-01T14:10:19.503972144Z"}
{"log":" --etcd-certfile string SSL certification file used to secure etcd communication.\n","stream":"stderr","time":"2019-12-01T14:10:19.503976164Z"}
{"log":" --etcd-compaction-interval duration The interval of compaction requests. If 0, the compaction request from apiserver is disabled. (default 5m0s)\n","stream":"stderr","time":"2019-12-01T14:10:19.503980685Z"}
{"log":" --etcd-count-metric-poll-period duration Frequency of polling etcd for number of resources per type. 0 disables the metric collection. (default 1m0s)\n","stream":"stderr","time":"2019-12-01T14:10:19.503985225Z"}
{"log":" --etcd-keyfile string SSL key file used to secure etcd communication.\n","stream":"stderr","time":"2019-12-01T14:10:19.503989775Z"}
{"log":" --etcd-prefix string The prefix to prepend to all resource paths in etcd. (default \"/registry\")\n","stream":"stderr","time":"2019-12-01T14:10:19.503993735Z"}
{"log":" --etcd-servers strings List of etcd servers to connect with (scheme://ip:port), comma separated.\n","stream":"stderr","time":"2019-12-01T14:10:19.504002316Z"}
{"log":" --etcd-servers-overrides strings Per-resource etcd servers overrides, comma separated. The individual override format: group/resource#servers, where servers are URLs, semicolon separated.\n","stream":"stderr","time":"2019-12-01T14:10:19.504006676Z"}
{"log":" --storage-backend string The storage backend for persistence. Options: 'etcd3' (default).\n","stream":"stderr","time":"2019-12-01T14:10:19.504012076Z"}
{"log":" --storage-media-type string The media type to use to store objects in storage. Some resources or storage backends may only support a specific media type and will ignore this setting. (default \"application/vnd.kubernetes.protobuf\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504017766Z"}
{"log":" --watch-cache Enable watch caching in the apiserver (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.504030017Z"}
{"log":" --watch-cache-sizes strings Watch cache size settings for some resources (pods, nodes, etc.), comma separated. The individual setting format: resource[.group]#size, where resource is lowercase plural (no version), group is omitted for resources of apiVersion v1 (the legacy core API) and included for others, and size is a number. It takes effect when watch-cache is enabled. Some resources (replicationcontrollers, endpoints, nodes, pods, services, apiservices.apiregistration.k8s.io) have system defaults set by heuristics, others default to default-watch-cache-size\n","stream":"stderr","time":"2019-12-01T14:10:19.504034257Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504040497Z"}
{"log":"Secure serving flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504044557Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504048687Z"}
{"log":" --bind-address ip The IP address on which to listen for the --secure-port port. The associated interface(s) must be reachable by the rest of the cluster, and by CLI/web clients. If blank, all interfaces will be used (0.0.0.0 for all IPv4 interfaces and :: for all IPv6 interfaces). (default 0.0.0.0)\n","stream":"stderr","time":"2019-12-01T14:10:19.504052727Z"}
{"log":" --cert-dir string The directory where the TLS certs are located. If --tls-cert-file and --tls-private-key-file are provided, this flag will be ignored. (default \"/var/run/kubernetes\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504057887Z"}
{"log":" --http2-max-streams-per-connection int The limit that the server gives to clients for the maximum number of streams in an HTTP/2 connection. Zero means to use golang's default.\n","stream":"stderr","time":"2019-12-01T14:10:19.504062517Z"}
{"log":" --secure-port int The port on which to serve HTTPS with authentication and authorization.It cannot be switched off with 0. (default 6443)\n","stream":"stderr","time":"2019-12-01T14:10:19.504066867Z"}
{"log":" --tls-cert-file string File containing the default x509 Certificate for HTTPS. (CA cert, if any, concatenated after server cert). If HTTPS serving is enabled, and --tls-cert-file and --tls-private-key-file are not provided, a self-signed certificate and key are generated for the public address and saved to the directory specified by --cert-dir.\n","stream":"stderr","time":"2019-12-01T14:10:19.504072738Z"}
{"log":" --tls-cipher-suites strings Comma-separated list of cipher suites for the server. If omitted, the default Go cipher suites will be use. Possible values: TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_ECDSA_WITH_RC4_128_SHA,TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_RC4_128_SHA,TLS_RSA_WITH_3DES_EDE_CBC_SHA,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_128_CBC_SHA256,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_RC4_128_SHA\n","stream":"stderr","time":"2019-12-01T14:10:19.504077868Z"}
{"log":" --tls-min-version string Minimum TLS version supported. Possible values: VersionTLS10, VersionTLS11, VersionTLS12, VersionTLS13\n","stream":"stderr","time":"2019-12-01T14:10:19.504098279Z"}
{"log":" --tls-private-key-file string File containing the default x509 private key matching --tls-cert-file.\n","stream":"stderr","time":"2019-12-01T14:10:19.504103219Z"}
{"log":" --tls-sni-cert-key namedCertKey A pair of x509 certificate and private key file paths, optionally suffixed with a list of domain patterns which are fully qualified domain names, possibly with prefixed wildcard segments. If no domain patterns are provided, the names of the certificate are extracted. Non-wildcard matches trump over wildcard matches, explicit domain patterns trump over extracted names. For multiple key/certificate pairs, use the --tls-sni-cert-key multiple times. Examples: \"example.crt,example.key\" or \"foo.crt,foo.key:*.foo.com,foo.com\". (default [])\n","stream":"stderr","time":"2019-12-01T14:10:19.504108469Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.50411481Z"}
{"log":"Insecure serving flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.50411876Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.50412254Z"}
{"log":" --address ip The IP address on which to serve the insecure --port (set to 0.0.0.0 for all IPv4 interfaces and :: for all IPv6 interfaces). (default 127.0.0.1) (DEPRECATED: see --bind-address instead.)\n","stream":"stderr","time":"2019-12-01T14:10:19.50412695Z"}
{"log":" --insecure-bind-address ip The IP address on which to serve the --insecure-port (set to 0.0.0.0 for all IPv4 interfaces and :: for all IPv6 interfaces). (default 127.0.0.1) (DEPRECATED: This flag will be removed in a future version.)\n","stream":"stderr","time":"2019-12-01T14:10:19.50413173Z"}
{"log":" --insecure-port int The port on which to serve unsecured, unauthenticated access. (default 8080) (DEPRECATED: This flag will be removed in a future version.)\n","stream":"stderr","time":"2019-12-01T14:10:19.50413674Z"}
{"log":" --port int The port on which to serve unsecured, unauthenticated access. Set to 0 to disable. (default 8080) (DEPRECATED: see --secure-port instead.)\n","stream":"stderr","time":"2019-12-01T14:10:19.50414103Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.50414581Z"}
{"log":"Auditing flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.50414941Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.50415391Z"}
{"log":" --audit-dynamic-configuration Enables dynamic audit configuration. This feature also requires the DynamicAuditing feature flag\n","stream":"stderr","time":"2019-12-01T14:10:19.504160041Z"}
{"log":" --audit-log-batch-buffer-size int The size of the buffer to store events before batching and writing. Only used in batch mode. (default 10000)\n","stream":"stderr","time":"2019-12-01T14:10:19.504165671Z"}
{"log":" --audit-log-batch-max-size int The maximum size of a batch. Only used in batch mode. (default 1)\n","stream":"stderr","time":"2019-12-01T14:10:19.504170231Z"}
{"log":" --audit-log-batch-max-wait duration The amount of time to wait before force writing the batch that hadn't reached the max size. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:10:19.504174242Z"}
{"log":" --audit-log-batch-throttle-burst int Maximum number of requests sent at the same moment if ThrottleQPS was not utilized before. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:10:19.504179222Z"}
{"log":" --audit-log-batch-throttle-enable Whether batching throttling is enabled. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:10:19.504187912Z"}
{"log":" --audit-log-batch-throttle-qps float32 Maximum average number of batches per second. Only used in batch mode.\n","stream":"stderr","time":"2019-12-01T14:10:19.504192172Z"}
{"log":" --audit-log-format string Format of saved audits. \"legacy\" indicates 1-line text format for each event. \"json\" indicates structured json format. Known formats are legacy,json. (default \"json\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504196292Z"}
{"log":" --audit-log-maxage int The maximum number of days to retain old audit log files based on the timestamp encoded in their filename.\n","stream":"stderr","time":"2019-12-01T14:10:19.504201762Z"}
{"log":" --audit-log-maxbackup int The maximum number of old audit log files to retain.\n","stream":"stderr","time":"2019-12-01T14:10:19.504206793Z"}
{"log":" --audit-log-maxsize int The maximum size in megabytes of the audit log file before it gets rotated.\n","stream":"stderr","time":"2019-12-01T14:10:19.504211073Z"}
{"log":" --audit-log-mode string Strategy for sending audit events. Blocking indicates sending events should block server responses. Batch causes the backend to buffer and write events asynchronously. Known modes are batch,blocking,blocking-strict. (default \"blocking\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504215843Z"}
{"log":" --audit-log-path string If set, all requests coming to the apiserver will be logged to this file. '-' means standard out.\n","stream":"stderr","time":"2019-12-01T14:10:19.504221053Z"}
{"log":" --audit-log-truncate-enabled Whether event and batch truncating is enabled.\n","stream":"stderr","time":"2019-12-01T14:10:19.504225173Z"}
{"log":" --audit-log-truncate-max-batch-size int Maximum size of the batch sent to the underlying backend. Actual serialized size can be several hundreds of bytes greater. If a batch exceeds this limit, it is split into several batches of smaller size. (default 10485760)\n","stream":"stderr","time":"2019-12-01T14:10:19.504229293Z"}
{"log":" --audit-log-truncate-max-event-size int Maximum size of the audit event sent to the underlying backend. If the size of an event is greater than this number, first request and response are removed, and if this doesn't reduce the size enough, event is discarded. (default 102400)\n","stream":"stderr","time":"2019-12-01T14:10:19.504234063Z"}
{"log":" --audit-log-version string API group and version used for serializing audit events written to log. (default \"audit.k8s.io/v1\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504239053Z"}
{"log":" --audit-policy-file string Path to the file that defines the audit policy configuration.\n","stream":"stderr","time":"2019-12-01T14:10:19.504243593Z"}
{"log":" --audit-webhook-batch-buffer-size int The size of the buffer to store events before batching and writing. Only used in batch mode. (default 10000)\n","stream":"stderr","time":"2019-12-01T14:10:19.504247673Z"}
{"log":" --audit-webhook-batch-max-size int The maximum size of a batch. Only used in batch mode. (default 400)\n","stream":"stderr","time":"2019-12-01T14:10:19.504252574Z"}
{"log":" --audit-webhook-batch-max-wait duration The amount of time to wait before force writing the batch that hadn't reached the max size. Only used in batch mode. (default 30s)\n","stream":"stderr","time":"2019-12-01T14:10:19.504257664Z"}
{"log":" --audit-webhook-batch-throttle-burst int Maximum number of requests sent at the same moment if ThrottleQPS was not utilized before. Only used in batch mode. (default 15)\n","stream":"stderr","time":"2019-12-01T14:10:19.504262725Z"}
{"log":" --audit-webhook-batch-throttle-enable Whether batching throttling is enabled. Only used in batch mode. (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.504269975Z"}
{"log":" --audit-webhook-batch-throttle-qps float32 Maximum average number of batches per second. Only used in batch mode. (default 10)\n","stream":"stderr","time":"2019-12-01T14:10:19.504274855Z"}
{"log":" --audit-webhook-config-file string Path to a kubeconfig formatted file that defines the audit webhook configuration.\n","stream":"stderr","time":"2019-12-01T14:10:19.504294296Z"}
{"log":" --audit-webhook-initial-backoff duration The amount of time to wait before retrying the first failed request. (default 10s)\n","stream":"stderr","time":"2019-12-01T14:10:19.504298736Z"}
{"log":" --audit-webhook-mode string Strategy for sending audit events. Blocking indicates sending events should block server responses. Batch causes the backend to buffer and write events asynchronously. Known modes are batch,blocking,blocking-strict. (default \"batch\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504304166Z"}
{"log":" --audit-webhook-truncate-enabled Whether event and batch truncating is enabled.\n","stream":"stderr","time":"2019-12-01T14:10:19.504309206Z"}
{"log":" --audit-webhook-truncate-max-batch-size int Maximum size of the batch sent to the underlying backend. Actual serialized size can be several hundreds of bytes greater. If a batch exceeds this limit, it is split into several batches of smaller size. (default 10485760)\n","stream":"stderr","time":"2019-12-01T14:10:19.504314726Z"}
{"log":" --audit-webhook-truncate-max-event-size int Maximum size of the audit event sent to the underlying backend. If the size of an event is greater than this number, first request and response are removed, and if this doesn't reduce the size enough, event is discarded. (default 102400)\n","stream":"stderr","time":"2019-12-01T14:10:19.504320286Z"}
{"log":" --audit-webhook-version string API group and version used for serializing audit events written to webhook. (default \"audit.k8s.io/v1\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504325976Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504330406Z"}
{"log":"Features flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504334136Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504338556Z"}
{"log":" --contention-profiling Enable lock contention profiling, if profiling is enabled\n","stream":"stderr","time":"2019-12-01T14:10:19.504342277Z"}
{"log":" --profiling Enable profiling via web interface host:port/debug/pprof/ (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.504347468Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504351938Z"}
{"log":"Authentication flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504355598Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504359698Z"}
{"log":" --anonymous-auth Enables anonymous requests to the secure port of the API server. Requests that are not rejected by another authentication method are treated as anonymous requests. Anonymous requests have a username of system:anonymous, and a group name of system:unauthenticated. (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.504363688Z"}
{"log":" --api-audiences strings Identifiers of the API. The service account token authenticator will validate that tokens used against the API are bound to at least one of these audiences. If the --service-account-issuer flag is configured and this flag is not, this field defaults to a single element list containing the issuer URL .\n","stream":"stderr","time":"2019-12-01T14:10:19.504368708Z"}
{"log":" --authentication-token-webhook-cache-ttl duration The duration to cache responses from the webhook token authenticator. (default 2m0s)\n","stream":"stderr","time":"2019-12-01T14:10:19.504375508Z"}
{"log":" --authentication-token-webhook-config-file string File with webhook configuration for token authentication in kubeconfig format. The API server will query the remote service to determine authentication for bearer tokens.\n","stream":"stderr","time":"2019-12-01T14:10:19.504383108Z"}
{"log":" --client-ca-file string If set, any request presenting a client certificate signed by one of the authorities in the client-ca-file is authenticated with an identity corresponding to the CommonName of the client certificate.\n","stream":"stderr","time":"2019-12-01T14:10:19.504388499Z"}
{"log":" --enable-bootstrap-token-auth Enable to allow secrets of type 'bootstrap.kubernetes.io/token' in the 'kube-system' namespace to be used for TLS bootstrapping authentication.\n","stream":"stderr","time":"2019-12-01T14:10:19.504394179Z"}
{"log":" --oidc-ca-file string If set, the OpenID server's certificate will be verified by one of the authorities in the oidc-ca-file, otherwise the host's root CA set will be used.\n","stream":"stderr","time":"2019-12-01T14:10:19.504399189Z"}
{"log":" --oidc-client-id string The client ID for the OpenID Connect client, must be set if oidc-issuer-url is set.\n","stream":"stderr","time":"2019-12-01T14:10:19.504404169Z"}
{"log":" --oidc-groups-claim string If provided, the name of a custom OpenID Connect claim for specifying user groups. The claim value is expected to be a string or array of strings. This flag is experimental, please see the authentication documentation for further details.\n","stream":"stderr","time":"2019-12-01T14:10:19.504410539Z"}
{"log":" --oidc-groups-prefix string If provided, all groups will be prefixed with this value to prevent conflicts with other authentication strategies.\n","stream":"stderr","time":"2019-12-01T14:10:19.504415379Z"}
{"log":" --oidc-issuer-url string The URL of the OpenID issuer, only HTTPS scheme will be accepted. If set, it will be used to verify the OIDC JSON Web Token (JWT).\n","stream":"stderr","time":"2019-12-01T14:10:19.504420569Z"}
{"log":" --oidc-required-claim mapStringString A key=value pair that describes a required claim in the ID Token. If set, the claim is verified to be present in the ID Token with a matching value. Repeat this flag to specify multiple claims.\n","stream":"stderr","time":"2019-12-01T14:10:19.504426009Z"}
{"log":" --oidc-signing-algs strings Comma-separated list of allowed JOSE asymmetric signing algorithms. JWTs with a 'alg' header value not in this list will be rejected. Values are defined by RFC 7518 https://tools.ietf.org/html/rfc7518#section-3.1. (default [RS256])\n","stream":"stderr","time":"2019-12-01T14:10:19.504431891Z"}
{"log":" --oidc-username-claim string The OpenID claim to use as the user name. Note that claims other than the default ('sub') is not guaranteed to be unique and immutable. This flag is experimental, please see the authentication documentation for further details. (default \"sub\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504436931Z"}
{"log":" --oidc-username-prefix string If provided, all usernames will be prefixed with this value. If not provided, username claims other than 'email' are prefixed by the issuer URL to avoid clashes. To skip any prefixing, provide the value '-'.\n","stream":"stderr","time":"2019-12-01T14:10:19.504441801Z"}
{"log":" --requestheader-allowed-names strings List of client certificate common names to allow to provide usernames in headers specified by --requestheader-username-headers. If empty, any client certificate validated by the authorities in --requestheader-client-ca-file is allowed.\n","stream":"stderr","time":"2019-12-01T14:10:19.504446961Z"}
{"log":" --requestheader-client-ca-file string Root certificate bundle to use to verify client certificates on incoming requests before trusting usernames in headers specified by --requestheader-username-headers. WARNING: generally do not depend on authorization being already done for incoming requests.\n","stream":"stderr","time":"2019-12-01T14:10:19.504455751Z"}
{"log":" --requestheader-extra-headers-prefix strings List of request header prefixes to inspect. X-Remote-Extra- is suggested.\n","stream":"stderr","time":"2019-12-01T14:10:19.504461721Z"}
{"log":" --requestheader-group-headers strings List of request headers to inspect for groups. X-Remote-Group is suggested.\n","stream":"stderr","time":"2019-12-01T14:10:19.504466371Z"}
{"log":" --requestheader-username-headers strings List of request headers to inspect for usernames. X-Remote-User is common.\n","stream":"stderr","time":"2019-12-01T14:10:19.504471781Z"}
{"log":" --service-account-issuer string Identifier of the service account token issuer. The issuer will assert this identifier in \"iss\" claim of issued tokens. This value is a string or URI.\n","stream":"stderr","time":"2019-12-01T14:10:19.504476082Z"}
{"log":" --service-account-key-file stringArray File containing PEM-encoded x509 RSA or ECDSA private or public keys, used to verify ServiceAccount tokens. The specified file can contain multiple keys, and the flag can be specified multiple times with different files. If unspecified, --tls-private-key-file is used. Must be specified when --service-account-signing-key is provided\n","stream":"stderr","time":"2019-12-01T14:10:19.504481452Z"}
{"log":" --service-account-lookup If true, validate ServiceAccount tokens exist in etcd as part of authentication. (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.504486852Z"}
{"log":" --service-account-max-token-expiration duration The maximum validity duration of a token created by the service account token issuer. If an otherwise valid TokenRequest with a validity duration larger than this value is requested, a token will be issued with a validity duration of this value.\n","stream":"stderr","time":"2019-12-01T14:10:19.504491152Z"}
{"log":" --token-auth-file string If set, the file that will be used to secure the secure port of the API server via token authentication.\n","stream":"stderr","time":"2019-12-01T14:10:19.504497082Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504501362Z"}
{"log":"Authorization flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504506292Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504547914Z"}
{"log":" --authorization-mode strings Ordered list of plug-ins to do authorization on secure port. Comma-delimited list of: AlwaysAllow,AlwaysDeny,ABAC,Webhook,RBAC,Node. (default [AlwaysAllow])\n","stream":"stderr","time":"2019-12-01T14:10:19.504559284Z"}
{"log":" --authorization-policy-file string File with authorization policy in json line by line format, used with --authorization-mode=ABAC, on the secure port.\n","stream":"stderr","time":"2019-12-01T14:10:19.504570435Z"}
{"log":" --authorization-webhook-cache-authorized-ttl duration The duration to cache 'authorized' responses from the webhook authorizer. (default 5m0s)\n","stream":"stderr","time":"2019-12-01T14:10:19.504575895Z"}
{"log":" --authorization-webhook-cache-unauthorized-ttl duration The duration to cache 'unauthorized' responses from the webhook authorizer. (default 30s)\n","stream":"stderr","time":"2019-12-01T14:10:19.504580085Z"}
{"log":" --authorization-webhook-config-file string File with webhook configuration in kubeconfig format, used with --authorization-mode=Webhook. The API server will query the remote service to determine access on the API server's secure port.\n","stream":"stderr","time":"2019-12-01T14:10:19.504584295Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504594125Z"}
{"log":"Cloud provider flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504599305Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504607986Z"}
{"log":" --cloud-config string The path to the cloud provider configuration file. Empty string for no configuration file.\n","stream":"stderr","time":"2019-12-01T14:10:19.504611727Z"}
{"log":" --cloud-provider string The provider for cloud services. Empty string for no provider.\n","stream":"stderr","time":"2019-12-01T14:10:19.504617177Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504621157Z"}
{"log":"Api enablement flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504626417Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504630487Z"}
{"log":" --runtime-config mapStringString A set of key=value pairs that describe runtime configuration that may be passed to apiserver. \u003cgroup\u003e/\u003cversion\u003e (or \u003cversion\u003e for the core group) key can be used to turn on/off specific api versions. api/all is special key to control all api versions, be careful setting it false, unless you know what you do. api/legacy is deprecated, we will remove it in the future, so stop using it. (default )\n","stream":"stderr","time":"2019-12-01T14:10:19.504634217Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504641357Z"}
{"log":"Egress selector flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504646037Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504649787Z"}
{"log":" --egress-selector-config-file string File with apiserver egress selector configuration.\n","stream":"stderr","time":"2019-12-01T14:10:19.504653688Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504658528Z"}
{"log":"Admission flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504662088Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504666108Z"}
{"log":" --admission-control strings Admission is divided into two phases. In the first phase, only mutating admission plugins run. In the second phase, only validating admission plugins run. The names in the below list may represent a validating plugin, a mutating plugin, or both. The order of plugins in which they are passed to this flag does not matter. Comma-delimited list of: AlwaysAdmit, AlwaysDeny, AlwaysPullImages, DefaultStorageClass, DefaultTolerationSeconds, DenyEscalatingExec, DenyExecOnPrivileged, EventRateLimit, ExtendedResourceToleration, ImagePolicyWebhook, LimitPodHardAntiAffinityTopology, LimitRanger, MutatingAdmissionWebhook, NamespaceAutoProvision, NamespaceExists, NamespaceLifecycle, NodeRestriction, OwnerReferencesPermissionEnforcement, PersistentVolumeClaimResize, PersistentVolumeLabel, PodNodeSelector, PodPreset, PodSecurityPolicy, PodTolerationRestriction, Priority, ResourceQuota, RuntimeClass, SecurityContextDeny, ServiceAccount, StorageObjectInUseProtection, TaintNodesByCondition, ValidatingAdmissionWebhook. (DEPRECATED: Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version.)\n","stream":"stderr","time":"2019-12-01T14:10:19.504755381Z"}
{"log":" --admission-control-config-file string File with admission control configuration.\n","stream":"stderr","time":"2019-12-01T14:10:19.504784372Z"}
{"log":" --disable-admission-plugins strings admission plugins that should be disabled although they are in the default enabled plugins list (NamespaceLifecycle, LimitRanger, ServiceAccount, TaintNodesByCondition, Priority, DefaultTolerationSeconds, DefaultStorageClass, StorageObjectInUseProtection, PersistentVolumeClaimResize, MutatingAdmissionWebhook, ValidatingAdmissionWebhook, RuntimeClass, ResourceQuota). Comma-delimited list of admission plugins: AlwaysAdmit, AlwaysDeny, AlwaysPullImages, DefaultStorageClass, DefaultTolerationSeconds, DenyEscalatingExec, DenyExecOnPrivileged, EventRateLimit, ExtendedResourceToleration, ImagePolicyWebhook, LimitPodHardAntiAffinityTopology, LimitRanger, MutatingAdmissionWebhook, NamespaceAutoProvision, NamespaceExists, NamespaceLifecycle, NodeRestriction, OwnerReferencesPermissionEnforcement, PersistentVolumeClaimResize, PersistentVolumeLabel, PodNodeSelector, PodPreset, PodSecurityPolicy, PodTolerationRestriction, Priority, ResourceQuota, RuntimeClass, SecurityContextDeny, ServiceAccount, StorageObjectInUseProtection, TaintNodesByCondition, ValidatingAdmissionWebhook. The order of plugins in this flag does not matter.\n","stream":"stderr","time":"2019-12-01T14:10:19.504789153Z"}
{"log":" --enable-admission-plugins strings admission plugins that should be enabled in addition to default enabled ones (NamespaceLifecycle, LimitRanger, ServiceAccount, TaintNodesByCondition, Priority, DefaultTolerationSeconds, DefaultStorageClass, StorageObjectInUseProtection, PersistentVolumeClaimResize, MutatingAdmissionWebhook, ValidatingAdmissionWebhook, RuntimeClass, ResourceQuota). Comma-delimited list of admission plugins: AlwaysAdmit, AlwaysDeny, AlwaysPullImages, DefaultStorageClass, DefaultTolerationSeconds, DenyEscalatingExec, DenyExecOnPrivileged, EventRateLimit, ExtendedResourceToleration, ImagePolicyWebhook, LimitPodHardAntiAffinityTopology, LimitRanger, MutatingAdmissionWebhook, NamespaceAutoProvision, NamespaceExists, NamespaceLifecycle, NodeRestriction, OwnerReferencesPermissionEnforcement, PersistentVolumeClaimResize, PersistentVolumeLabel, PodNodeSelector, PodPreset, PodSecurityPolicy, PodTolerationRestriction, Priority, ResourceQuota, RuntimeClass, SecurityContextDeny, ServiceAccount, StorageObjectInUseProtection, TaintNodesByCondition, ValidatingAdmissionWebhook. The order of plugins in this flag does not matter.\n","stream":"stderr","time":"2019-12-01T14:10:19.504809023Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504817613Z"}
{"log":"Misc flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504821313Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504825733Z"}
{"log":" --allow-privileged If true, allow privileged containers. [default=false]\n","stream":"stderr","time":"2019-12-01T14:10:19.504829513Z"}
{"log":" --apiserver-count int The number of apiservers running in the cluster, must be a positive number. (In use when --endpoint-reconciler-type=master-count is enabled.) (default 1)\n","stream":"stderr","time":"2019-12-01T14:10:19.504833644Z"}
{"log":" --enable-aggregator-routing Turns on aggregator routing requests to endpoints IP rather than cluster IP.\n","stream":"stderr","time":"2019-12-01T14:10:19.504838464Z"}
{"log":" --endpoint-reconciler-type string Use an endpoint reconciler (master-count, lease, none) (default \"lease\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504842934Z"}
{"log":" --event-ttl duration Amount of time to retain events. (default 1h0m0s)\n","stream":"stderr","time":"2019-12-01T14:10:19.504847504Z"}
{"log":" --kubelet-certificate-authority string Path to a cert file for the certificate authority.\n","stream":"stderr","time":"2019-12-01T14:10:19.504851864Z"}
{"log":" --kubelet-client-certificate string Path to a client cert file for TLS.\n","stream":"stderr","time":"2019-12-01T14:10:19.504856284Z"}
{"log":" --kubelet-client-key string Path to a client key file for TLS.\n","stream":"stderr","time":"2019-12-01T14:10:19.504861234Z"}
{"log":" --kubelet-https Use https for kubelet connections. (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.504866084Z"}
{"log":" --kubelet-preferred-address-types strings List of the preferred NodeAddressTypes to use for kubelet connections. (default [Hostname,InternalDNS,InternalIP,ExternalDNS,ExternalIP])\n","stream":"stderr","time":"2019-12-01T14:10:19.504870405Z"}
{"log":" --kubelet-timeout duration Timeout for kubelet operations. (default 5s)\n","stream":"stderr","time":"2019-12-01T14:10:19.504875075Z"}
{"log":" --kubernetes-service-node-port int If non-zero, the Kubernetes master service (which apiserver creates/maintains) will be of type NodePort, using this as the value of the port. If zero, the Kubernetes master service will be of type ClusterIP.\n","stream":"stderr","time":"2019-12-01T14:10:19.504883066Z"}
{"log":" --max-connection-bytes-per-sec int If non-zero, throttle each user connection to this number of bytes/sec. Currently only applies to long-running requests.\n","stream":"stderr","time":"2019-12-01T14:10:19.504888576Z"}
{"log":" --proxy-client-cert-file string Client certificate used to prove the identity of the aggregator or kube-apiserver when it must call out during a request. This includes proxying requests to a user api-server and calling out to webhook admission plugins. It is expected that this cert includes a signature from the CA in the --requestheader-client-ca-file flag. That CA is published in the 'extension-apiserver-authentication' configmap in the kube-system namespace. Components receiving calls from kube-aggregator should use that CA to perform their half of the mutual TLS verification.\n","stream":"stderr","time":"2019-12-01T14:10:19.504893826Z"}
{"log":" --proxy-client-key-file string Private key for the client certificate used to prove the identity of the aggregator or kube-apiserver when it must call out during a request. This includes proxying requests to a user api-server and calling out to webhook admission plugins.\n","stream":"stderr","time":"2019-12-01T14:10:19.504900126Z"}
{"log":" --service-account-signing-key-file string Path to the file that contains the current private key of the service account token issuer. The issuer will sign issued ID tokens with this private key. (Requires the 'TokenRequest' feature gate.)\n","stream":"stderr","time":"2019-12-01T14:10:19.504905176Z"}
{"log":" --service-cluster-ip-range string A CIDR notation IP range from which to assign service cluster IPs. This must not overlap with any IP ranges assigned to nodes for pods. (default \"10.0.0.0/24\")\n","stream":"stderr","time":"2019-12-01T14:10:19.504910706Z"}
{"log":" --service-node-port-range portRange A port range to reserve for services with NodePort visibility. Example: '30000-32767'. Inclusive at both ends of the range. (default 30000-32767)\n","stream":"stderr","time":"2019-12-01T14:10:19.504915636Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504920886Z"}
{"log":"Global flags:\n","stream":"stderr","time":"2019-12-01T14:10:19.504924797Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.504928837Z"}
{"log":" --add-dir-header If true, adds the file directory to the header\n","stream":"stderr","time":"2019-12-01T14:10:19.504932737Z"}
{"log":" --alsologtostderr log to standard error as well as files\n","stream":"stderr","time":"2019-12-01T14:10:19.504937117Z"}
{"log":" -h, --help help for kube-apiserver\n","stream":"stderr","time":"2019-12-01T14:10:19.504941477Z"}
{"log":" --log-backtrace-at traceLocation when logging hits line file:N, emit a stack trace (default :0)\n","stream":"stderr","time":"2019-12-01T14:10:19.504946607Z"}
{"log":" --log-dir string If non-empty, write log files in this directory\n","stream":"stderr","time":"2019-12-01T14:10:19.50502573Z"}
{"log":" --log-file string If non-empty, use this log file\n","stream":"stderr","time":"2019-12-01T14:10:19.505362311Z"}
{"log":" --log-file-max-size uint Defines the maximum size a log file can grow to. Unit is megabytes. If the value is 0, the maximum file size is unlimited. (default 1800)\n","stream":"stderr","time":"2019-12-01T14:10:19.505367341Z"}
{"log":" --log-flush-frequency duration Maximum number of seconds between log flushes (default 5s)\n","stream":"stderr","time":"2019-12-01T14:10:19.505372632Z"}
{"log":" --logtostderr log to standard error instead of files (default true)\n","stream":"stderr","time":"2019-12-01T14:10:19.505383462Z"}
{"log":" --skip-headers If true, avoid header prefixes in the log messages\n","stream":"stderr","time":"2019-12-01T14:10:19.505389172Z"}
{"log":" --skip-log-headers If true, avoid headers when opening log files\n","stream":"stderr","time":"2019-12-01T14:10:19.505393553Z"}
{"log":" --stderrthreshold severity logs at or above this threshold go to stderr (default 2)\n","stream":"stderr","time":"2019-12-01T14:10:19.505398983Z"}
{"log":" -v, --v Level number for the log level verbosity\n","stream":"stderr","time":"2019-12-01T14:10:19.505403313Z"}
{"log":" --version version[=true] Print version information and quit\n","stream":"stderr","time":"2019-12-01T14:10:19.505408713Z"}
{"log":" --vmodule moduleSpec comma-separated list of pattern=N settings for file-filtered logging\n","stream":"stderr","time":"2019-12-01T14:10:19.505414173Z"}
{"log":"\n","stream":"stderr","time":"2019-12-01T14:10:19.505419214Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:35.822258029Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:35.82228772Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:35.822910402Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:35.822978405Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:35.944119944Z"}
{"log":"I1201 14:10:35.944171 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:35.944310111Z"}
{"log":"I1201 14:10:35.944537 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:35.94459492Z"}
{"log":"F1201 14:10:36.366975 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:36.36712649Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:37.064698711Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:37.064727312Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:37.065349564Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:37.065365484Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:37.182813106Z"}
{"log":"I1201 14:10:37.182903 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:37.183015483Z"}
{"log":"I1201 14:10:37.183223 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:37.183320183Z"}
{"log":"F1201 14:10:37.643904 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:37.644076839Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:38.439700885Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:38.439745236Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:38.439833249Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:38.440029106Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:38.560450755Z"}
{"log":"I1201 14:10:38.560533 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:38.560657873Z"}
{"log":"I1201 14:10:38.560904 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:38.560969813Z"}
{"log":"F1201 14:10:39.472425 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:39.472585887Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:40.459731174Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:40.459769655Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:40.460361655Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:40.460419478Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:40.580224835Z"}
{"log":"I1201 14:10:40.580277 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:40.580408511Z"}
{"log":"I1201 14:10:40.580579 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:40.580640029Z"}
{"log":"F1201 14:10:41.026041 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:41.026187062Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:42.419710133Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:42.419758325Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:42.419823676Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:42.420167169Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:42.541774667Z"}
{"log":"I1201 14:10:42.541831 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:42.541980974Z"}
{"log":"I1201 14:10:42.542092 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:42.542184731Z"}
{"log":"F1201 14:10:42.902703 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:42.902824751Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:45.103325927Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:45.103364948Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:45.105420029Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:45.10544212Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:45.22411557Z"}
{"log":"I1201 14:10:45.224165 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:45.224302536Z"}
{"log":"I1201 14:10:45.224493 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:45.224580225Z"}
{"log":"F1201 14:10:45.570497 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:45.570630537Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:49.357172955Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:49.357224677Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:49.358065226Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:49.358079027Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:49.473256611Z"}
{"log":"I1201 14:10:49.473302 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:49.473407326Z"}
{"log":"I1201 14:10:49.473587 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:49.473653245Z"}
{"log":"F1201 14:10:50.227733 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:50.227868112Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:57.216304658Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:10:57.216357519Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:10:57.217875273Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:10:57.218045439Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:10:57.341311508Z"}
{"log":"I1201 14:10:57.341371 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:10:57.341498915Z"}
{"log":"I1201 14:10:57.341668 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:10:57.341729073Z"}
{"log":"F1201 14:10:58.109757 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:10:58.10989159Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:11:11.497339522Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:11:11.497379414Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:11:11.497912493Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:11:11.497999216Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:11:11.614685385Z"}
{"log":"I1201 14:11:11.614719 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:11:11.61480006Z"}
{"log":"I1201 14:11:11.614979 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:11:11.615052598Z"}
{"log":"F1201 14:11:12.104508 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:11:12.104632969Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:11:38.272490558Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:11:38.272574161Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:11:38.276650029Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:11:38.276680911Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:11:38.383926678Z"}
{"log":"I1201 14:11:38.383982 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:11:38.384141886Z"}
{"log":"I1201 14:11:38.384240 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:11:38.384325823Z"}
{"log":"F1201 14:11:39.133992 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:11:39.134143312Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:12:30.910381883Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:12:30.910419285Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:12:30.911784925Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:12:30.912018815Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:12:31.030946447Z"}
{"log":"I1201 14:12:31.030996 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:12:31.031126144Z"}
{"log":"I1201 14:12:31.031218 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:12:31.03127737Z"}
{"log":"F1201 14:12:31.342910 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:12:31.343040742Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:13:31.962667621Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:13:31.962702191Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:13:31.962708302Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:13:31.962715262Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:13:32.076789218Z"}
{"log":"I1201 14:13:32.076838 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:13:32.076960394Z"}
{"log":"I1201 14:13:32.077063 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:13:32.077153791Z"}
{"log":"F1201 14:13:32.971314 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:13:32.971433488Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:14:33.553923873Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:14:33.553966373Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:14:33.559978674Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:14:33.560064034Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:14:33.672610554Z"}
{"log":"I1201 14:14:33.672666 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:14:33.672792973Z"}
{"log":"I1201 14:14:33.672890 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:14:33.672979951Z"}
{"log":"F1201 14:14:34.053082 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:14:34.053231212Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:15:34.6229281Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:15:34.622989111Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:15:34.625495405Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:15:34.625526346Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:15:34.74234199Z"}
{"log":"I1201 14:15:34.742391 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:15:34.74251225Z"}
{"log":"I1201 14:15:34.742622 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:15:34.74268186Z"}
{"log":"F1201 14:15:35.489461 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:15:35.489600592Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:16:36.093084901Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:16:36.093125241Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:16:36.093145991Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:16:36.093438534Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:16:36.213945884Z"}
{"log":"I1201 14:16:36.213994 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:16:36.214125116Z"}
{"log":"I1201 14:16:36.214240 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:16:36.214358548Z"}
{"log":"F1201 14:16:36.668621 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:16:36.668756871Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:17:37.263701808Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:17:37.263745389Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:17:37.265149718Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:17:37.26531334Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:17:37.379168525Z"}
{"log":"I1201 14:17:37.379219 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:17:37.379347607Z"}
{"log":"I1201 14:17:37.379476 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:17:37.3795679Z"}
{"log":"F1201 14:17:37.886381 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:17:37.886501339Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:18:38.496213855Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:18:38.496247136Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:18:38.496336218Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:18:38.496347648Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:18:38.616864798Z"}
{"log":"I1201 14:18:38.616976 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:18:38.617082811Z"}
{"log":"I1201 14:18:38.617207 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:18:38.617279665Z"}
{"log":"F1201 14:18:39.061553 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:18:39.06171148Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:19:39.645933622Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:39.645979373Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:19:39.647186098Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:39.648329712Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:19:39.764009228Z"}
{"log":"I1201 14:19:39.764132 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:19:39.764228842Z"}
{"log":"I1201 14:19:39.764357 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:19:39.764416716Z"}
{"log":"F1201 14:19:40.196071 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:19:40.196243193Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:50.51178883Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:19:50.511823831Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:19:50.513342634Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:50.513536328Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:19:50.628615829Z"}
{"log":"I1201 14:19:50.628676 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:19:50.628798263Z"}
{"log":"I1201 14:19:50.628913 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:19:50.628975497Z"}
{"log":"F1201 14:19:51.082113 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:19:51.08227316Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:19:51.774558084Z"}
{"log":".0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:51.776585138Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:19:51.777736663Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:51.777754353Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:19:51.901707352Z"}
{"log":"I1201 14:19:51.901850 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:19:51.901965997Z"}
{"log":"I1201 14:19:51.902077 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:19:51.902158051Z"}
{"log":"F1201 14:19:52.682373 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:19:52.682521675Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:53.477491731Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:19:53.477547932Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:19:53.479033465Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:53.479128127Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:19:53.59774181Z"}
{"log":"I1201 14:19:53.597804 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:19:53.597947305Z"}
{"log":"I1201 14:19:53.598119 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:19:53.598212199Z"}
{"log":"F1201 14:19:54.053650 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:19:54.053778273Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:19:55.031120819Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:55.03116256Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:19:55.031848784Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:55.031881135Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:19:55.147244717Z"}
{"log":"I1201 14:19:55.147325 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:19:55.147443852Z"}
{"log":"I1201 14:19:55.147593 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:19:55.147672447Z"}
{"log":"F1201 14:19:55.541459 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:19:55.54159585Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:19:56.908709156Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:56.908749296Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:19:56.911307673Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:56.911349084Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:19:57.026277584Z"}
{"log":"I1201 14:19:57.026329 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:19:57.026473539Z"}
{"log":"I1201 14:19:57.026617 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:19:57.026709054Z"}
{"log":"F1201 14:19:57.474320 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:19:57.474468803Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:19:59.663447814Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:59.663486834Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:19:59.664092238Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:19:59.66416493Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:19:59.78125776Z"}
{"log":"I1201 14:19:59.781283 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:19:59.781356662Z"}
{"log":"I1201 14:19:59.781514 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:19:59.781645918Z"}
{"log":"F1201 14:20:00.371323 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:20:00.371463159Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:20:04.21144917Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:04.211539482Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:20:04.214779104Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:04.214805935Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:20:04.332176696Z"}
{"log":"I1201 14:20:04.332262 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:20:04.332388321Z"}
{"log":"I1201 14:20:04.332609 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:20:04.332686437Z"}
{"log":"F1201 14:20:04.824808 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:20:04.824947441Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:11.823914145Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:20:11.823950756Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:20:11.823964396Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:11.823971086Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:20:11.94389357Z"}
{"log":"I1201 14:20:11.943956 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:20:11.944096085Z"}
{"log":"I1201 14:20:11.944241 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:20:11.94433689Z"}
{"log":"F1201 14:20:12.578609 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:20:12.578735176Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:20:25.974908944Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:25.974951145Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:20:25.981800754Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:25.981830824Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:20:26.096033573Z"}
{"log":"I1201 14:20:26.096100 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:20:26.096236957Z"}
{"log":"I1201 14:20:26.096371 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:20:26.096453443Z"}
{"log":"F1201 14:20:26.649182 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:20:26.649328108Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:20:52.844901957Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:52.844962458Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:20:52.847641953Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:20:52.847671804Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:20:52.966268533Z"}
{"log":"I1201 14:20:52.966316 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:20:52.966427847Z"}
{"log":"I1201 14:20:52.966571 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:20:52.966671673Z"}
{"log":"F1201 14:20:53.629783 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:20:53.629923963Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:21:45.441588816Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:21:45.441645297Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:21:45.443069344Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:21:45.443232598Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:21:45.568419057Z"}
{"log":"I1201 14:21:45.568506 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:21:45.568652783Z"}
{"log":"I1201 14:21:45.568832 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:21:45.568900739Z"}
{"log":"F1201 14:21:46.004055 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:21:46.004189815Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:22:46.656733336Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:22:46.656790337Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:22:46.658842423Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:22:46.658875474Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:22:46.792656161Z"}
{"log":"I1201 14:22:46.792687 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:22:46.792810936Z"}
{"log":"I1201 14:22:46.792946 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:22:46.793024711Z"}
{"log":"F1201 14:22:47.231142 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:22:47.231319969Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:23:47.810617851Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:23:47.810678383Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:23:47.812608598Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:23:47.812622838Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:23:47.922933599Z"}
{"log":"I1201 14:23:47.922971 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:23:47.923061543Z"}
{"log":"I1201 14:23:47.923186 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:23:47.923278449Z"}
{"log":"F1201 14:23:48.315812 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:23:48.315951588Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:24:48.920144404Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:24:48.920200705Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:24:48.921391791Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:24:48.921549195Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:24:49.039900599Z"}
{"log":"I1201 14:24:49.039934 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:24:49.040060234Z"}
{"log":"I1201 14:24:49.040197 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:24:49.040287771Z"}
{"log":"F1201 14:24:49.439237 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:24:49.439390988Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:25:50.040668729Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:25:50.043873456Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:25:50.043911027Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:25:50.043918417Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:25:50.17705776Z"}
{"log":"I1201 14:25:50.177152 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:25:50.177254406Z"}
{"log":"I1201 14:25:50.177434 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:25:50.177511224Z"}
{"log":"F1201 14:25:50.790145 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:25:50.790283524Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:26:51.430895777Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:26:51.431086383Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:26:51.434697204Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:26:51.434727315Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:26:51.575151542Z"}
{"log":"I1201 14:26:51.575375 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:26:51.575486822Z"}
{"log":"I1201 14:26:51.577923 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:26:51.578070262Z"}
{"log":"F1201 14:26:51.833261 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:26:51.833400588Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:27:52.450027164Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:27:52.450106136Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:27:52.451566552Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:27:52.451641244Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:27:52.575233179Z"}
{"log":"I1201 14:27:52.575371 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:27:52.575491757Z"}
{"log":"I1201 14:27:52.575588 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:27:52.575682953Z"}
{"log":"F1201 14:27:52.872397 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:27:52.872512239Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:28:53.477021988Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:28:53.477101659Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:28:53.479071182Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:28:53.479098323Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:28:53.595447153Z"}
{"log":"I1201 14:28:53.595543 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:28:53.59567926Z"}
{"log":"I1201 14:28:53.595823 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:28:53.595890617Z"}
{"log":"F1201 14:28:54.018243 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:28:54.018376379Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:29:54.61844092Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:29:54.618485041Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:29:54.621313552Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:29:54.621340343Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:29:54.736989965Z"}
{"log":"I1201 14:29:54.736990 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:29:54.73712815Z"}
{"log":"I1201 14:29:54.737261 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:29:54.737388848Z"}
{"log":"F1201 14:29:55.106144 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:29:55.106305427Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:30:55.858765015Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:30:55.858805125Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:30:55.858810595Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:30:55.858816115Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:30:56.01510836Z"}
{"log":"I1201 14:30:56.015118 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:30:56.0152279Z"}
{"log":"I1201 14:30:56.015328 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:30:56.015418548Z"}
{"log":"F1201 14:30:56.670379 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:30:56.670530587Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:05.260431921Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:05.260473941Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:05.260494821Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:05.260500091Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:05.395177928Z"}
{"log":"I1201 14:31:05.395239 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:05.395374857Z"}
{"log":"I1201 14:31:05.395544 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:05.395624744Z"}
{"log":"F1201 14:31:05.732947 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:05.733115211Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:06.439692096Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:06.439722866Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:06.44175524Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:06.44177965Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:06.560590361Z"}
{"log":"I1201 14:31:06.560671 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:06.560811499Z"}
{"log":"I1201 14:31:06.561046 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:06.561170286Z"}
{"log":"F1201 14:31:07.051712 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:07.051874572Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:07.862100803Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:07.862150382Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:07.863315973Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:07.863332853Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:07.987143983Z"}
{"log":"I1201 14:31:07.987186 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:07.987319102Z"}
{"log":"I1201 14:31:07.987468 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:07.98754093Z"}
{"log":"F1201 14:31:08.672675 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:08.672800266Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:09.669979094Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:09.670029833Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:09.670649259Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:09.670665078Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:09.790391288Z"}
{"log":"I1201 14:31:09.790459 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:09.790590806Z"}
{"log":"I1201 14:31:09.790761 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:09.790848844Z"}
{"log":"F1201 14:31:10.182694 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:10.182847263Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:11.603358185Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:11.603396275Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:11.60407147Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:11.60409893Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:11.722116979Z"}
{"log":"I1201 14:31:11.722210 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:11.722312397Z"}
{"log":"I1201 14:31:11.722446 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:11.722526186Z"}
{"log":"F1201 14:31:12.481029 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:12.481152103Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:14.652828141Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:14.65287676Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:14.654101931Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:14.65426166Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:14.778568298Z"}
{"log":"I1201 14:31:14.778638 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:14.778774866Z"}
{"log":"I1201 14:31:14.778985 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:14.779070334Z"}
{"log":"F1201 14:31:15.278992 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:15.279173132Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:19.07743342Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:19.077502429Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:19.078644851Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:19.07871135Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:19.201336093Z"}
{"log":"I1201 14:31:19.201386 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:19.201505602Z"}
{"log":"I1201 14:31:19.201684 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:19.20175793Z"}
{"log":"F1201 14:31:20.384858 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:20.385001585Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:27.471284866Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:27.471329716Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:27.472867796Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:27.472958105Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:27.596196261Z"}
{"log":"I1201 14:31:27.596227 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:27.59633521Z"}
{"log":"I1201 14:31:27.596568 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:27.596654628Z"}
{"log":"F1201 14:31:28.096658 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:28.096774939Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:31:41.485193657Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:41.485242577Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:31:41.488502188Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:31:41.488568748Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:31:41.610179957Z"}
{"log":"I1201 14:31:41.610274 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:31:41.610380076Z"}
{"log":"I1201 14:31:41.610547 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:31:41.610621085Z"}
{"log":"F1201 14:31:41.994933 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:31:41.995086386Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:32:08.186251504Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:32:08.186293004Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:32:08.189272643Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:32:08.189298643Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:32:08.305848492Z"}
{"log":"I1201 14:32:08.305907 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:32:08.306050511Z"}
{"log":"I1201 14:32:08.306188 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:32:08.306271021Z"}
{"log":"F1201 14:32:08.671056 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:32:08.671204501Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:33:00.506088684Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:33:00.506128494Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:33:00.506749924Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:33:00.506765334Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:33:00.621624664Z"}
{"log":"I1201 14:33:00.621802 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:33:00.621915814Z"}
{"log":"I1201 14:33:00.622058 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:33:00.622144754Z"}
{"log":"F1201 14:33:01.007148 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:33:01.00729016Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:34:01.576543255Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:34:01.582911862Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:34:01.582960652Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:34:01.582969892Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:34:01.709592647Z"}
{"log":"I1201 14:34:01.709639 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:34:01.709749517Z"}
{"log":"I1201 14:34:01.709988 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:34:01.710058668Z"}
{"log":"F1201 14:34:02.042594 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:34:02.04272019Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:35:02.651106803Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:35:02.651175274Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:35:02.653815329Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:35:02.653845508Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:35:02.788850315Z"}
{"log":"I1201 14:35:02.788926 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:35:02.789051846Z"}
{"log":"I1201 14:35:02.789254 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:35:02.789337318Z"}
{"log":"F1201 14:35:03.457599 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:35:03.457725913Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:36:04.067783236Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:36:04.067817077Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:36:04.072633365Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:36:04.072673246Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:36:04.18265869Z"}
{"log":"I1201 14:36:04.182696 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:36:04.18277837Z"}
{"log":"I1201 14:36:04.184787 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:36:04.184892108Z"}
{"log":"F1201 14:36:04.699817 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:36:04.699953994Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:37:05.291018825Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:37:05.291098436Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:37:05.293263858Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:37:05.293304318Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:37:05.410620718Z"}
{"log":"I1201 14:37:05.410680 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:37:05.410840141Z"}
{"log":"I1201 14:37:05.411078 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:37:05.411161884Z"}
{"log":"F1201 14:37:05.969326 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:37:05.969461498Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:38:06.577377285Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:38:06.577448915Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:38:06.578042703Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:38:06.578109524Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:38:06.69303591Z"}
{"log":"I1201 14:38:06.693081 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:38:06.693162312Z"}
{"log":"I1201 14:38:06.693315 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:38:06.693375804Z"}
{"log":"F1201 14:38:07.246994 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:38:07.247114972Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:39:07.840510498Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:39:07.84064458Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:39:07.842808641Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:39:07.842851272Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:39:07.964292115Z"}
{"log":"I1201 14:39:07.964338 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:39:07.964490898Z"}
{"log":"I1201 14:39:07.964660 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:39:07.964742142Z"}
{"log":"F1201 14:39:08.609373 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:39:08.609532861Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:40:09.209150932Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:40:09.209180913Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:40:09.209877974Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:40:09.209910504Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:40:09.331078929Z"}
{"log":"I1201 14:40:09.331135 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:40:09.331294823Z"}
{"log":"I1201 14:40:09.331435 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:40:09.331521637Z"}
{"log":"F1201 14:40:09.884167 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:40:09.884330273Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:41:10.487720255Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:41:10.487760084Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:41:10.487786985Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:41:10.488955135Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:41:10.61179038Z"}
{"log":"I1201 14:41:10.611859 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:41:10.612005834Z"}
{"log":"I1201 14:41:10.612189 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:41:10.612265517Z"}
{"log":"F1201 14:41:11.707628 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:41:11.707770065Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:12.422885109Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:12.42293314Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:12.424342297Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:12.424503599Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:12.534489791Z"}
{"log":"I1201 14:42:12.534503 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:12.534587333Z"}
{"log":"I1201 14:42:12.534709 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:12.534813227Z"}
{"log":"F1201 14:42:13.065812 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:13.065972041Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:19.870360097Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:19.870387557Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:19.870453148Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:19.870510329Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:19.989057666Z"}
{"log":"I1201 14:42:19.989098 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:19.989243449Z"}
{"log":"I1201 14:42:19.989413 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:19.989489693Z"}
{"log":"F1201 14:42:20.277373 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:20.277519238Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:20.973579214Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:20.973621114Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:20.974618254Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:20.97496034Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:21.125625908Z"}
{"log":"I1201 14:42:21.125646 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:21.12571789Z"}
{"log":"I1201 14:42:21.125960 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:21.126048376Z"}
{"log":"F1201 14:42:21.586228 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:21.586384089Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:22.376506639Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:22.376603541Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:22.377687602Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:22.377701022Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:22.4906827Z"}
{"log":"I1201 14:42:22.490734 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:22.490880665Z"}
{"log":"I1201 14:42:22.491022 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:22.491077228Z"}
{"log":"F1201 14:42:23.383073 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:23.383185527Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:24.383166418Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:24.38324526Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:24.384761587Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:24.384839359Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:24.500969621Z"}
{"log":"I1201 14:42:24.500981 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:24.501074573Z"}
{"log":"I1201 14:42:24.501227 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:24.501303807Z"}
{"log":"F1201 14:42:25.232056 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:25.232192581Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:26.614046072Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:26.614074003Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:26.614658674Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:26.614720205Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:26.730561265Z"}
{"log":"I1201 14:42:26.730581 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:26.730683528Z"}
{"log":"I1201 14:42:26.730806 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:26.730921442Z"}
{"log":"F1201 14:42:27.512861 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:27.512978738Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:29.722095383Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:29.722148724Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:29.72354392Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:29.723626651Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:29.84003622Z"}
{"log":"I1201 14:42:29.840095 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:29.840250173Z"}
{"log":"I1201 14:42:29.840382 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:29.840456607Z"}
{"log":"F1201 14:42:30.333516 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:30.333651374Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:34.121760064Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:34.121810175Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:34.12264323Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:34.122656891Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:34.235674206Z"}
{"log":"I1201 14:42:34.235796 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:34.23590527Z"}
{"log":"I1201 14:42:34.236095 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:34.236181255Z"}
{"log":"F1201 14:42:34.967756 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:34.967917737Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:41.966335722Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:41.966378633Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:41.967898622Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:41.967912392Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:42.085376807Z"}
{"log":"I1201 14:42:42.085433 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:42.08557363Z"}
{"log":"I1201 14:42:42.085816 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:42.085872217Z"}
{"log":"F1201 14:42:42.569109 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:42.569232977Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:56.022977124Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:42:56.023023165Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:42:56.028558652Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:42:56.028589813Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:42:56.145022938Z"}
{"log":"I1201 14:42:56.145138 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:42:56.145246042Z"}
{"log":"I1201 14:42:56.145353 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:42:56.145448025Z"}
{"log":"F1201 14:42:56.696367 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:42:56.696553954Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:43:22.913849801Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:43:22.913904672Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:43:22.920227087Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:43:22.920293598Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:43:23.034333009Z"}
{"log":"I1201 14:43:23.034411 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:43:23.034528733Z"}
{"log":"I1201 14:43:23.034717 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:43:23.034801578Z"}
{"log":"F1201 14:43:23.441828 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:43:23.44197096Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:44:15.25309043Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:44:15.253134371Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:44:15.253151032Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:44:15.253157622Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:44:15.375014559Z"}
{"log":"I1201 14:44:15.375101 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:44:15.375217654Z"}
{"log":"I1201 14:44:15.375456 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:44:15.37553685Z"}
{"log":"F1201 14:44:16.116304 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:44:16.116448656Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:45:16.722964848Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:45:16.722994018Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:45:16.72355924Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:45:16.723636231Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:45:16.837354299Z"}
{"log":"I1201 14:45:16.837382 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:45:16.837457352Z"}
{"log":"I1201 14:45:16.837607 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:45:16.837691187Z"}
{"log":"F1201 14:45:17.784484 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:45:17.784647272Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:46:18.375185696Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:46:18.375227607Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:46:18.377909335Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:46:18.377940486Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:46:18.496027241Z"}
{"log":"I1201 14:46:18.496054 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:46:18.496143364Z"}
{"log":"I1201 14:46:18.496281 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:46:18.496365559Z"}
{"log":"F1201 14:46:19.018490 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:46:19.018641566Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:47:19.584336488Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:47:19.584375629Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:47:19.584955822Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:47:19.585015823Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:47:19.696697571Z"}
{"log":"I1201 14:47:19.696742 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:47:19.696855685Z"}
{"log":"I1201 14:47:19.696974 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:47:19.69702693Z"}
{"log":"F1201 14:47:20.483905 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:47:20.484037693Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:48:21.072320717Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:48:21.072375298Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:48:21.072382029Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:48:21.072389729Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:48:21.182371145Z"}
{"log":"I1201 14:48:21.182410 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:48:21.182482208Z"}
{"log":"I1201 14:48:21.182645 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:48:21.182734394Z"}
{"log":"F1201 14:48:21.765167 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:48:21.765289468Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:49:22.339970216Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:49:22.340011657Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:49:22.341008652Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:49:22.341036642Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:49:22.456247894Z"}
{"log":"I1201 14:49:22.456294 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:49:22.456426578Z"}
{"log":"I1201 14:49:22.456509 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:49:22.456630823Z"}
{"log":"F1201 14:49:23.324176 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:49:23.324337374Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:50:23.920212207Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:50:23.920251698Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:50:23.922172086Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:50:23.922187676Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:50:24.037524897Z"}
{"log":"I1201 14:50:24.037574 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:50:24.037717681Z"}
{"log":"I1201 14:50:24.037933 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:50:24.038004219Z"}
{"log":"F1201 14:50:24.570818 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:50:24.570937169Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:51:25.148138133Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:51:25.148185334Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:51:25.149915468Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:51:25.156138252Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:51:25.274841316Z"}
{"log":"I1201 14:51:25.274890 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:51:25.274969949Z"}
{"log":"I1201 14:51:25.275124 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:51:25.275193885Z"}
{"log":"F1201 14:51:25.776300 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:51:25.776448329Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:52:26.371490093Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:52:26.371531484Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:52:26.372250612Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:52:26.372265672Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:52:26.493610367Z"}
{"log":"I1201 14:52:26.493655 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:52:26.493794812Z"}
{"log":"I1201 14:52:26.493935 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:52:26.494012578Z"}
{"log":"F1201 14:52:26.881691 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:52:26.881848476Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:27.592349933Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:27.592394374Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:27.592402804Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:27.592409664Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:27.707202781Z"}
{"log":"I1201 14:53:27.707319 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:27.707439617Z"}
{"log":"I1201 14:53:27.707615 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:27.707695954Z"}
{"log":"F1201 14:53:28.288434 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:28.288604409Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:35.028089665Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:35.028132036Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:35.029575373Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:35.029658475Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:35.145006441Z"}
{"log":"I1201 14:53:35.145071 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:35.145213087Z"}
{"log":"I1201 14:53:35.145354 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:35.145403871Z"}
{"log":"F1201 14:53:35.627770 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:35.627919549Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:36.310366798Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:36.310411399Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:36.317117082Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:36.317146363Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:36.428036385Z"}
{"log":"I1201 14:53:36.428151 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:36.428246271Z"}
{"log":"I1201 14:53:36.428369 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:36.428427095Z"}
{"log":"F1201 14:53:36.770975 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:36.771111228Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:37.563844599Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:37.563899891Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:37.563907461Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:37.563914401Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:37.667414004Z"}
{"log":"I1201 14:53:37.667426 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:37.667506336Z"}
{"log":"I1201 14:53:37.667613 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:37.66768683Z"}
{"log":"F1201 14:53:38.208637 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:38.208780151Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:39.205118038Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:39.205183329Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:39.206532033Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:39.206594605Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:39.322173Z"}
{"log":"I1201 14:53:39.322229 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:39.322372454Z"}
{"log":"I1201 14:53:39.322541 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:39.322623671Z"}
{"log":"F1201 14:53:39.732136 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:39.732275753Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:41.111736108Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:41.111781489Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:41.114357525Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:41.114374265Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:41.230167876Z"}
{"log":"I1201 14:53:41.230199 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:41.23027746Z"}
{"log":"I1201 14:53:41.230443 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:41.230534827Z"}
{"log":"F1201 14:53:41.698643 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:41.698788211Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:43.88980691Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:43.889850691Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:43.891082553Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:43.891260977Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:44.005979923Z"}
{"log":"I1201 14:53:44.006053 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:44.006180367Z"}
{"log":"I1201 14:53:44.006310 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:44.006380652Z"}
{"log":"F1201 14:53:44.785281 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:44.78543351Z"}
{"log":"+ echo kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:48.572718547Z"}
{"log":"+ grep -q cloud-provider=azure\n","stream":"stderr","time":"2019-12-01T14:53:48.57280599Z"}
{"log":"+ '[' kube-apiserver = kubelet ']'\n","stream":"stderr","time":"2019-12-01T14:53:48.57281387Z"}
{"log":"+ exec kube-apiserver --proxy-client-key-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client-key.pem --requestheader-client-ca-file=/etc/kubernetes/ssl/kube-apiserver-requestheader-ca.pem --tls-cert-file=/etc/kubernetes/ssl/kube-apiserver.pem --requestheader-username-headers=X-Remote-User --client-ca-file=/etc/kubernetes/ssl/kube-ca.pem --advertise-address=172.31.26.30 --kubelet-client-key=/etc/kubernetes/ssl/kube-apiserver-key.pem --authorization-mode=Node,RBAC --requestheader-allowed-names=kube-apiserver-proxy-client --requestheader-group-headers=X-Remote-Group --runtime-config=authorization.k8s.io/v1beta1=true --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --bind-address=0.0.0.0 --etcd-cafile=/etc/kubernetes/ssl/kube-ca.pem --tls-private-key-file=/etc/kubernetes/ssl/kube-apiserver-key.pem --secure-port=6443 --allow-privileged=true --storage-backend=etcd3 --etcd-certfile=/etc/kubernetes/ssl/kube-node.pem --etcd-keyfile=/etc/kubernetes/ssl/kube-node-key.pem --kubelet-client-certificate=/etc/kubernetes/ssl/kube-apiserver.pem --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,NodeRestriction,Priority,TaintNodesByCondition,PersistentVolumeClaimResize --cloud-provider=aws --anonymous-auth=false --service-account-lookup=true --profiling=false --etcd-prefix=/registry --etcd-servers=https://172.31.26.30:2379 --proxy-client-cert-file=/etc/kubernetes/ssl/kube-apiserver-proxy-client.pem --service-account-key-file=/etc/kubernetes/ssl/kube-service-account-token-key.pem --cloud-config=/etc/kubernetes/cloud-config --insecure-port=0\n","stream":"stderr","time":"2019-12-01T14:53:48.573431186Z"}
{"log":"Flag --insecure-port has been deprecated, This flag will be removed in a future version.\n","stream":"stderr","time":"2019-12-01T14:53:48.691261963Z"}
{"log":"I1201 14:53:48.691324 1 server.go:623] external host was not specified, using 172.31.26.30\n","stream":"stderr","time":"2019-12-01T14:53:48.691449668Z"}
{"log":"I1201 14:53:48.691596 1 server.go:149] Version: v1.16.3\n","stream":"stderr","time":"2019-12-01T14:53:48.691673783Z"}
{"log":"F1201 14:53:49.889607 1 config.go:56] Error reading from cloud configuration file /etc/kubernetes/cloud-config: \u0026os.PathError{Op:\"open\", Path:\"/etc/kubernetes/cloud-config\", Err:0x2}\n","stream":"stderr","time":"2019-12-01T14:53:49.889732603Z"}
This file has been truncated, but you can view the full file.
{"log":"2019/12/01 13:55:16 [INFO] Rancher version v2.3.3 is starting\n","stream":"stdout","time":"2019-12-01T13:55:16.259657428Z"}
{"log":"2019/12/01 13:55:16 [INFO] Rancher arguments {ACMEDomains:[] AddLocal:auto Embedded:false KubeConfig: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:false NoCACerts:false ListenConfig:\u003cnil\u003e AuditLogPath:/var/log/auditlog/rancher-api-audit.log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Features:}\n","stream":"stdout","time":"2019-12-01T13:55:16.259867505Z"}
{"log":"2019/12/01 13:55:16 [INFO] Listening on /tmp/log.sock\n","stream":"stdout","time":"2019-12-01T13:55:16.260026013Z"}
{"log":"2019/12/01 13:55:16 [INFO] Running etcd --data-dir=management-state/etcd\n","stream":"stdout","time":"2019-12-01T13:55:16.260621985Z"}
{"log":"2019-12-01 13:55:16.269846 W | pkg/flags: unrecognized environment variable ETCD_URL_arm64=https://github.com/etcd-io/etcd/releases/download/v3.3.14/etcd-v3.3.14-linux-arm64.tar.gz\n","stream":"stderr","time":"2019-12-01T13:55:16.270006165Z"}
{"log":"2019-12-01 13:55:16.269884 W | pkg/flags: unrecognized environment variable ETCD_URL_amd64=https://github.com/etcd-io/etcd/releases/download/v3.3.14/etcd-v3.3.14-linux-amd64.tar.gz\n","stream":"stderr","time":"2019-12-01T13:55:16.270028815Z"}
{"log":"2019-12-01 13:55:16.269890 W | pkg/flags: unrecognized environment variable ETCD_UNSUPPORTED_ARCH=amd64\n","stream":"stderr","time":"2019-12-01T13:55:16.270036074Z"}
{"log":"2019-12-01 13:55:16.269897 W | pkg/flags: unrecognized environment variable ETCD_URL=ETCD_URL_amd64\n","stream":"stderr","time":"2019-12-01T13:55:16.270041505Z"}
{"log":"2019-12-01 13:55:16.270065 I | etcdmain: etcd Version: 3.3.14\n","stream":"stderr","time":"2019-12-01T13:55:16.270140813Z"}
{"log":"2019-12-01 13:55:16.270084 I | etcdmain: Git SHA: 5cf5d88a1\n","stream":"stderr","time":"2019-12-01T13:55:16.270153113Z"}
{"log":"2019-12-01 13:55:16.270089 I | etcdmain: Go Version: go1.12.9\n","stream":"stderr","time":"2019-12-01T13:55:16.270158563Z"}
{"log":"2019-12-01 13:55:16.270095 I | etcdmain: Go OS/Arch: linux/amd64\n","stream":"stderr","time":"2019-12-01T13:55:16.270163573Z"}
{"log":"2019-12-01 13:55:16.270101 I | etcdmain: setting maximum number of CPUs to 2, total number of available CPUs is 2\n","stream":"stderr","time":"2019-12-01T13:55:16.270168242Z"}
{"log":"2019-12-01 13:55:16.270438 I | embed: listening for peers on http://localhost:2380\n","stream":"stderr","time":"2019-12-01T13:55:16.270514098Z"}
{"log":"2019-12-01 13:55:16.270614 I | embed: listening for client requests on localhost:2379\n","stream":"stderr","time":"2019-12-01T13:55:16.270696486Z"}
{"log":"2019-12-01 13:55:16.273446 I | etcdserver: name = default\n","stream":"stderr","time":"2019-12-01T13:55:16.27353597Z"}
{"log":"2019-12-01 13:55:16.273467 I | etcdserver: data dir = management-state/etcd\n","stream":"stderr","time":"2019-12-01T13:55:16.27354703Z"}
{"log":"2019-12-01 13:55:16.273472 I | etcdserver: member dir = management-state/etcd/member\n","stream":"stderr","time":"2019-12-01T13:55:16.27355165Z"}
{"log":"2019-12-01 13:55:16.273476 I | etcdserver: heartbeat = 100ms\n","stream":"stderr","time":"2019-12-01T13:55:16.273555699Z"}
{"log":"2019-12-01 13:55:16.273480 I | etcdserver: election = 1000ms\n","stream":"stderr","time":"2019-12-01T13:55:16.273559389Z"}
{"log":"2019-12-01 13:55:16.273484 I | etcdserver: snapshot count = 100000\n","stream":"stderr","time":"2019-12-01T13:55:16.27356364Z"}
{"log":"2019-12-01 13:55:16.273493 I | etcdserver: advertise client URLs = http://localhost:2379\n","stream":"stderr","time":"2019-12-01T13:55:16.273567159Z"}
{"log":"2019-12-01 13:55:16.273500 I | etcdserver: initial advertise peer URLs = http://localhost:2380\n","stream":"stderr","time":"2019-12-01T13:55:16.273584039Z"}
{"log":"2019-12-01 13:55:16.273509 I | etcdserver: initial cluster = default=http://localhost:2380\n","stream":"stderr","time":"2019-12-01T13:55:16.273653158Z"}
{"log":"2019-12-01 13:55:16.276881 I | etcdserver: starting member 8e9e05c52164694d in cluster cdf818194e3a8c32\n","stream":"stderr","time":"2019-12-01T13:55:16.276981375Z"}
{"log":"2019-12-01 13:55:16.276918 I | raft: 8e9e05c52164694d became follower at term 0\n","stream":"stderr","time":"2019-12-01T13:55:16.277001616Z"}
{"log":"2019-12-01 13:55:16.276929 I | raft: newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]\n","stream":"stderr","time":"2019-12-01T13:55:16.277007285Z"}
{"log":"2019-12-01 13:55:16.276938 I | raft: 8e9e05c52164694d became follower at term 1\n","stream":"stderr","time":"2019-12-01T13:55:16.277028375Z"}
{"log":"2019-12-01 13:55:16.281311 W | auth: simple token is not cryptographically signed\n","stream":"stderr","time":"2019-12-01T13:55:16.281385799Z"}
{"log":"2019-12-01 13:55:16.283556 I | etcdserver: starting server... [version: 3.3.14, cluster version: to_be_decided]\n","stream":"stderr","time":"2019-12-01T13:55:16.28364366Z"}
{"log":"2019-12-01 13:55:16.285578 I | etcdserver: 8e9e05c52164694d as single-node; fast-forwarding 9 ticks (election ticks 10)\n","stream":"stderr","time":"2019-12-01T13:55:16.285660414Z"}
{"log":"2019-12-01 13:55:16.286314 I | etcdserver/membership: added member 8e9e05c52164694d [http://localhost:2380] to cluster cdf818194e3a8c32\n","stream":"stderr","time":"2019-12-01T13:55:16.286394314Z"}
{"log":"2019-12-01 13:55:17.077233 I | raft: 8e9e05c52164694d is starting a new election at term 1\n","stream":"stderr","time":"2019-12-01T13:55:17.077388556Z"}
{"log":"2019-12-01 13:55:17.077275 I | raft: 8e9e05c52164694d became candidate at term 2\n","stream":"stderr","time":"2019-12-01T13:55:17.077434116Z"}
{"log":"2019-12-01 13:55:17.077291 I | raft: 8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2\n","stream":"stderr","time":"2019-12-01T13:55:17.077442186Z"}
{"log":"2019-12-01 13:55:17.077304 I | raft: 8e9e05c52164694d became leader at term 2\n","stream":"stderr","time":"2019-12-01T13:55:17.077447536Z"}
{"log":"2019-12-01 13:55:17.077312 I | raft: raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2\n","stream":"stderr","time":"2019-12-01T13:55:17.077452506Z"}
{"log":"2019-12-01 13:55:17.077627 I | etcdserver: setting up the initial cluster version to 3.3\n","stream":"stderr","time":"2019-12-01T13:55:17.077726223Z"}
{"log":"2019-12-01 13:55:17.078278 N | etcdserver/membership: set the initial cluster version to 3.3\n","stream":"stderr","time":"2019-12-01T13:55:17.078333628Z"}
{"log":"2019-12-01 13:55:17.078361 I | etcdserver: published {Name:default ClientURLs:[http://localhost:2379]} to cluster cdf818194e3a8c32\n","stream":"stderr","time":"2019-12-01T13:55:17.078497497Z"}
{"log":"2019-12-01 13:55:17.078406 I | etcdserver/api: enabled capabilities for version 3.3\n","stream":"stderr","time":"2019-12-01T13:55:17.078509317Z"}
{"log":"2019-12-01 13:55:17.078471 I | embed: ready to serve client requests\n","stream":"stderr","time":"2019-12-01T13:55:17.078562337Z"}
{"log":"2019-12-01 13:55:17.079271 N | embed: serving insecure client requests on 127.0.0.1:2379, this is strongly discouraged!\n","stream":"stderr","time":"2019-12-01T13:55:17.07932773Z"}
{"log":"2019/12/01 13:55:17 [INFO] Waiting for k3s to start\n","stream":"stdout","time":"2019-12-01T13:55:17.264325864Z"}
{"log":"time=\"2019-12-01T13:55:17Z\" level=info msg=\"Preparing data dir /var/lib/rancher/k3s/data/de37a675b342fcd56e57fd5707882786b0e0c840862d6ddc1e8f5c391fb424c9\"\n","stream":"stderr","time":"2019-12-01T13:55:17.265131887Z"}
{"log":"2019/12/01 13:55:18 [INFO] Waiting for k3s to start\n","stream":"stdout","time":"2019-12-01T13:55:18.264576585Z"}
{"log":"time=\"2019-12-01T13:55:18.720348975Z\" level=info msg=\"Starting k3s v0.8.0 (f867995f)\"\n","stream":"stderr","time":"2019-12-01T13:55:18.720510014Z"}
{"log":"time=\"2019-12-01T13:55:18.979553351Z\" level=info msg=\"Running kube-apiserver --advertise-port=6443 --allow-privileged=true --api-audiences=unknown --authorization-mode=Node,RBAC --basic-auth-file=/var/lib/rancher/k3s/server/cred/passwd --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --enable-admission-plugins=NodeRestriction --etcd-servers=http://localhost:2379 --insecure-port=0 --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=k3s --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-cluster-ip-range=10.43.0.0/16 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key\"\n","stream":"stderr","time":"2019-12-01T13:55:18.97975328Z"}
{"log":"2019/12/01 13:55:19 [INFO] Waiting for k3s to start\n","stream":"stdout","time":"2019-12-01T13:55:19.264714436Z"}
{"log":"E1201 13:55:19.765853 25 prometheus.go:138] failed to register depth metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.76598574Z"}
{"log":"E1201 13:55:19.766266 25 prometheus.go:150] failed to register adds metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.76633094Z"}
{"log":"E1201 13:55:19.766341 25 prometheus.go:162] failed to register latency metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.76641463Z"}
{"log":"E1201 13:55:19.766444 25 prometheus.go:174] failed to register work_duration metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.766510281Z"}
{"log":"E1201 13:55:19.766499 25 prometheus.go:189] failed to register unfinished_work_seconds metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.766592931Z"}
{"log":"E1201 13:55:19.766542 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.76660369Z"}
{"log":"W1201 13:55:19.923972 25 genericapiserver.go:315] Skipping API batch/v2alpha1 because it has no resources.\n","stream":"stderr","time":"2019-12-01T13:55:19.924103852Z"}
{"log":"W1201 13:55:19.931573 25 genericapiserver.go:315] Skipping API node.k8s.io/v1alpha1 because it has no resources.\n","stream":"stderr","time":"2019-12-01T13:55:19.931702493Z"}
{"log":"E1201 13:55:19.951473 25 prometheus.go:138] failed to register depth metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.951618474Z"}
{"log":"E1201 13:55:19.951537 25 prometheus.go:150] failed to register adds metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.951644815Z"}
{"log":"E1201 13:55:19.951719 25 prometheus.go:162] failed to register latency metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.951799254Z"}
{"log":"E1201 13:55:19.951771 25 prometheus.go:174] failed to register work_duration metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.951858445Z"}
{"log":"E1201 13:55:19.951821 25 prometheus.go:189] failed to register unfinished_work_seconds metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.951870064Z"}
{"log":"E1201 13:55:19.951907 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric admission_quota_controller: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:19.952004304Z"}
{"log":"time=\"2019-12-01T13:55:19.963610635Z\" level=info msg=\"Running kube-scheduler --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --port=10251 --secure-port=0\"\n","stream":"stderr","time":"2019-12-01T13:55:19.963752425Z"}
{"log":"time=\"2019-12-01T13:55:19.970180415Z\" level=info msg=\"Running kube-controller-manager --allocate-node-cidrs=true --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --cluster-signing-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --port=10252 --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=0 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.key --use-service-account-credentials=true\"\n","stream":"stderr","time":"2019-12-01T13:55:19.970317426Z"}
{"log":"W1201 13:55:20.003054 25 authorization.go:47] Authorization is disabled\n","stream":"stderr","time":"2019-12-01T13:55:20.003165939Z"}
{"log":"W1201 13:55:20.003083 25 authentication.go:55] Authentication is disabled\n","stream":"stderr","time":"2019-12-01T13:55:20.003192619Z"}
{"log":"E1201 13:55:20.109616 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.109743622Z"}
{"log":"E1201 13:55:20.109838 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.109894572Z"}
{"log":"E1201 13:55:20.110259 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.110352515Z"}
{"log":"E1201 13:55:20.110813 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.110887976Z"}
{"log":"E1201 13:55:20.124928 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.125073191Z"}
{"log":"E1201 13:55:20.130540 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.130638602Z"}
{"log":"E1201 13:55:20.131647 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.131741526Z"}
{"log":"E1201 13:55:20.131867 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.131931957Z"}
{"log":"E1201 13:55:20.137098 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.137198987Z"}
{"log":"E1201 13:55:20.138048 25 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:20.138120161Z"}
{"log":"E1201 13:55:20.138230 25 leaderelection.go:306] error retrieving resource lock kube-system/kube-controller-manager: endpoints \"kube-controller-manager\" is forbidden: User \"system:kube-controller-manager\" cannot get resource \"endpoints\" in API group \"\" in the namespace \"kube-system\"\n","stream":"stderr","time":"2019-12-01T13:55:20.138272661Z"}
{"log":"time=\"2019-12-01T13:55:20.145626989Z\" level=info msg=\"Creating CRD listenerconfigs.k3s.cattle.io\"\n","stream":"stderr","time":"2019-12-01T13:55:20.14575729Z"}
{"log":"time=\"2019-12-01T13:55:20.150356627Z\" level=info msg=\"Creating CRD addons.k3s.cattle.io\"\n","stream":"stderr","time":"2019-12-01T13:55:20.150464608Z"}
{"log":"time=\"2019-12-01T13:55:20.152578556Z\" level=info msg=\"Creating CRD helmcharts.helm.cattle.io\"\n","stream":"stderr","time":"2019-12-01T13:55:20.152687216Z"}
{"log":"time=\"2019-12-01T13:55:20.156419351Z\" level=info msg=\"Waiting for CRD helmcharts.helm.cattle.io to become available\"\n","stream":"stderr","time":"2019-12-01T13:55:20.156527561Z"}
{"log":"E1201 13:55:20.228886 25 controller.go:147] Unable to perform initial Kubernetes service initialization: Service \"kubernetes\" is invalid: spec.clusterIP: Invalid value: \"10.43.0.1\": cannot allocate resources of type serviceipallocations at this time\n","stream":"stderr","time":"2019-12-01T13:55:20.229049719Z"}
{"log":"E1201 13:55:20.229801 25 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/172.17.0.2, ResourceVersion: 0, AdditionalErrorMsg: \n","stream":"stderr","time":"2019-12-01T13:55:20.229918882Z"}
{"log":"2019/12/01 13:55:20 [INFO] Waiting for k3s to start\n","stream":"stdout","time":"2019-12-01T13:55:20.265107137Z"}
{"log":"time=\"2019-12-01T13:55:20.658632335Z\" level=info msg=\"Done waiting for CRD helmcharts.helm.cattle.io to become available\"\n","stream":"stderr","time":"2019-12-01T13:55:20.658769695Z"}
{"log":"time=\"2019-12-01T13:55:20.658722025Z\" level=info msg=\"Waiting for CRD listenerconfigs.k3s.cattle.io to become available\"\n","stream":"stderr","time":"2019-12-01T13:55:20.658823605Z"}
{"log":"E1201 13:55:21.121718 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.121873946Z"}
{"log":"E1201 13:55:21.124027 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.124167493Z"}
{"log":"E1201 13:55:21.139252 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.139424776Z"}
{"log":"E1201 13:55:21.153275 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.153397069Z"}
{"log":"E1201 13:55:21.157177 25 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.157273788Z"}
{"log":"E1201 13:55:21.157552 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.157641Z"}
{"log":"E1201 13:55:21.157587 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.157797202Z"}
{"log":"E1201 13:55:21.157952 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.158014053Z"}
{"log":"E1201 13:55:21.158168 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.158232355Z"}
{"log":"E1201 13:55:21.158605 25 reflector.go:126] k8s.io/client-go/informers/factory.go:130: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope\n","stream":"stderr","time":"2019-12-01T13:55:21.158673888Z"}
{"log":"time=\"2019-12-01T13:55:21.160661633Z\" level=info msg=\"Done waiting for CRD listenerconfigs.k3s.cattle.io to become available\"\n","stream":"stderr","time":"2019-12-01T13:55:21.160820774Z"}
{"log":"time=\"2019-12-01T13:55:21.160697223Z\" level=info msg=\"Waiting for CRD addons.k3s.cattle.io to become available\"\n","stream":"stderr","time":"2019-12-01T13:55:21.160842084Z"}
{"log":"2019/12/01 13:55:21 [INFO] Waiting for k3s to start\n","stream":"stdout","time":"2019-12-01T13:55:21.265277006Z"}
{"log":"time=\"2019-12-01T13:55:21.662683441Z\" level=info msg=\"Done waiting for CRD addons.k3s.cattle.io to become available\"\n","stream":"stderr","time":"2019-12-01T13:55:21.662823882Z"}
{"log":"time=\"2019-12-01T13:55:21.670504589Z\" level=info msg=\"Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-1.64.0.tgz\"\n","stream":"stderr","time":"2019-12-01T13:55:21.67064836Z"}
{"log":"time=\"2019-12-01T13:55:21.670823931Z\" level=info msg=\"Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"\n","stream":"stderr","time":"2019-12-01T13:55:21.670900302Z"}
{"log":"E1201 13:55:21.671075 25 prometheus.go:138] failed to register depth metric k3s.cattle.io/v1, Kind=Addon: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=Addon_depth\", help: \"(Deprecated) Current depth of workqueue: k3s.cattle.io/v1, Kind=Addon\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=Addon_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.671153173Z"}
{"log":"E1201 13:55:21.671116 25 prometheus.go:150] failed to register adds metric k3s.cattle.io/v1, Kind=Addon: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=Addon_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: k3s.cattle.io/v1, Kind=Addon\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=Addon_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.671175374Z"}
{"log":"E1201 13:55:21.671166 25 prometheus.go:162] failed to register latency metric k3s.cattle.io/v1, Kind=Addon: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=Addon_queue_latency\", help: \"(Deprecated) How long an item stays in workqueuek3s.cattle.io/v1, Kind=Addon before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=Addon_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.671241645Z"}
{"log":"E1201 13:55:21.671222 25 prometheus.go:174] failed to register work_duration metric k3s.cattle.io/v1, Kind=Addon: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=Addon_work_duration\", help: \"(Deprecated) How long processing an item from workqueuek3s.cattle.io/v1, Kind=Addon takes.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=Addon_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.671316295Z"}
{"log":"E1201 13:55:21.671257 25 prometheus.go:189] failed to register unfinished_work_seconds metric k3s.cattle.io/v1, Kind=Addon: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=Addon_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work k3s.cattle.io/v1, Kind=Addon has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=Addon_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.671328215Z"}
{"log":"E1201 13:55:21.671285 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric k3s.cattle.io/v1, Kind=Addon: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=Addon_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for k3s.cattle.io/v1, Kind=Addon been running.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=Addon_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.671387675Z"}
{"log":"E1201 13:55:21.671330 25 prometheus.go:214] failed to register retries metric k3s.cattle.io/v1, Kind=Addon: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=Addon_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: k3s.cattle.io/v1, Kind=Addon\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=Addon_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.671398835Z"}
{"log":"time=\"2019-12-01T13:55:21.674895261Z\" level=error msg=\"Update cert unable to convert string to cert: Unable to split cert into two parts\"\n","stream":"stderr","time":"2019-12-01T13:55:21.675030673Z"}
{"log":"time=\"2019-12-01T13:55:21.675071032Z\" level=info msg=\"Listening on :6443\"\n","stream":"stderr","time":"2019-12-01T13:55:21.675126933Z"}
{"log":"E1201 13:55:21.681966 25 prometheus.go:138] failed to register depth metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=ListenerConfig_depth\", help: \"(Deprecated) Current depth of workqueue: k3s.cattle.io/v1, Kind=ListenerConfig\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=ListenerConfig_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.682077805Z"}
{"log":"E1201 13:55:21.682015 25 prometheus.go:150] failed to register adds metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=ListenerConfig_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: k3s.cattle.io/v1, Kind=ListenerConfig\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=ListenerConfig_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.682159025Z"}
{"log":"E1201 13:55:21.682091 25 prometheus.go:162] failed to register latency metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=ListenerConfig_queue_latency\", help: \"(Deprecated) How long an item stays in workqueuek3s.cattle.io/v1, Kind=ListenerConfig before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=ListenerConfig_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.682179065Z"}
{"log":"E1201 13:55:21.682162 25 prometheus.go:174] failed to register work_duration metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=ListenerConfig_work_duration\", help: \"(Deprecated) How long processing an item from workqueuek3s.cattle.io/v1, Kind=ListenerConfig takes.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=ListenerConfig_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.682238435Z"}
{"log":"E1201 13:55:21.682219 25 prometheus.go:189] failed to register unfinished_work_seconds metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=ListenerConfig_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work k3s.cattle.io/v1, Kind=ListenerConfig has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=ListenerConfig_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.682291286Z"}
{"log":"E1201 13:55:21.682260 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=ListenerConfig_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for k3s.cattle.io/v1, Kind=ListenerConfig been running.\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=ListenerConfig_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.682303536Z"}
{"log":"E1201 13:55:21.682338 25 prometheus.go:214] failed to register retries metric k3s.cattle.io/v1, Kind=ListenerConfig: descriptor Desc{fqName: \"k3s.cattle.io/v1, Kind=ListenerConfig_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: k3s.cattle.io/v1, Kind=ListenerConfig\", constLabels: {}, variableLabels: []} is invalid: \"k3s.cattle.io/v1, Kind=ListenerConfig_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:21.682379047Z"}
{"log":"time=\"2019-12-01T13:55:22.183278491Z\" level=info msg=\"Starting k3s.cattle.io/v1, Kind=Addon controller\"\n","stream":"stderr","time":"2019-12-01T13:55:22.183468414Z"}
{"log":"2019/12/01 13:55:22 [INFO] Waiting for k3s to start\n","stream":"stdout","time":"2019-12-01T13:55:22.265440691Z"}
{"log":"time=\"2019-12-01T13:55:22.283474364Z\" level=info msg=\"Starting k3s.cattle.io/v1, Kind=ListenerConfig controller\"\n","stream":"stderr","time":"2019-12-01T13:55:22.283639116Z"}
{"log":"time=\"2019-12-01T13:55:22.283658426Z\" level=error msg=\"Update cert unable to convert string to cert: Unable to split cert into two parts\"\n","stream":"stderr","time":"2019-12-01T13:55:22.283787108Z"}
{"log":"time=\"2019-12-01T13:55:22.283963969Z\" level=info msg=\"Node token is available at /var/lib/rancher/k3s/server/node-token\"\n","stream":"stderr","time":"2019-12-01T13:55:22.284085301Z"}
{"log":"time=\"2019-12-01T13:55:22.284005310Z\" level=info msg=\"To join node to cluster: k3s agent -s https://172.17.0.2:6443 -t ${NODE_TOKEN}\"\n","stream":"stderr","time":"2019-12-01T13:55:22.284104791Z"}
{"log":"E1201 13:55:22.293137 25 prometheus.go:138] failed to register depth metric /v1, Kind=Node: descriptor Desc{fqName: \"/v1, Kind=Node_depth\", help: \"(Deprecated) Current depth of workqueue: /v1, Kind=Node\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Node_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.293277489Z"}
{"log":"E1201 13:55:22.293283 25 prometheus.go:150] failed to register adds metric /v1, Kind=Node: descriptor Desc{fqName: \"/v1, Kind=Node_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: /v1, Kind=Node\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Node_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.293360619Z"}
{"log":"E1201 13:55:22.293423 25 prometheus.go:162] failed to register latency metric /v1, Kind=Node: descriptor Desc{fqName: \"/v1, Kind=Node_queue_latency\", help: \"(Deprecated) How long an item stays in workqueue/v1, Kind=Node before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Node_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.293521691Z"}
{"log":"E1201 13:55:22.293556 25 prometheus.go:174] failed to register work_duration metric /v1, Kind=Node: descriptor Desc{fqName: \"/v1, Kind=Node_work_duration\", help: \"(Deprecated) How long processing an item from workqueue/v1, Kind=Node takes.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Node_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.293650523Z"}
{"log":"E1201 13:55:22.293648 25 prometheus.go:189] failed to register unfinished_work_seconds metric /v1, Kind=Node: descriptor Desc{fqName: \"/v1, Kind=Node_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work /v1, Kind=Node has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Node_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.293752364Z"}
{"log":"E1201 13:55:22.293750 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric /v1, Kind=Node: descriptor Desc{fqName: \"/v1, Kind=Node_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for /v1, Kind=Node been running.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Node_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.293828915Z"}
{"log":"E1201 13:55:22.293857 25 prometheus.go:214] failed to register retries metric /v1, Kind=Node: descriptor Desc{fqName: \"/v1, Kind=Node_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: /v1, Kind=Node\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Node_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.293950016Z"}
{"log":"E1201 13:55:22.294108 25 prometheus.go:138] failed to register depth metric batch/v1, Kind=Job: descriptor Desc{fqName: \"batch/v1, Kind=Job_depth\", help: \"(Deprecated) Current depth of workqueue: batch/v1, Kind=Job\", constLabels: {}, variableLabels: []} is invalid: \"batch/v1, Kind=Job_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.294182749Z"}
{"log":"E1201 13:55:22.294257 25 prometheus.go:150] failed to register adds metric batch/v1, Kind=Job: descriptor Desc{fqName: \"batch/v1, Kind=Job_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: batch/v1, Kind=Job\", constLabels: {}, variableLabels: []} is invalid: \"batch/v1, Kind=Job_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.2943245Z"}
{"log":"E1201 13:55:22.294428 25 prometheus.go:162] failed to register latency metric batch/v1, Kind=Job: descriptor Desc{fqName: \"batch/v1, Kind=Job_queue_latency\", help: \"(Deprecated) How long an item stays in workqueuebatch/v1, Kind=Job before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"batch/v1, Kind=Job_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.294489092Z"}
{"log":"E1201 13:55:22.294580 25 prometheus.go:174] failed to register work_duration metric batch/v1, Kind=Job: descriptor Desc{fqName: \"batch/v1, Kind=Job_work_duration\", help: \"(Deprecated) How long processing an item from workqueuebatch/v1, Kind=Job takes.\", constLabels: {}, variableLabels: []} is invalid: \"batch/v1, Kind=Job_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.294664564Z"}
{"log":"E1201 13:55:22.294745 25 prometheus.go:189] failed to register unfinished_work_seconds metric batch/v1, Kind=Job: descriptor Desc{fqName: \"batch/v1, Kind=Job_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work batch/v1, Kind=Job has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"batch/v1, Kind=Job_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.294814385Z"}
{"log":"E1201 13:55:22.294894 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric batch/v1, Kind=Job: descriptor Desc{fqName: \"batch/v1, Kind=Job_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for batch/v1, Kind=Job been running.\", constLabels: {}, variableLabels: []} is invalid: \"batch/v1, Kind=Job_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.294956657Z"}
{"log":"E1201 13:55:22.295062 25 prometheus.go:214] failed to register retries metric batch/v1, Kind=Job: descriptor Desc{fqName: \"batch/v1, Kind=Job_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: batch/v1, Kind=Job\", constLabels: {}, variableLabels: []} is invalid: \"batch/v1, Kind=Job_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.295138789Z"}
{"log":"E1201 13:55:22.295287 25 prometheus.go:138] failed to register depth metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: \"helm.cattle.io/v1, Kind=HelmChart_depth\", help: \"(Deprecated) Current depth of workqueue: helm.cattle.io/v1, Kind=HelmChart\", constLabels: {}, variableLabels: []} is invalid: \"helm.cattle.io/v1, Kind=HelmChart_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.295359191Z"}
{"log":"E1201 13:55:22.295435 25 prometheus.go:150] failed to register adds metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: \"helm.cattle.io/v1, Kind=HelmChart_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: helm.cattle.io/v1, Kind=HelmChart\", constLabels: {}, variableLabels: []} is invalid: \"helm.cattle.io/v1, Kind=HelmChart_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.295500303Z"}
{"log":"E1201 13:55:22.295593 25 prometheus.go:162] failed to register latency metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: \"helm.cattle.io/v1, Kind=HelmChart_queue_latency\", help: \"(Deprecated) How long an item stays in workqueuehelm.cattle.io/v1, Kind=HelmChart before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"helm.cattle.io/v1, Kind=HelmChart_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.295660844Z"}
{"log":"E1201 13:55:22.295767 25 prometheus.go:174] failed to register work_duration metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: \"helm.cattle.io/v1, Kind=HelmChart_work_duration\", help: \"(Deprecated) How long processing an item from workqueuehelm.cattle.io/v1, Kind=HelmChart takes.\", constLabels: {}, variableLabels: []} is invalid: \"helm.cattle.io/v1, Kind=HelmChart_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.295834836Z"}
{"log":"E1201 13:55:22.295918 25 prometheus.go:189] failed to register unfinished_work_seconds metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: \"helm.cattle.io/v1, Kind=HelmChart_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work helm.cattle.io/v1, Kind=HelmChart has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"helm.cattle.io/v1, Kind=HelmChart_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.295988558Z"}
{"log":"E1201 13:55:22.296064 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: \"helm.cattle.io/v1, Kind=HelmChart_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for helm.cattle.io/v1, Kind=HelmChart been running.\", constLabels: {}, variableLabels: []} is invalid: \"helm.cattle.io/v1, Kind=HelmChart_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.29613356Z"}
{"log":"E1201 13:55:22.296229 25 prometheus.go:214] failed to register retries metric helm.cattle.io/v1, Kind=HelmChart: descriptor Desc{fqName: \"helm.cattle.io/v1, Kind=HelmChart_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: helm.cattle.io/v1, Kind=HelmChart\", constLabels: {}, variableLabels: []} is invalid: \"helm.cattle.io/v1, Kind=HelmChart_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.296298401Z"}
{"log":"E1201 13:55:22.296500 25 prometheus.go:138] failed to register depth metric /v1, Kind=Service: descriptor Desc{fqName: \"/v1, Kind=Service_depth\", help: \"(Deprecated) Current depth of workqueue: /v1, Kind=Service\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Service_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.296576385Z"}
{"log":"E1201 13:55:22.296651 25 prometheus.go:150] failed to register adds metric /v1, Kind=Service: descriptor Desc{fqName: \"/v1, Kind=Service_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: /v1, Kind=Service\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Service_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.296715096Z"}
{"log":"E1201 13:55:22.296808 25 prometheus.go:162] failed to register latency metric /v1, Kind=Service: descriptor Desc{fqName: \"/v1, Kind=Service_queue_latency\", help: \"(Deprecated) How long an item stays in workqueue/v1, Kind=Service before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Service_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.296874488Z"}
{"log":"E1201 13:55:22.296970 25 prometheus.go:174] failed to register work_duration metric /v1, Kind=Service: descriptor Desc{fqName: \"/v1, Kind=Service_work_duration\", help: \"(Deprecated) How long processing an item from workqueue/v1, Kind=Service takes.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Service_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.2970377Z"}
{"log":"E1201 13:55:22.297126 25 prometheus.go:189] failed to register unfinished_work_seconds metric /v1, Kind=Service: descriptor Desc{fqName: \"/v1, Kind=Service_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work /v1, Kind=Service has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Service_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.297193211Z"}
{"log":"E1201 13:55:22.297271 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric /v1, Kind=Service: descriptor Desc{fqName: \"/v1, Kind=Service_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for /v1, Kind=Service been running.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Service_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.297338973Z"}
{"log":"E1201 13:55:22.297432 25 prometheus.go:214] failed to register retries metric /v1, Kind=Service: descriptor Desc{fqName: \"/v1, Kind=Service_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: /v1, Kind=Service\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Service_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.297500015Z"}
{"log":"E1201 13:55:22.297646 25 prometheus.go:138] failed to register depth metric /v1, Kind=Pod: descriptor Desc{fqName: \"/v1, Kind=Pod_depth\", help: \"(Deprecated) Current depth of workqueue: /v1, Kind=Pod\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Pod_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.297718797Z"}
{"log":"E1201 13:55:22.297792 25 prometheus.go:150] failed to register adds metric /v1, Kind=Pod: descriptor Desc{fqName: \"/v1, Kind=Pod_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: /v1, Kind=Pod\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Pod_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.297857648Z"}
{"log":"E1201 13:55:22.297942 25 prometheus.go:162] failed to register latency metric /v1, Kind=Pod: descriptor Desc{fqName: \"/v1, Kind=Pod_queue_latency\", help: \"(Deprecated) How long an item stays in workqueue/v1, Kind=Pod before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Pod_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.298010349Z"}
{"log":"E1201 13:55:22.298124 25 prometheus.go:174] failed to register work_duration metric /v1, Kind=Pod: descriptor Desc{fqName: \"/v1, Kind=Pod_work_duration\", help: \"(Deprecated) How long processing an item from workqueue/v1, Kind=Pod takes.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Pod_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.298194242Z"}
{"log":"E1201 13:55:22.298277 25 prometheus.go:189] failed to register unfinished_work_seconds metric /v1, Kind=Pod: descriptor Desc{fqName: \"/v1, Kind=Pod_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work /v1, Kind=Pod has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Pod_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.298344664Z"}
{"log":"E1201 13:55:22.298421 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric /v1, Kind=Pod: descriptor Desc{fqName: \"/v1, Kind=Pod_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for /v1, Kind=Pod been running.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Pod_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.298487285Z"}
{"log":"E1201 13:55:22.298587 25 prometheus.go:214] failed to register retries metric /v1, Kind=Pod: descriptor Desc{fqName: \"/v1, Kind=Pod_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: /v1, Kind=Pod\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Pod_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.298657147Z"}
{"log":"E1201 13:55:22.298801 25 prometheus.go:138] failed to register depth metric /v1, Kind=Endpoints: descriptor Desc{fqName: \"/v1, Kind=Endpoints_depth\", help: \"(Deprecated) Current depth of workqueue: /v1, Kind=Endpoints\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Endpoints_depth\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.298873979Z"}
{"log":"E1201 13:55:22.298948 25 prometheus.go:150] failed to register adds metric /v1, Kind=Endpoints: descriptor Desc{fqName: \"/v1, Kind=Endpoints_adds\", help: \"(Deprecated) Total number of adds handled by workqueue: /v1, Kind=Endpoints\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Endpoints_adds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.299028781Z"}
{"log":"E1201 13:55:22.299125 25 prometheus.go:162] failed to register latency metric /v1, Kind=Endpoints: descriptor Desc{fqName: \"/v1, Kind=Endpoints_queue_latency\", help: \"(Deprecated) How long an item stays in workqueue/v1, Kind=Endpoints before being requested.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Endpoints_queue_latency\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.299190973Z"}
{"log":"E1201 13:55:22.299288 25 prometheus.go:174] failed to register work_duration metric /v1, Kind=Endpoints: descriptor Desc{fqName: \"/v1, Kind=Endpoints_work_duration\", help: \"(Deprecated) How long processing an item from workqueue/v1, Kind=Endpoints takes.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Endpoints_work_duration\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.299359814Z"}
{"log":"E1201 13:55:22.299441 25 prometheus.go:189] failed to register unfinished_work_seconds metric /v1, Kind=Endpoints: descriptor Desc{fqName: \"/v1, Kind=Endpoints_unfinished_work_seconds\", help: \"(Deprecated) How many seconds of work /v1, Kind=Endpoints has done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Endpoints_unfinished_work_seconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.299508396Z"}
{"log":"E1201 13:55:22.299586 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric /v1, Kind=Endpoints: descriptor Desc{fqName: \"/v1, Kind=Endpoints_longest_running_processor_microseconds\", help: \"(Deprecated) How many microseconds has the longest running processor for /v1, Kind=Endpoints been running.\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Endpoints_longest_running_processor_microseconds\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.299653187Z"}
{"log":"E1201 13:55:22.299745 25 prometheus.go:214] failed to register retries metric /v1, Kind=Endpoints: descriptor Desc{fqName: \"/v1, Kind=Endpoints_retries\", help: \"(Deprecated) Total number of retries handled by workqueue: /v1, Kind=Endpoints\", constLabels: {}, variableLabels: []} is invalid: \"/v1, Kind=Endpoints_retries\" is not a valid metric name\n","stream":"stderr","time":"2019-12-01T13:55:22.299813768Z"}
{"log":"time=\"2019-12-01T13:55:22.368097340Z\" level=info msg=\"Wrote kubeconfig /etc/rancher/k3s/k3s.yaml\"\n","stream":"stderr","time":"2019-12-01T13:55:22.368233571Z"}
{"log":"time=\"2019-12-01T13:55:22.368306152Z\" level=info msg=\"Run: k3s kubectl\"\n","stream":"stderr","time":"2019-12-01T13:55:22.368346093Z"}
{"log":"time=\"2019-12-01T13:55:22.368400493Z\" level=info msg=\"k3s is up and running\"\n","stream":"stderr","time":"2019-12-01T13:55:22.368438683Z"}
{"log":"2019/12/01 13:55:23 [INFO] Running in single server mode, will not peer connections\n","stream":"stdout","time":"2019-12-01T13:55:23.284324598Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD apps.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.290534445Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD authconfigs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.297953996Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD catalogs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.302910825Z"}
{"log":"time=\"2019-12-01T13:55:23.305141766Z\" level=info msg=\"Starting helm.cattle.io/v1, Kind=HelmChart controller\"\n","stream":"stderr","time":"2019-12-01T13:55:23.30540916Z"}
{"log":"E1201 13:55:23.306304 25 autoregister_controller.go:193] v3.project.cattle.io failed with : apiservices.apiregistration.k8s.io \"v3.project.cattle.io\" already exists\n","stream":"stderr","time":"2019-12-01T13:55:23.306437464Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD apprevisions.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.308828127Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD catalogtemplates.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.309331364Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD pipelineexecutions.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.314222811Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD catalogtemplateversions.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.315276026Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD clusteralerts.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.327412304Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD pipelinesettings.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.327538406Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD pipelines.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.340600606Z"}
{"log":"W1201 13:55:23.449911 25 lease.go:222] Resetting endpoints for master service \"kubernetes\" to [172.17.0.2]\n","stream":"stderr","time":"2019-12-01T13:55:23.450071578Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD clusteralertgroups.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.487953181Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD sourcecodecredentials.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.687742951Z"}
{"log":"time=\"2019-12-01T13:55:23.816250126Z\" level=info msg=\"Starting batch/v1, Kind=Job controller\"\n","stream":"stderr","time":"2019-12-01T13:55:23.816428169Z"}
{"log":"2019/12/01 13:55:23 [INFO] Creating CRD clustercatalogs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:23.889870613Z"}
{"log":"2019-12-01 13:55:24.142645 W | etcdserver: read-only range request \"key:\\\"/registry/health\\\" \" with result \"range_response_count:0 size:5\" took too long (100.838485ms) to execute\n","stream":"stderr","time":"2019-12-01T13:55:24.142786202Z"}
{"log":"2019/12/01 13:55:24 [INFO] Creating CRD sourcecodeproviderconfigs.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:24.144671163Z"}
{"log":"time=\"2019-12-01T13:55:24.525391464Z\" level=info msg=\"Starting /v1, Kind=Node controller\"\n","stream":"stderr","time":"2019-12-01T13:55:24.525569826Z"}
{"log":"time=\"2019-12-01T13:55:24.625520797Z\" level=info msg=\"Starting /v1, Kind=Service controller\"\n","stream":"stderr","time":"2019-12-01T13:55:24.625708071Z"}
{"log":"2019-12-01 13:55:24.643181 W | etcdserver: request \"header:\u003cID:7587842725592610561 \u003e txn:\u003ccompare:\u003ctarget:MOD key:\\\"/registry/apiextensions.k8s.io/customresourcedefinitions/clustercatalogs.management.cattle.io\\\" mod_revision:0 \u003e success:\u003crequest_put:\u003ckey:\\\"/registry/apiextensions.k8s.io/customresourcedefinitions/clustercatalogs.management.cattle.io\\\" value_size:621 \u003e\u003e failure:\u003c\u003e\u003e\" with result \"size:16\" took too long (356.544159ms) to execute\n","stream":"stderr","time":"2019-12-01T13:55:24.644277371Z"}
{"log":"2019-12-01 13:55:24.643455 W | etcdserver: read-only range request \"key:\\\"/registry/configmaps/kube-system/k3s\\\" \" with result \"range_response_count:1 size:469\" took too long (284.489594ms) to execute\n","stream":"stderr","time":"2019-12-01T13:55:24.644312231Z"}
{"log":"2019-12-01 13:55:24.643524 W | etcdserver: read-only range request \"key:\\\"/registry/serviceaccounts/kube-system/replicaset-controller\\\" \" with result \"range_response_count:0 size:5\" took too long (188.091785ms) to execute\n","stream":"stderr","time":"2019-12-01T13:55:24.644320972Z"}
{"log":"2019/12/01 13:55:24 [INFO] Creating CRD clusterloggings.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:24.645044604Z"}
{"log":"2019/12/01 13:55:24 [INFO] Creating CRD sourcecoderepositories.project.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:24.646114012Z"}
{"log":"time=\"2019-12-01T13:55:24.725656432Z\" level=info msg=\"Starting /v1, Kind=Pod controller\"\n","stream":"stderr","time":"2019-12-01T13:55:24.725801635Z"}
{"log":"2019/12/01 13:55:24 [INFO] Creating CRD clusteralertrules.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:24.826878206Z"}
{"log":"time=\"2019-12-01T13:55:24.826968937Z\" level=info msg=\"Starting /v1, Kind=Endpoints controller\"\n","stream":"stderr","time":"2019-12-01T13:55:24.827083849Z"}
{"log":"W1201 13:55:24.916508 25 probe.go:268] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.\n","stream":"stderr","time":"2019-12-01T13:55:24.916624177Z"}
{"log":"2019/12/01 13:55:25 [INFO] Creating CRD clustermonitorgraphs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:25.087777495Z"}
{"log":"2019/12/01 13:55:25 [INFO] Creating CRD clusterregistrationtokens.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:25.487666132Z"}
{"log":"2019/12/01 13:55:25 [INFO] Creating CRD clusterroletemplatebindings.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:25.687747646Z"}
{"log":"2019/12/01 13:55:25 [INFO] Creating CRD clusterscans.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:25.887799249Z"}
{"log":"2019/12/01 13:55:26 [INFO] Creating CRD clusters.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:26.087815812Z"}
{"log":"W1201 13:55:26.233467 25 shared_informer.go:312] resyncPeriod 59351996749217 is smaller than resyncCheckPeriod 59887182340429 and the informer has already started. Changing it to 59887182340429\n","stream":"stderr","time":"2019-12-01T13:55:26.233636278Z"}
{"log":"E1201 13:55:26.234703 25 resource_quota_controller.go:171] initial monitor sync has error: [couldn't start monitor for resource \"management.cattle.io/v3, Resource=clustercatalogs\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clustercatalogs\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=apps\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=apps\", couldn't start monitor for resource \"helm.cattle.io/v1, Resource=helmcharts\": unable to monitor quota for resource \"helm.cattle.io/v1, Resource=helmcharts\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=apprevisions\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=apprevisions\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=pipelines\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=pipelines\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=catalogtemplateversions\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=catalogtemplateversions\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=catalogtemplates\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=catalogtemplates\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusteralertgroups\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusteralertgroups\", couldn't start monitor for resource \"k3s.cattle.io/v1, Resource=listenerconfigs\": unable to monitor quota for resource \"k3s.cattle.io/v1, Resource=listenerconfigs\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=sourcecoderepositories\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=sourcecoderepositories\", couldn't start monitor for resource \"extensions/v1beta1, Resource=networkpolicies\": unable to monitor quota for resource \"extensions/v1beta1, Resource=networkpolicies\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusteralertrules\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusteralertrules\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=sourcecodecredentials\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=sourcecodecredentials\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clustermonitorgraphs\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clustermonitorgraphs\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterscans\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterscans\", couldn't start monitor for resource \"k3s.cattle.io/v1, Resource=addons\": unable to monitor quota for resource \"k3s.cattle.io/v1, Resource=addons\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterregistrationtokens\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterregistrationtokens\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=pipelinesettings\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=pipelinesettings\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterloggings\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterloggings\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusteralerts\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusteralerts\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterroletemplatebindings\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterroletemplatebindings\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=sourcecodeproviderconfigs\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=sourcecodeproviderconfigs\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=pipelineexecutions\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=pipelineexecutions\"]\n","stream":"stderr","time":"2019-12-01T13:55:26.234825474Z"}
{"log":"2019/12/01 13:55:26 [INFO] Creating CRD composeconfigs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:26.287993745Z"}
{"log":"2019/12/01 13:55:26 [INFO] Creating CRD dynamicschemas.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:26.488708686Z"}
{"log":"2019/12/01 13:55:26 [INFO] Creating CRD etcdbackups.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:26.687608767Z"}
{"log":"2019/12/01 13:55:26 [INFO] Creating CRD features.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:26.887682992Z"}
{"log":"W1201 13:55:27.031445 25 controllermanager.go:445] Skipping \"root-ca-cert-publisher\"\n","stream":"stderr","time":"2019-12-01T13:55:27.031613355Z"}
{"log":"2019/12/01 13:55:27 [INFO] Creating CRD globalrolebindings.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:27.088577831Z"}
{"log":"2019/12/01 13:55:27 [INFO] Creating CRD globalroles.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:27.297538675Z"}
{"log":"2019/12/01 13:55:27 [INFO] Creating CRD groupmembers.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:27.49880055Z"}
{"log":"E1201 13:55:27.681417 25 prometheus.go:138] failed to register depth metric certificate: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:27.681595066Z"}
{"log":"E1201 13:55:27.681462 25 prometheus.go:150] failed to register adds metric certificate: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:27.681623686Z"}
{"log":"E1201 13:55:27.681521 25 prometheus.go:162] failed to register latency metric certificate: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:27.681689878Z"}
{"log":"E1201 13:55:27.681605 25 prometheus.go:174] failed to register work_duration metric certificate: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:27.681702528Z"}
{"log":"E1201 13:55:27.681665 25 prometheus.go:189] failed to register unfinished_work_seconds metric certificate: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:27.681754779Z"}
{"log":"E1201 13:55:27.681693 25 prometheus.go:202] failed to register longest_running_processor_microseconds metric certificate: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:27.68176456Z"}
{"log":"E1201 13:55:27.681771 25 prometheus.go:214] failed to register retries metric certificate: duplicate metrics collector registration attempted\n","stream":"stderr","time":"2019-12-01T13:55:27.681802871Z"}
{"log":"2019/12/01 13:55:27 [INFO] Creating CRD groups.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:27.687541381Z"}
{"log":"2019/12/01 13:55:27 [INFO] Creating CRD kontainerdrivers.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:27.888189642Z"}
{"log":"2019/12/01 13:55:28 [INFO] Creating CRD listenconfigs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:28.087572335Z"}
{"log":"2019/12/01 13:55:28 [INFO] Creating CRD multiclusterapps.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:28.287584548Z"}
{"log":"2019/12/01 13:55:28 [INFO] Creating CRD multiclusterapprevisions.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:28.487592563Z"}
{"log":"2019/12/01 13:55:28 [INFO] Creating CRD monitormetrics.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:28.687778074Z"}
{"log":"2019/12/01 13:55:28 [INFO] Creating CRD nodedrivers.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:28.887541143Z"}
{"log":"2019/12/01 13:55:29 [INFO] Creating CRD nodepools.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:29.087372208Z"}
{"log":"2019/12/01 13:55:29 [INFO] Creating CRD nodetemplates.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:29.28745536Z"}
{"log":"2019/12/01 13:55:29 [INFO] Creating CRD nodes.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:29.487540622Z"}
{"log":"2019/12/01 13:55:29 [INFO] Creating CRD notifiers.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:29.68877189Z"}
{"log":"2019/12/01 13:55:29 [INFO] Creating CRD podsecuritypolicytemplateprojectbindings.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:29.887849291Z"}
{"log":"2019/12/01 13:55:30 [INFO] Creating CRD podsecuritypolicytemplates.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:30.087952237Z"}
{"log":"2019/12/01 13:55:30 [INFO] Creating CRD preferences.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:30.287873608Z"}
{"log":"2019/12/01 13:55:30 [INFO] Creating CRD projectalerts.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:30.487642374Z"}
{"log":"2019/12/01 13:55:30 [INFO] Creating CRD projectalertgroups.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:30.687565966Z"}
{"log":"2019/12/01 13:55:30 [INFO] Creating CRD projectcatalogs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:30.887776456Z"}
{"log":"2019/12/01 13:55:31 [INFO] Creating CRD projectloggings.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:31.087501678Z"}
{"log":"2019/12/01 13:55:31 [INFO] Creating CRD projectalertrules.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:31.287947355Z"}
{"log":"2019/12/01 13:55:31 [INFO] Creating CRD projectmonitorgraphs.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:31.487891401Z"}
{"log":"2019/12/01 13:55:31 [INFO] Creating CRD projectnetworkpolicies.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:31.687658478Z"}
{"log":"2019/12/01 13:55:31 [INFO] Creating CRD projectroletemplatebindings.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:31.887809058Z"}
{"log":"2019/12/01 13:55:32 [INFO] Creating CRD projects.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:32.087768576Z"}
{"log":"2019/12/01 13:55:32 [INFO] Creating CRD rkek8ssystemimages.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:32.288246782Z"}
{"log":"2019/12/01 13:55:32 [INFO] Creating CRD rkek8sserviceoptions.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:32.4879005Z"}
{"log":"2019/12/01 13:55:32 [INFO] Creating CRD rkeaddons.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:32.687679236Z"}
{"log":"2019/12/01 13:55:32 [INFO] Creating CRD roletemplates.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:32.887956257Z"}
{"log":"2019/12/01 13:55:33 [INFO] Creating CRD settings.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:33.089224456Z"}
{"log":"2019/12/01 13:55:33 [INFO] Creating CRD templates.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:33.287728981Z"}
{"log":"2019/12/01 13:55:33 [INFO] Creating CRD templateversions.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:33.487870385Z"}
{"log":"2019/12/01 13:55:33 [INFO] Creating CRD templatecontents.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:33.687816372Z"}
{"log":"2019/12/01 13:55:33 [INFO] Creating CRD tokens.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:33.887725367Z"}
{"log":"2019/12/01 13:55:34 [INFO] Creating CRD userattributes.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:34.087777744Z"}
{"log":"2019/12/01 13:55:34 [INFO] Creating CRD users.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:34.287831447Z"}
{"log":"2019/12/01 13:55:34 [INFO] Creating CRD globaldnses.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:34.487848682Z"}
{"log":"2019/12/01 13:55:34 [INFO] Creating CRD globaldnsproviders.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:34.687540805Z"}
{"log":"2019/12/01 13:55:34 [INFO] Creating CRD clustertemplates.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:34.888576899Z"}
{"log":"2019/12/01 13:55:35 [INFO] Creating CRD clustertemplaterevisions.management.cattle.io\n","stream":"stdout","time":"2019-12-01T13:55:35.087652138Z"}
{"log":"2019/12/01 13:55:36 [INFO] Starting API controllers\n","stream":"stdout","time":"2019-12-01T13:55:36.156852075Z"}
{"log":"2019/12/01 13:55:37 [INFO] Starting catalog controller\n","stream":"stdout","time":"2019-12-01T13:55:37.118671395Z"}
{"log":"2019/12/01 13:55:37 [INFO] Starting project-level catalog controller\n","stream":"stdout","time":"2019-12-01T13:55:37.11876985Z"}
{"log":"2019/12/01 13:55:37 [INFO] Starting cluster-level catalog controller\n","stream":"stdout","time":"2019-12-01T13:55:37.11878141Z"}
{"log":"2019/12/01 13:55:37 [INFO] Starting management controllers\n","stream":"stdout","time":"2019-12-01T13:55:37.140298065Z"}
{"log":"2019/12/01 13:55:37 [INFO] Reconciling GlobalRoles\n","stream":"stdout","time":"2019-12-01T13:55:37.999977052Z"}
{"log":"2019/12/01 13:55:38 [INFO] Listening on :443\n","stream":"stdout","time":"2019-12-01T13:55:38.003255728Z"}
{"log":"2019/12/01 13:55:38 [INFO] Listening on :80\n","stream":"stdout","time":"2019-12-01T13:55:38.003267919Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating users-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.00496868Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating user\n","stream":"stdout","time":"2019-12-01T13:55:38.012420308Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-users-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.013283225Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating user-base\n","stream":"stdout","time":"2019-12-01T13:55:38.023984342Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating clusters-create\n","stream":"stdout","time":"2019-12-01T13:55:38.028376289Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-user for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.029860213Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating nodedrivers-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.034180487Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating authn-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.03610951Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating podsecuritypolicytemplates-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.04033574Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-user-base for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.041822333Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-nodedrivers-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.058122269Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating kontainerdrivers-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.058479105Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-clusters-create for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.061234523Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-authn-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.061918332Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating roles-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.068153738Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-podsecuritypolicytemplates-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.06844134Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-kontainerdrivers-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.077158812Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating settings-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.078845534Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating features-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.087595548Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-roles-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.088959057Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating catalogs-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.098279775Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-settings-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.10519121Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-features-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.105943252Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating catalogs-use\n","stream":"stdout","time":"2019-12-01T13:55:38.106739707Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating clustertemplates-create\n","stream":"stdout","time":"2019-12-01T13:55:38.119249291Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-catalogs-manage for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.119711701Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-catalogs-use for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.126160847Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating admin\n","stream":"stdout","time":"2019-12-01T13:55:38.130743472Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-clustertemplates-create for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.141439549Z"}
{"log":"2019/12/01 13:55:38 [INFO] Reconciling RoleTemplates\n","stream":"stdout","time":"2019-12-01T13:55:38.143024667Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-gr-controller] Creating clusterRole cattle-globalrole-admin for corresponding GlobalRole\n","stream":"stdout","time":"2019-12-01T13:55:38.145477082Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating cluster-admin\n","stream":"stdout","time":"2019-12-01T13:55:38.146657973Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating view\n","stream":"stdout","time":"2019-12-01T13:55:38.159610806Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating cluster-owner\n","stream":"stdout","time":"2019-12-01T13:55:38.17327684Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating clustercatalogs-view\n","stream":"stdout","time":"2019-12-01T13:55:38.179252025Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating ingress-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.187494438Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating ingress-view\n","stream":"stdout","time":"2019-12-01T13:55:38.198516029Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating services-view\n","stream":"stdout","time":"2019-12-01T13:55:38.206663828Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating configmaps-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.212469436Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating persistentvolumeclaims-view\n","stream":"stdout","time":"2019-12-01T13:55:38.219284087Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating serviceaccounts-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.222825978Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating projectcatalogs-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.225572126Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating nodes-view\n","stream":"stdout","time":"2019-12-01T13:55:38.233318906Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating clusterroletemplatebindings-view\n","stream":"stdout","time":"2019-12-01T13:55:38.238218516Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating project-owner\n","stream":"stdout","time":"2019-12-01T13:55:38.242270049Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating project-member\n","stream":"stdout","time":"2019-12-01T13:55:38.247942071Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating workloads-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.26123271Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating persistentvolumeclaims-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.264540961Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating projectroletemplatebindings-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.271389224Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating clusterroletemplatebindings-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.279890827Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating clusterscans-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.283044511Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating secrets-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.288781467Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating cluster-member\n","stream":"stdout","time":"2019-12-01T13:55:38.292490725Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating backups-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.296002046Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating read-only\n","stream":"stdout","time":"2019-12-01T13:55:38.299628681Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating project-monitoring-readonly\n","stream":"stdout","time":"2019-12-01T13:55:38.30873802Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating admin\n","stream":"stdout","time":"2019-12-01T13:55:38.313696961Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating storage-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.316850986Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating workloads-view\n","stream":"stdout","time":"2019-12-01T13:55:38.327508412Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating projectroletemplatebindings-view\n","stream":"stdout","time":"2019-12-01T13:55:38.336499096Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating projects-view\n","stream":"stdout","time":"2019-12-01T13:55:38.340173573Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating nodes-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.345018131Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating create-ns\n","stream":"stdout","time":"2019-12-01T13:55:38.34969305Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating services-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.358892494Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating edit\n","stream":"stdout","time":"2019-12-01T13:55:38.36279325Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating projects-create\n","stream":"stdout","time":"2019-12-01T13:55:38.368013663Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating clustercatalogs-manage\n","stream":"stdout","time":"2019-12-01T13:55:38.377834793Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating secrets-view\n","stream":"stdout","time":"2019-12-01T13:55:38.380863893Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating configmaps-view\n","stream":"stdout","time":"2019-12-01T13:55:38.385855196Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating serviceaccounts-view\n","stream":"stdout","time":"2019-12-01T13:55:38.391293928Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating projectcatalogs-view\n","stream":"stdout","time":"2019-12-01T13:55:38.394490485Z"}
{"log":"2019/12/01 13:55:38 [INFO] Created default admin user and binding\n","stream":"stdout","time":"2019-12-01T13:55:38.530526629Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating new GlobalRoleBinding for GlobalRoleBinding globalrolebinding-pfxtc\n","stream":"stdout","time":"2019-12-01T13:55:38.538350454Z"}
{"log":"2019/12/01 13:55:38 [INFO] [mgmt-auth-grb-controller] Creating clusterRoleBinding for globalRoleBinding globalrolebinding-pfxtc for user user-4m8g4 with role cattle-globalrole-admin\n","stream":"stdout","time":"2019-12-01T13:55:38.538374054Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver rancherKubernetesEngine\n","stream":"stdout","time":"2019-12-01T13:55:38.629156415Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver googleKubernetesEngine\n","stream":"stdout","time":"2019-12-01T13:55:38.63584446Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver rancherkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.644853086Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver azureKubernetesService\n","stream":"stdout","time":"2019-12-01T13:55:38.647979919Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver googlekubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.65924072Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver amazonElasticContainerService\n","stream":"stdout","time":"2019-12-01T13:55:38.662290441Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver rancherkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.671290056Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver baiducloudcontainerengine\n","stream":"stdout","time":"2019-12-01T13:55:38.672047168Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver rancherkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.687381853Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver azurekubernetesservice\n","stream":"stdout","time":"2019-12-01T13:55:38.68871959Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver aliyunkubernetescontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:38.690726586Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver tencentkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.698247928Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver baiducloudcontainerengine\n","stream":"stdout","time":"2019-12-01T13:55:38.699838466Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver googlekubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.701964086Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver amazonelasticcontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:38.709890955Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver googlekubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.713164855Z"}
{"log":"2019/12/01 13:55:38 [INFO] adding kontainer driver huaweicontainercloudengine\n","stream":"stdout","time":"2019-12-01T13:55:38.714504672Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver azurekubernetesservice\n","stream":"stdout","time":"2019-12-01T13:55:38.725847247Z"}
{"log":"2019/12/01 13:55:38 [INFO] Created cattle-global-nt namespace\n","stream":"stdout","time":"2019-12-01T13:55:38.727609683Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver pinganyunecs\n","stream":"stdout","time":"2019-12-01T13:55:38.727825862Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver amazonelasticcontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:38.732116695Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver aliyunecs\n","stream":"stdout","time":"2019-12-01T13:55:38.744035575Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver azurekubernetesservice\n","stream":"stdout","time":"2019-12-01T13:55:38.747074054Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver aliyunkubernetescontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:38.761363875Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver tencentkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.761927089Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver huaweicontainercloudengine\n","stream":"stdout","time":"2019-12-01T13:55:38.762434871Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver amazonec2\n","stream":"stdout","time":"2019-12-01T13:55:38.763171573Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver amazonelasticcontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:38.768647467Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver baiducloudcontainerengine\n","stream":"stdout","time":"2019-12-01T13:55:38.770202293Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver azure\n","stream":"stdout","time":"2019-12-01T13:55:38.779447377Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver tencentkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.786839763Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver huaweicontainercloudengine\n","stream":"stdout","time":"2019-12-01T13:55:38.794560754Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver cloudca\n","stream":"stdout","time":"2019-12-01T13:55:38.796728436Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver tencentkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:38.81551028Z"}
{"log":"2019/12/01 13:55:38 [INFO] create kontainerdriver aliyunkubernetescontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:38.831308995Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver huaweicontainercloudengine\n","stream":"stdout","time":"2019-12-01T13:55:38.837485288Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver digitalocean\n","stream":"stdout","time":"2019-12-01T13:55:38.841871666Z"}
{"log":"2019/12/01 13:55:38 [INFO] update kontainerdriver aliyunkubernetescontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:38.866707798Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver exoscale\n","stream":"stdout","time":"2019-12-01T13:55:38.883870811Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver linode\n","stream":"stdout","time":"2019-12-01T13:55:38.930025694Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver openstack\n","stream":"stdout","time":"2019-12-01T13:55:38.94887882Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver otc\n","stream":"stdout","time":"2019-12-01T13:55:38.959442491Z"}
{"log":"2019/12/01 13:55:38 [INFO] Creating node driver packet\n","stream":"stdout","time":"2019-12-01T13:55:38.970222692Z"}
{"log":"2019/12/01 13:55:39 [INFO] Creating node driver rackspace\n","stream":"stdout","time":"2019-12-01T13:55:39.010701829Z"}
{"log":"2019/12/01 13:55:39 [INFO] Creating node driver softlayer\n","stream":"stdout","time":"2019-12-01T13:55:39.019821538Z"}
{"log":"2019/12/01 13:55:39 [INFO] Creating node driver vmwarevsphere\n","stream":"stdout","time":"2019-12-01T13:55:39.027342987Z"}
{"log":"2019/12/01 13:55:39 [INFO] Rancher startup complete\n","stream":"stdout","time":"2019-12-01T13:55:39.046621391Z"}
{"log":"2019/12/01 13:55:39 [INFO] update kontainerdriver rancherkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:39.187532218Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading azureConfig to nodeconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.216204536Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading azureConfig to nodetemplateconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.223756057Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading azurecredentialConfig to credentialconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.227204208Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading linodeConfig to nodeconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.230291463Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading linodeConfig to nodetemplateconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.236292096Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading digitaloceanConfig to nodeconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.239026117Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading digitaloceanConfig to nodetemplateconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.242497078Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading amazonec2Config to nodeconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.246207822Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading amazonec2Config to nodetemplateconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.250813163Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading vmwarevsphereConfig to nodeconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.254739755Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading vmwarevsphereConfig to nodetemplateconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.25985524Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading linodecredentialConfig to credentialconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.263205276Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading digitaloceancredentialConfig to credentialconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.265974738Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading amazonec2credentialConfig to credentialconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.272246193Z"}
{"log":"2019/12/01 13:55:39 [INFO] uploading vmwarevspherecredentialConfig to credentialconfig schema\n","stream":"stdout","time":"2019-12-01T13:55:39.279906149Z"}
{"log":"2019/12/01 13:55:39 [INFO] update kontainerdriver tencentkubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:39.315760242Z"}
{"log":"2019/12/01 13:55:39 [INFO] update kontainerdriver huaweicontainercloudengine\n","stream":"stdout","time":"2019-12-01T13:55:39.337659241Z"}
{"log":"2019/12/01 13:55:39 [INFO] update kontainerdriver aliyunkubernetescontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:39.366846511Z"}
{"log":"2019/12/01 13:55:39 [INFO] driverMetadata: refresh data\n","stream":"stdout","time":"2019-12-01T13:55:39.437152833Z"}
{"log":"2019/12/01 13:55:39 [INFO] Updating global catalog system-library\n","stream":"stdout","time":"2019-12-01T13:55:39.729876349Z"}
{"log":"2019/12/01 13:55:39 [INFO] Catalog sync done. 3 templates created, 0 templates updated, 0 templates deleted\n","stream":"stdout","time":"2019-12-01T13:55:39.797679572Z"}
{"log":"2019/12/01 13:55:39 [INFO] driverMetadata initialized successfully\n","stream":"stdout","time":"2019-12-01T13:55:39.98761589Z"}
{"log":"2019/12/01 13:55:40 [INFO] Updating global catalog library\n","stream":"stdout","time":"2019-12-01T13:55:40.497005194Z"}
{"log":"E1201 13:55:40.521256 25 resource_quota_controller.go:437] failed to sync resource monitors: [couldn't start monitor for resource \"project.cattle.io/v3, Resource=sourcecodecredentials\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=sourcecodecredentials\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterloggings\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterloggings\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=pipelineexecutions\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=pipelineexecutions\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=sourcecoderepositories\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=sourcecoderepositories\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=etcdbackups\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=etcdbackups\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusteralerts\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusteralerts\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterregistrationtokens\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterregistrationtokens\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clustercatalogs\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clustercatalogs\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterscans\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterscans\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=pipelinesettings\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=pipelinesettings\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=catalogtemplateversions\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=catalogtemplateversions\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusteralertrules\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusteralertrules\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clustermonitorgraphs\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clustermonitorgraphs\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusteralertgroups\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusteralertgroups\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=apprevisions\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=apprevisions\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=sourcecodeproviderconfigs\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=sourcecodeproviderconfigs\", couldn't start monitor for resource \"extensions/v1beta1, Resource=networkpolicies\": unable to monitor quota for resource \"extensions/v1beta1, Resource=networkpolicies\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=clusterroletemplatebindings\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=clusterroletemplatebindings\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=pipelines\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=pipelines\", couldn't start monitor for resource \"helm.cattle.io/v1, Resource=helmcharts\": unable to monitor quota for resource \"helm.cattle.io/v1, Resource=helmcharts\", couldn't start monitor for resource \"k3s.cattle.io/v1, Resource=listenerconfigs\": unable to monitor quota for resource \"k3s.cattle.io/v1, Resource=listenerconfigs\", couldn't start monitor for resource \"k3s.cattle.io/v1, Resource=addons\": unable to monitor quota for resource \"k3s.cattle.io/v1, Resource=addons\", couldn't start monitor for resource \"management.cattle.io/v3, Resource=catalogtemplates\": unable to monitor quota for resource \"management.cattle.io/v3, Resource=catalogtemplates\", couldn't start monitor for resource \"project.cattle.io/v3, Resource=apps\": unable to monitor quota for resource \"project.cattle.io/v3, Resource=apps\"]\n","stream":"stderr","time":"2019-12-01T13:55:40.521386438Z"}
{"log":"2019/12/01 13:55:41 [INFO] Updating global catalog system-library\n","stream":"stdout","time":"2019-12-01T13:55:41.184729255Z"}
{"log":"2019/12/01 13:55:41 [INFO] Catalog sync done. 2 templates created, 3 templates updated, 0 templates deleted\n","stream":"stdout","time":"2019-12-01T13:55:41.465954311Z"}
{"log":"2019/12/01 13:55:42 [INFO] Catalog sync done. 41 templates created, 0 templates updated, 0 templates deleted\n","stream":"stdout","time":"2019-12-01T13:55:42.078908417Z"}
{"log":"2019/12/01 13:55:42 [ERROR] CatalogController library [catalog] failed with : failed to sync templates. Resetting commit. Multiple error occurred: [yaml: line 4: did not find expected key]\n","stream":"stdout","time":"2019-12-01T13:55:42.089318054Z"}
{"log":"2019/12/01 13:55:42 [INFO] Updating global catalog library\n","stream":"stdout","time":"2019-12-01T13:55:42.748086784Z"}
{"log":"2019/12/01 13:55:42 [INFO] Catalog sync done. 0 templates created, 0 templates updated, 0 templates deleted\n","stream":"stdout","time":"2019-12-01T13:55:42.799676106Z"}
{"log":"2019/12/01 13:55:43 [INFO] kontainerdriver googlekubernetesengine listening on address 127.0.0.1:37889\n","stream":"stdout","time":"2019-12-01T13:55:43.718517036Z"}
{"log":"2019/12/01 13:55:43 [INFO] kontainerdriver googlekubernetesengine stopped\n","stream":"stdout","time":"2019-12-01T13:55:43.720445258Z"}
{"log":"2019/12/01 13:55:43 [INFO] update kontainerdriver googlekubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:43.737606924Z"}
{"log":"2019/12/01 13:55:43 [INFO] kontainerdriver azurekubernetesservice listening on address 127.0.0.1:46410\n","stream":"stdout","time":"2019-12-01T13:55:43.768070376Z"}
{"log":"2019/12/01 13:55:43 [INFO] kontainerdriver azurekubernetesservice stopped\n","stream":"stdout","time":"2019-12-01T13:55:43.769438171Z"}
{"log":"2019/12/01 13:55:43 [INFO] kontainerdriver amazonelasticcontainerservice listening on address 127.0.0.1:36724\n","stream":"stdout","time":"2019-12-01T13:55:43.778056341Z"}
{"log":"2019/12/01 13:55:43 [INFO] kontainerdriver amazonelasticcontainerservice stopped\n","stream":"stdout","time":"2019-12-01T13:55:43.783657697Z"}
{"log":"2019/12/01 13:55:43 [INFO] update kontainerdriver azurekubernetesservice\n","stream":"stdout","time":"2019-12-01T13:55:43.788032306Z"}
{"log":"2019/12/01 13:55:43 [INFO] update kontainerdriver amazonelasticcontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:43.798058724Z"}
{"log":"2019/12/01 13:55:48 [INFO] kontainerdriver googlekubernetesengine listening on address 127.0.0.1:39043\n","stream":"stdout","time":"2019-12-01T13:55:48.739490175Z"}
{"log":"2019/12/01 13:55:48 [INFO] kontainerdriver googlekubernetesengine stopped\n","stream":"stdout","time":"2019-12-01T13:55:48.740926569Z"}
{"log":"2019/12/01 13:55:48 [INFO] dynamic schema for kontainerdriver googlekubernetesengine updating\n","stream":"stdout","time":"2019-12-01T13:55:48.741035995Z"}
{"log":"2019/12/01 13:55:48 [INFO] update kontainerdriver googlekubernetesengine\n","stream":"stdout","time":"2019-12-01T13:55:48.751560854Z"}
{"log":"2019/12/01 13:55:48 [INFO] kontainerdriver azurekubernetesservice listening on address 127.0.0.1:40368\n","stream":"stdout","time":"2019-12-01T13:55:48.793034345Z"}
{"log":"2019/12/01 13:55:48 [INFO] kontainerdriver azurekubernetesservice stopped\n","stream":"stdout","time":"2019-12-01T13:55:48.794480189Z"}
{"log":"2019/12/01 13:55:48 [INFO] dynamic schema for kontainerdriver azurekubernetesservice updating\n","stream":"stdout","time":"2019-12-01T13:55:48.794649618Z"}
{"log":"2019/12/01 13:55:48 [INFO] kontainerdriver amazonelasticcontainerservice listening on address 127.0.0.1:46768\n","stream":"stdout","time":"2019-12-01T13:55:48.80015398Z"}
{"log":"2019/12/01 13:55:48 [INFO] update kontainerdriver azurekubernetesservice\n","stream":"stdout","time":"2019-12-01T13:55:48.804331003Z"}
{"log":"2019/12/01 13:55:48 [INFO] kontainerdriver amazonelasticcontainerservice stopped\n","stream":"stdout","time":"2019-12-01T13:55:48.806119716Z"}
{"log":"2019/12/01 13:55:48 [INFO] dynamic schema for kontainerdriver amazonelasticcontainerservice updating\n","stream":"stdout","time":"2019-12-01T13:55:48.806266232Z"}
{"log":"2019/12/01 13:55:48 [INFO] update kontainerdriver amazonelasticcontainerservice\n","stream":"stdout","time":"2019-12-01T13:55:48.814635461Z"}
{"log":"2019/12/01 13:55:49 [INFO] Creating token for user user-4m8g4\n","stream":"stdout","time":"2019-12-01T13:55:49.047219303Z"}
{"log":"time=\"2019-12-01 13:55:49\" level=info msg=\"Telemetry Client v0.5.10\"\n","stream":"stderr","time":"2019-12-01T13:55:49.053283077Z"}
{"log":"time=\"2019-12-01 13:55:49\" level=info msg=\"Listening on 0.0.0.0:8114\"\n","stream":"stderr","time":"2019-12-01T13:55:49.053546591Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-cluster-rbac-delete] Creating namespace c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.397189593Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-cluster-rbac-delete] Creating Default project for cluster c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.400607506Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Creating namespace p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.405463504Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-cluster-rbac-delete] Creating System project for cluster c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.407515603Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Creating namespace p-9qspd\n","stream":"stdout","time":"2019-12-01T13:55:52.412048865Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-cluster-rbac-delete] Updating cluster c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.413545135Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Creating creator projectRoleTemplateBinding for user user-4m8g4 for project p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.416540864Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Creating creator projectRoleTemplateBinding for user user-4m8g4 for project p-9qspd\n","stream":"stdout","time":"2019-12-01T13:55:52.418143849Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Creating creator clusterRoleTemplateBinding for user user-4m8g4 for cluster c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.42528891Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Setting InitialRolesPopulated condition on project p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.428525173Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating clusterRole p-clc98-projectowner\n","stream":"stdout","time":"2019-12-01T13:55:52.43411329Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating clusterRole c-68x4j-clusterowner\n","stream":"stdout","time":"2019-12-01T13:55:52.437760105Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating roleBinding for membership in project p-clc98 for subject user-4m8g4\n","stream":"stdout","time":"2019-12-01T13:55:52.440057017Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Updating project p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.441366597Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Setting InitialRolesPopulated condition on cluster \n","stream":"stdout","time":"2019-12-01T13:55:52.444571788Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-cluster-rbac-delete] Updating cluster c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.445115267Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating clusterRole c-68x4j-clustermember\n","stream":"stdout","time":"2019-12-01T13:55:52.450189927Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating clusterRoleBinding for membership in cluster c-68x4j for subject user-4m8g4\n","stream":"stdout","time":"2019-12-01T13:55:52.452665439Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating clusterRoleBinding for membership in cluster c-68x4j for subject user-4m8g4\n","stream":"stdout","time":"2019-12-01T13:55:52.457602101Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Updating project p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.458310109Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating role cluster-owner in namespace c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.461723402Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating roleBinding for subject user-4m8g4 with role cluster-owner in namespace \n","stream":"stdout","time":"2019-12-01T13:55:52.468149834Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating role cluster-owner in namespace p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.472648314Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating roleBinding for subject user-4m8g4 with role cluster-owner in namespace \n","stream":"stdout","time":"2019-12-01T13:55:52.478247272Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating role project-owner in namespace c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.479951383Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-cluster-rbac-delete] Updating cluster c-68x4j\n","stream":"stdout","time":"2019-12-01T13:55:52.483935984Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Setting InitialRolesPopulated condition on project p-9qspd\n","stream":"stdout","time":"2019-12-01T13:55:52.488742851Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating roleBinding for subject user-4m8g4 with role project-owner in namespace \n","stream":"stdout","time":"2019-12-01T13:55:52.491526239Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Updating project p-9qspd\n","stream":"stdout","time":"2019-12-01T13:55:52.495264048Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating role project-owner in namespace p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.500707368Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating clusterRole p-9qspd-projectowner\n","stream":"stdout","time":"2019-12-01T13:55:52.514520394Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating role cluster-owner in namespace p-9qspd\n","stream":"stdout","time":"2019-12-01T13:55:52.520306182Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-project-rbac-create] Updating project p-9qspd\n","stream":"stdout","time":"2019-12-01T13:55:52.543310468Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating role admin in namespace p-clc98\n","stream":"stdout","time":"2019-12-01T13:55:52.556109251Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-crtb-controller] Creating roleBinding for subject user-4m8g4 with role cluster-owner in namespace \n","stream":"stdout","time":"2019-12-01T13:55:52.573383081Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating roleBinding for membership in project p-9qspd for subject user-4m8g4\n","stream":"stdout","time":"2019-12-01T13:55:52.573963191Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Updating clusterRoleBinding clusterrolebinding-lczvf for cluster membership in cluster c-68x4j for subject user-4m8g4\n","stream":"stdout","time":"2019-12-01T13:55:52.609126095Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating roleBinding for subject user-4m8g4 with role project-owner in namespace \n","stream":"stdout","time":"2019-12-01T13:55:52.614732503Z"}
{"log":"2019/12/01 13:55:52 [INFO] [mgmt-auth-prtb-controller] Creating roleBinding for subject user-4m8g4 with role project-owner in namespace \n","stream":"stdout","time":"2019-12-01T13:55:52.625953191Z"}
{"log":"2019/12/0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment