Skip to content

Instantly share code, notes, and snippets.

@MichaelSp

MichaelSp/console.log

Created September 9, 2019 19:07
Show Gist options
  • Save MichaelSp/976bc36ca3d3bddc522ee5908ad4e7ed to your computer and use it in GitHub Desktop.
Save MichaelSp/976bc36ca3d3bddc522ee5908ad4e7ed to your computer and use it in GitHub Desktop.
Download ZIP
ingress nginx log
Raw
console.log
-------------------------------------------------------------------------------
NGINX Ingress controller
Release: 0.25.1
Build: git-5179893a9
Repository: https://github.com/kubernetes/ingress-nginx/
nginx version: openresty/1.15.8.1
-------------------------------------------------------------------------------
I0909 18:52:02.759828 8 flags.go:192] Watching for Ingress class: nginx
W0909 18:52:02.761334 8 flags.go:221] SSL certificate chain completion is disabled (--enable-ssl-chain-completion=false)
nginx version: openresty/1.15.8.1
built by gcc 8.3.0 (Debian 8.3.0-6)
built with OpenSSL 1.1.1c 28 May 2019
TLS SNI support enabled
configure arguments: --prefix=/usr/local/openresty/nginx --with-debug --with-cc-opt='-DNGX_LUA_USE_ASSERT -DNGX_LUA_ABORT_AT_PANIC -O2 -g -Og -fPIE -fstack-protector-strong -Wformat -Werror=format-security -Wno-deprecated-declarations -fno-strict-aliasing -D_FORTIFY_SOURCE=2 --param=ssp-buffer-size=4 -DTCP_FASTOPEN=23 -fPIC -Wno-cast-function-type -I/root/.hunter/_Base/2c5c6fc/fdb8df4/92161a9/Install/include -m64 -mtune=native' --add-module=../ngx_devel_kit-0.3.1rc1 --add-module=../echo-nginx-module-0.61 --add-module=../xss-nginx-module-0.06 --add-module=../ngx_coolkit-0.2 --add-module=../set-misc-nginx-module-0.32 --add-module=../form-input-nginx-module-0.12 --add-module=../encrypted-session-nginx-module-0.08 --add-module=../srcache-nginx-module-0.31 --add-module=../ngx_lua-0.10.15 --add-module=../ngx_lua_upstream-0.07 --add-module=../headers-more-nginx-module-0.33 --add-module=../array-var-nginx-module-0.05 --add-module=../memc-nginx-module-0.19 --add-module=../redis2-nginx-module-0.15 --add-module=../redis-nginx-module-0.3.7 --add-module=../rds-json-nginx-module-0.15 --add-module=../rds-csv-nginx-module-0.09 --add-module=../ngx_stream_lua-0.0.7 --with-ld-opt='-Wl,-rpath,/usr/local/openresty/luajit/lib -fPIE -fPIC -pie -Wl,-z,relro -Wl,-z,now -L/root/.hunter/_Base/2c5c6fc/fdb8df4/92161a9/Install/lib' --with-compat --with-pcre-jit --with-http_ssl_module --with-http_stub_status_module --with-http_realip_module --with-http_auth_request_module --with-http_addition_module --with-http_dav_module --with-http_geoip_module --with-http_gzip_static_module --with-http_sub_module --with-http_v2_module --with-stream --with-stream_ssl_module --with-stream_ssl_preread_module --with-threads --with-http_secure_link_module --with-http_gunzip_module --with-md5-asm --with-sha1-asm --with-file-aio --without-mail_pop3_module --without-mail_smtp_module --without-mail_imap_module --without-http_uwsgi_module --without-http_scgi_module --user=www-data --group=www-data --add-module=/tmp/build/nginx-http-auth-digest-cd8641886c873cf543255aeda20d23e4cd603d05 --add-module=/tmp/build/ngx_http_substitutions_filter_module-bc58cb11844bc42735bbaef7085ea86ace46d05b --add-module=/tmp/build/nginx-influxdb-module-5b09391cb7b9a889687c0aa67964c06a2d933e8b --add-dynamic-module=/tmp/build/nginx-opentracing-0.8.0/opentracing --add-dynamic-module=/tmp/build/ModSecurity-nginx-d7101e13685efd7e7c9f808871b202656a969f4b --add-dynamic-module=/tmp/build/ngx_http_geoip2_module-3.2 --add-module=/tmp/build/nginx_ajp_module-bf6cd93f2098b59260de8d494f0f4b1f11a84627 --add-module=/tmp/build/ngx_brotli --with-stream --with-stream_ssl_preread_module
W0909 18:52:02.764167 8 client_config.go:541] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
I0909 18:52:02.764362 8 main.go:183] Creating API client for https://198.18.128.1:443
I0909 18:52:02.765127 8 main.go:203] Trying to discover Kubernetes version
I0909 18:52:02.778154 8 main.go:227] Running in Kubernetes cluster version v1.15 (v1.15.2) - git (clean) commit f6278300bebbb750328ac16ee6dd3aa7d3549568 - platform linux/amd64
I0909 18:52:02.783838 8 main.go:91] Validated default/something as the default backend.
I0909 18:52:03.134568 8 ssl.go:119] parsing ssl certificate extensions
I0909 18:52:03.135002 8 main.go:102] Created fake certificate with PemFileName: /etc/ingress-controller/ssl/default-fake-certificate.pem
I0909 18:52:03.142324 8 dns.go:56] nameservers IP address/es to use: [198.18.128.2]
I0909 18:52:03.163490 8 nginx.go:274] Starting NGINX Ingress controller
I0909 18:52:03.163664 8 reflector.go:122] Starting reflector *v1.Endpoints (0s) from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155
I0909 18:52:03.163683 8 reflector.go:160] Listing and watching *v1.Endpoints from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155
I0909 18:52:03.164017 8 reflector.go:122] Starting reflector *v1.ConfigMap (0s) from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:158
I0909 18:52:03.164035 8 reflector.go:160] Listing and watching *v1.ConfigMap from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:158
I0909 18:52:03.164142 8 reflector.go:122] Starting reflector *v1.Service (0s) from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:156
I0909 18:52:03.164160 8 reflector.go:160] Listing and watching *v1.Service from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:156
I0909 18:52:03.164036 8 reflector.go:122] Starting reflector *v1.Secret (0s) from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:157
I0909 18:52:03.164199 8 reflector.go:160] Listing and watching *v1.Secret from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:157
I0909 18:52:03.164098 8 reflector.go:122] Starting reflector *v1.Pod (0s) from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:159
I0909 18:52:03.164213 8 reflector.go:160] Listing and watching *v1.Pod from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:159
I0909 18:52:03.195103 8 event.go:258] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"kube-system", Name:"nginx-ingress-config-map", UID:"628bedcf-5cef-4ca3-b328-23c683bfba13", APIVersion:"v1", ResourceVersion:"80836", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap kube-system/nginx-ingress-config-map
I0909 18:52:03.203375 8 backend_ssl.go:40] Syncing Secret "kube-system/default-ssl-cert"
I0909 18:52:03.203761 8 ssl.go:119] parsing ssl certificate extensions
I0909 18:52:03.204631 8 backend_ssl.go:122] Configuring Secret "kube-system/default-ssl-cert" for TLS encryption (CN: [<redacted>]) and authentication
I0909 18:52:03.204646 8 backend_ssl.go:66] Adding Secret "kube-system/default-ssl-cert" to the local store
I0909 18:52:04.263980 8 reflector.go:122] Starting reflector *v1beta1.Ingress (0s) from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:179
I0909 18:52:04.264015 8 reflector.go:160] Listing and watching *v1beta1.Ingress from k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:179
I0909 18:52:04.269666 8 backend_ssl.go:40] Syncing Secret "kube-system/default-ssl-cert"
I0909 18:52:04.269969 8 ssl.go:119] parsing ssl certificate extensions
I0909 18:52:04.270990 8 backend_ssl.go:122] Configuring Secret "kube-system/default-ssl-cert" for TLS encryption (CN: [<redacted>]) and authentication
I0909 18:52:04.271017 8 main.go:48] annotation kubernetes.io/ingress.class is not present in ingress default/my-product
I0909 18:52:04.271034 8 store.go:633] updating annotations information for ingress default/my-product
I0909 18:52:04.271046 8 main.go:143] No default affinity was found for Ingress my-product
I0909 18:52:04.271057 8 backend_ssl.go:40] Syncing Secret "kube-system/sso-ca"
I0909 18:52:04.271110 8 event.go:258] Event(v1.ObjectReference{Kind:"Ingress", Namespace:"default", Name:"my-product", UID:"c4088e8f-b1f3-4129-af7e-3b023121dd71", APIVersion:"networking.k8s.io/v1beta1", ResourceVersion:"87647", FieldPath:""}): type: 'Normal' reason: 'CREATE' Ingress default/my-product
I0909 18:52:04.271242 8 ssl.go:250] Created CA Certificate for Authentication: /etc/ingress-controller/ssl/ca-kube-system-sso-ca.pem
I0909 18:52:04.271259 8 backend_ssl.go:137] Configuring Secret "kube-system/sso-ca" for TLS authentication
I0909 18:52:04.271266 8 backend_ssl.go:66] Adding Secret "kube-system/sso-ca" to the local store
I0909 18:52:04.271407 8 store.go:665] updating references to secrets for ingress default/my-product
I0909 18:52:04.271421 8 backend_ssl.go:40] Syncing Secret "kube-system/sso-ca"
I0909 18:52:04.271587 8 ssl.go:250] Created CA Certificate for Authentication: /etc/ingress-controller/ssl/ca-kube-system-sso-ca.pem
I0909 18:52:04.271599 8 backend_ssl.go:137] Configuring Secret "kube-system/sso-ca" for TLS authentication
I0909 18:52:04.364076 8 nginx.go:318] Starting NGINX process
I0909 18:52:04.364222 8 leaderelection.go:235] attempting to acquire leader lease kube-system/ingress-controller-leader-nginx...
I0909 18:52:04.364524 8 queue.go:87] queuing item &ObjectMeta{Name:initial-sync,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],}
I0909 18:52:04.364677 8 queue.go:128] syncing initial-sync
I0909 18:52:04.364592 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:postgresql,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/postgresql,UID:873c22e8-0ce7-4557-87ab-8742009be4e4,ResourceVersion:1660,Generation:0,CreationTimestamp:2019-09-09 09:54:32 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: postgresql,chart: postgresql-6.3.4,heritage: Tiller,release: postgresql,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:00:57Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.9 0xc0003bb3b0 ObjectReference{Kind:Pod,Namespace:management,Name:postgresql-postgresql-0,UID:7b3f85cb-2861-48f3-bab4-4fb14f18f6e6,APIVersion:,ResourceVersion:1659,FieldPath:,}}] [] [{postgresql 5432 TCP}]}],}
I0909 18:52:04.364732 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:postgresql,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/postgresql,UID:873c22e8-0ce7-4557-87ab-8742009be4e4,ResourceVersion:1660,Generation:0,CreationTimestamp:2019-09-09 09:54:32 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: postgresql,chart: postgresql-6.3.4,heritage: Tiller,release: postgresql,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:00:57Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.9 0xc0003bb3b0 ObjectReference{Kind:Pod,Namespace:management,Name:postgresql-postgresql-0,UID:7b3f85cb-2861-48f3-bab4-4fb14f18f6e6,APIVersion:,ResourceVersion:1659,FieldPath:,}}] [] [{postgresql 5432 TCP}]}],}
I0909 18:52:04.364849 8 controller.go:740] Creating upstream "default-my-product-30003"
I0909 18:52:04.364856 8 controller.go:845] Obtaining ports information for Service "default/my-product"
I0909 18:52:04.364866 8 endpoints.go:93] Getting Endpoints for Service "default/my-product" and port &ServicePort{Name:default-code-prod,Protocol:TCP,Port:30003,TargetPort:30003,NodePort:0,}
I0909 18:52:04.364777 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:redis-slave,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/redis-slave,UID:38dc1a66-e882-4cc6-805b-6cf5dc359e26,ResourceVersion:2387,Generation:0,CreationTimestamp:2019-09-09 09:54:36 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: redis,chart: redis-9.1.7,heritage: Tiller,release: redis,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:24Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.10 0xc0003bb470 ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-0,UID:71f4bbac-f211-4f6f-be35-595f10b5b650,APIVersion:,ResourceVersion:2344,FieldPath:,}} {100.101.1.19 0xc0003bb480 &ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-1,UID:b0d7ceae-0261-4d2b-95b2-85a90a8d3bc3,APIVersion:,ResourceVersion:2385,FieldPath:,}}] [] [{redis 6379 TCP}]}],}
I0909 18:52:04.364900 8 endpoints.go:136] Endpoints found for Service "default/my-product": [{10.96.131.102 30003 nil} {10.96.189.52 30003 nil} {10.96.5.23 30003 nil} {10.96.5.232 30003 nil} {10.96.5.233 30003 nil} {10.96.5.24 30003 nil} {10.96.5.25 30003 nil} {10.96.5.26 30003 nil} {10.96.5.27 30003 nil} {10.96.5.32 30003 nil} {10.96.5.40 30003 nil} {10.96.5.41 30003 nil} {10.96.5.42 30003 nil} {10.98.20.59 30003 nil} {10.98.20.60 30003 nil}]
I0909 18:52:04.364899 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:redis-slave,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/redis-slave,UID:38dc1a66-e882-4cc6-805b-6cf5dc359e26,ResourceVersion:2387,Generation:0,CreationTimestamp:2019-09-09 09:54:36 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: redis,chart: redis-9.1.7,heritage: Tiller,release: redis,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:24Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.10 0xc0003bb470 ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-0,UID:71f4bbac-f211-4f6f-be35-595f10b5b650,APIVersion:,ResourceVersion:2344,FieldPath:,}} {100.101.1.19 0xc0003bb480 &ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-1,UID:b0d7ceae-0261-4d2b-95b2-85a90a8d3bc3,APIVersion:,ResourceVersion:2385,FieldPath:,}}] [] [{redis 6379 TCP}]}],}
I0909 18:52:04.364940 8 controller.go:1094] Host "product.internal.domain" is listed in the TLS section but secretName is empty. Using default certificate.
I0909 18:52:04.364955 8 controller.go:515] Replacing location "/" for server "product.internal.domain" with upstream "upstream-default-backend" to use upstream "default-my-product-30003" (Ingress "default/my-product")
I0909 18:52:04.364939 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kibana-kibana,GenerateName:,Namespace:logging,SelfLink:/api/v1/namespaces/logging/endpoints/kibana-kibana,UID:e5e48b79-4d28-4154-9831-b35ceabe2273,ResourceVersion:1808,Generation:0,CreationTimestamp:2019-09-09 09:58:19 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: kibana,heritage: Tiller,release: kibana,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:01:55Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.2.3 0xc0003bb530 ObjectReference{Kind:Pod,Namespace:logging,Name:kibana-kibana-578f8ccf8d-bv2v5,UID:91ed0c12-6682-4dac-a620-e0f93756b2d3,APIVersion:,ResourceVersion:1806,FieldPath:,}}] [] [{http 5601 TCP}]}],}
I0909 18:52:04.364975 8 controller.go:133] Configuration changes detected, backend reload required.
I0909 18:52:04.364966 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kibana-kibana,GenerateName:,Namespace:logging,SelfLink:/api/v1/namespaces/logging/endpoints/kibana-kibana,UID:e5e48b79-4d28-4154-9831-b35ceabe2273,ResourceVersion:1808,Generation:0,CreationTimestamp:2019-09-09 09:58:19 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: kibana,heritage: Tiller,release: kibana,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:01:55Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.2.3 0xc0003bb530 ObjectReference{Kind:Pod,Namespace:logging,Name:kibana-kibana-578f8ccf8d-bv2v5,UID:91ed0c12-6682-4dac-a620-e0f93756b2d3,APIVersion:,ResourceVersion:1806,FieldPath:,}}] [] [{http 5601 TCP}]}],}
I0909 18:52:04.364993 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-metrics,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller-metrics,UID:d13bea76-17e1-44be-a7c2-8607bdd92271,ResourceVersion:87642,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[],}
I0909 18:52:04.365014 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-metrics,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller-metrics,UID:d13bea76-17e1-44be-a7c2-8607bdd92271,ResourceVersion:87642,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[],}
I0909 18:52:04.365042 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kubelet,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/kubelet,UID:3f503aa1-a7e4-4f6f-a32b-30e134f9985f,ResourceVersion:5863,Generation:0,CreationTimestamp:2019-09-09 10:25:34 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{k8s-app: kubelet,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{10.180.100.17 <nil> ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-cs2wq,UID:47313188-7b1a-4664-92c5-2c626e1ed4f2,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.20 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-7dwr2,UID:ac2d1eb6-83c2-4fde-9756-b7a9075104f9,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.28 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-f7md4,UID:5e745a94-1de7-4c7d-b4c7-9d276a922015,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.35 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-9v29w,UID:4b1ce762-df86-4bc5-a906-f77848ae4eb0,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.40 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-nnf6h,UID:13215e1c-b5ba-4c3b-af22-4e6007d6e0da,APIVersion:,ResourceVersion:,FieldPath:,}}] [] [{http-metrics 10255 TCP} {cadvisor 4194 TCP} {https-metrics 10250 TCP}]}],}
I0909 18:52:04.365087 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kubelet,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/kubelet,UID:3f503aa1-a7e4-4f6f-a32b-30e134f9985f,ResourceVersion:5863,Generation:0,CreationTimestamp:2019-09-09 10:25:34 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{k8s-app: kubelet,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{10.180.100.17 <nil> ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-cs2wq,UID:47313188-7b1a-4664-92c5-2c626e1ed4f2,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.20 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-7dwr2,UID:ac2d1eb6-83c2-4fde-9756-b7a9075104f9,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.28 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-f7md4,UID:5e745a94-1de7-4c7d-b4c7-9d276a922015,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.35 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-9v29w,UID:4b1ce762-df86-4bc5-a906-f77848ae4eb0,APIVersion:,ResourceVersion:,FieldPath:,}} {10.180.100.40 <nil> &ObjectReference{Kind:Node,Namespace:,Name:cc-stage-stage-nnf6h,UID:13215e1c-b5ba-4c3b-af22-4e6007d6e0da,APIVersion:,ResourceVersion:,FieldPath:,}}] [] [{http-metrics 10255 TCP} {cadvisor 4194 TCP} {https-metrics 10250 TCP}]}],}
I0909 18:52:04.365137 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kube-dns,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/kube-dns,UID:6cc4c0a7-d2a5-4aeb-adad-28b6747f75c0,ResourceVersion:2228,Generation:0,CreationTimestamp:2019-09-09 09:43:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,k8s-app: kube-dns,kubernetes.io/cluster-service: true,kubernetes.io/name: CoreDNS,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:23Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.3 0xc0003bb720 ObjectReference{Kind:Pod,Namespace:kube-system,Name:coredns-76d66b76f7-krrcm,UID:480db1a6-e819-4af6-afba-951999168d43,APIVersion:,ResourceVersion:470,FieldPath:,}} {100.101.1.11 0xc0003bb730 &ObjectReference{Kind:Pod,Namespace:kube-system,Name:coredns-76d66b76f7-fl47w,UID:1beb9f7b-8eee-479d-941d-4422becab80d,APIVersion:,ResourceVersion:2226,FieldPath:,}}] [] [{dns 53 UDP} {dns-tcp 53 TCP} {metrics 9153 TCP}]}],}
I0909 18:52:04.365168 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kube-dns,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/kube-dns,UID:6cc4c0a7-d2a5-4aeb-adad-28b6747f75c0,ResourceVersion:2228,Generation:0,CreationTimestamp:2019-09-09 09:43:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,k8s-app: kube-dns,kubernetes.io/cluster-service: true,kubernetes.io/name: CoreDNS,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:23Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.3 0xc0003bb720 ObjectReference{Kind:Pod,Namespace:kube-system,Name:coredns-76d66b76f7-krrcm,UID:480db1a6-e819-4af6-afba-951999168d43,APIVersion:,ResourceVersion:470,FieldPath:,}} {100.101.1.11 0xc0003bb730 &ObjectReference{Kind:Pod,Namespace:kube-system,Name:coredns-76d66b76f7-fl47w,UID:1beb9f7b-8eee-479d-941d-4422becab80d,APIVersion:,ResourceVersion:2226,FieldPath:,}}] [] [{dns 53 UDP} {dns-tcp 53 TCP} {metrics 9153 TCP}]}],}
I0909 18:52:04.365201 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:influx-influxdb,GenerateName:,Namespace:monitoring,SelfLink:/api/v1/namespaces/monitoring/endpoints/influx-influxdb,UID:89ae190e-deaa-499a-990d-2ba1eca1aa83,ResourceVersion:2329,Generation:0,CreationTimestamp:2019-09-09 09:54:50 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: influx-influxdb,chart: influxdb-1.3.4,heritage: Tiller,release: influx,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:45Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.1.18 0xc0003bb800 ObjectReference{Kind:Pod,Namespace:monitoring,Name:influx-influxdb-cdc99c6bc-l9h4s,UID:48918505-2b4e-4230-85f6-b295930ba774,APIVersion:,ResourceVersion:2327,FieldPath:,}}] [] [{api 8086 TCP} {rpc 8088 TCP}]}],}
I0909 18:52:04.365227 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:influx-influxdb,GenerateName:,Namespace:monitoring,SelfLink:/api/v1/namespaces/monitoring/endpoints/influx-influxdb,UID:89ae190e-deaa-499a-990d-2ba1eca1aa83,ResourceVersion:2329,Generation:0,CreationTimestamp:2019-09-09 09:54:50 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: influx-influxdb,chart: influxdb-1.3.4,heritage: Tiller,release: influx,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:45Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.1.18 0xc0003bb800 ObjectReference{Kind:Pod,Namespace:monitoring,Name:influx-influxdb-cdc99c6bc-l9h4s,UID:48918505-2b4e-4230-85f6-b295930ba774,APIVersion:,ResourceVersion:2327,FieldPath:,}}] [] [{api 8086 TCP} {rpc 8088 TCP}]}],}
I0909 18:52:04.365257 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kubernetes,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/endpoints/kubernetes,UID:c277e549-e3ac-434f-9f80-dbb95e9b9058,ResourceVersion:146,Generation:0,CreationTimestamp:2019-09-09 09:42:28 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{1.1.1.1 <nil> nil}] [] [{https 6443 TCP}]}],}
I0909 18:52:04.365285 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kubernetes,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/endpoints/kubernetes,UID:c277e549-e3ac-434f-9f80-dbb95e9b9058,ResourceVersion:146,Generation:0,CreationTimestamp:2019-09-09 09:42:28 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{1.1.1.1 <nil> nil}] [] [{https 6443 TCP}]}],}
I0909 18:52:04.365313 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller,UID:88972a13-bd36-4842-baa9-6e738923d5af,ResourceVersion:87643,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[],}
I0909 18:52:04.365577 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller,UID:88972a13-bd36-4842-baa9-6e738923d5af,ResourceVersion:87643,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[],}
I0909 18:52:04.365616 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:redis-headless,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/redis-headless,UID:6ac68a97-716c-4c68-b185-0ad4ea164cce,ResourceVersion:2386,Generation:0,CreationTimestamp:2019-09-09 09:54:36 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: redis,chart: redis-9.1.7,heritage: Tiller,release: redis,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:24Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.10 redis-slave-0 0xc0003bb9c0 ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-0,UID:71f4bbac-f211-4f6f-be35-595f10b5b650,APIVersion:,ResourceVersion:2344,FieldPath:,}} {100.101.1.16 redis-master-0 0xc0003bb9d0 &ObjectReference{Kind:Pod,Namespace:management,Name:redis-master-0,UID:40457de9-aad4-4310-a3bb-e716155cd39f,APIVersion:,ResourceVersion:2279,FieldPath:,}} {100.101.1.19 redis-slave-1 0xc0003bb9e0 &ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-1,UID:b0d7ceae-0261-4d2b-95b2-85a90a8d3bc3,APIVersion:,ResourceVersion:2385,FieldPath:,}}] [] [{redis 6379 TCP}]}],}
I0909 18:52:04.365666 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:redis-headless,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/redis-headless,UID:6ac68a97-716c-4c68-b185-0ad4ea164cce,ResourceVersion:2386,Generation:0,CreationTimestamp:2019-09-09 09:54:36 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: redis,chart: redis-9.1.7,heritage: Tiller,release: redis,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:24Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.10 redis-slave-0 0xc0003bb9c0 ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-0,UID:71f4bbac-f211-4f6f-be35-595f10b5b650,APIVersion:,ResourceVersion:2344,FieldPath:,}} {100.101.1.16 redis-master-0 0xc0003bb9d0 &ObjectReference{Kind:Pod,Namespace:management,Name:redis-master-0,UID:40457de9-aad4-4310-a3bb-e716155cd39f,APIVersion:,ResourceVersion:2279,FieldPath:,}} {100.101.1.19 redis-slave-1 0xc0003bb9e0 &ObjectReference{Kind:Pod,Namespace:management,Name:redis-slave-1,UID:b0d7ceae-0261-4d2b-95b2-85a90a8d3bc3,APIVersion:,ResourceVersion:2385,FieldPath:,}}] [] [{redis 6379 TCP}]}],}
I0909 18:52:04.365744 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:tiller-deploy,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/tiller-deploy,UID:50e93a88-c151-4875-8a3e-3e807f27eee0,ResourceVersion:25714,Generation:0,CreationTimestamp:2019-09-09 12:14:01 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: helm,kyma-project.io/installation: ,name: tiller,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T12:14:14Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.3.47 0xc0003bba80 ObjectReference{Kind:Pod,Namespace:kube-system,Name:tiller-deploy-6b9c5b769f-lfswd,UID:82e929af-5a52-476a-a2bc-52451714dbcc,APIVersion:,ResourceVersion:25713,FieldPath:,}}] [] [{tiller 44134 TCP}]}],}
I0909 18:52:04.365776 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:tiller-deploy,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/tiller-deploy,UID:50e93a88-c151-4875-8a3e-3e807f27eee0,ResourceVersion:25714,Generation:0,CreationTimestamp:2019-09-09 12:14:01 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: helm,kyma-project.io/installation: ,name: tiller,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T12:14:14Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.3.47 0xc0003bba80 ObjectReference{Kind:Pod,Namespace:kube-system,Name:tiller-deploy-6b9c5b769f-lfswd,UID:82e929af-5a52-476a-a2bc-52451714dbcc,APIVersion:,ResourceVersion:25713,FieldPath:,}}] [] [{tiller 44134 TCP}]}],}
I0909 18:52:04.366521 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:elasticsearch-master-headless,GenerateName:,Namespace:logging,SelfLink:/api/v1/namespaces/logging/endpoints/elasticsearch-master-headless,UID:7495a105-ce87-44a1-9923-1bc93452dd55,ResourceVersion:2365,Generation:0,CreationTimestamp:2019-09-09 09:58:17 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: elasticsearch-master,chart: elasticsearch-7.3.0,heritage: Tiller,release: elasticsearch,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:09Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.12 elasticsearch-master-2 0xc0003bbb40 ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-2,UID:ad89dec2-81eb-402d-9968-fd6200c6b08b,APIVersion:,ResourceVersion:1759,FieldPath:,}} {100.101.1.15 elasticsearch-master-1 0xc0003bbb50 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-1,UID:28515245-4060-4c4c-8bdd-cf551ade1305,APIVersion:,ResourceVersion:2362,FieldPath:,}} {100.101.2.5 elasticsearch-master-0 0xc0003bbb60 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-0,UID:ef7d0b10-ec17-4e87-8f4a-b50497c19045,APIVersion:,ResourceVersion:1788,FieldPath:,}}] [] [{transport 9300 TCP} {http 9200 TCP}]}],}
I0909 18:52:04.366602 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:elasticsearch-master-headless,GenerateName:,Namespace:logging,SelfLink:/api/v1/namespaces/logging/endpoints/elasticsearch-master-headless,UID:7495a105-ce87-44a1-9923-1bc93452dd55,ResourceVersion:2365,Generation:0,CreationTimestamp:2019-09-09 09:58:17 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: elasticsearch-master,chart: elasticsearch-7.3.0,heritage: Tiller,release: elasticsearch,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:09Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.12 elasticsearch-master-2 0xc0003bbb40 ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-2,UID:ad89dec2-81eb-402d-9968-fd6200c6b08b,APIVersion:,ResourceVersion:1759,FieldPath:,}} {100.101.1.15 elasticsearch-master-1 0xc0003bbb50 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-1,UID:28515245-4060-4c4c-8bdd-cf551ade1305,APIVersion:,ResourceVersion:2362,FieldPath:,}} {100.101.2.5 elasticsearch-master-0 0xc0003bbb60 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-0,UID:ef7d0b10-ec17-4e87-8f4a-b50497c19045,APIVersion:,ResourceVersion:1788,FieldPath:,}}] [] [{transport 9300 TCP} {http 9200 TCP}]}],}
I0909 18:52:04.366661 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:grafana,GenerateName:,Namespace:monitoring,SelfLink:/api/v1/namespaces/monitoring/endpoints/grafana,UID:29d62a13-c119-437e-a7d0-2ec214c4a4c4,ResourceVersion:1715,Generation:0,CreationTimestamp:2019-09-09 09:54:47 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: grafana,chart: grafana-3.8.9,heritage: Tiller,release: grafana,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:01:24Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.13 0xc0003bbc20 ObjectReference{Kind:Pod,Namespace:monitoring,Name:grafana-df8b5bf4b-8hwqm,UID:1c3157ed-40ba-40f6-bfa8-134f5265fc05,APIVersion:,ResourceVersion:1713,FieldPath:,}}] [] [{service 3000 TCP}]}],}
I0909 18:52:04.366688 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:grafana,GenerateName:,Namespace:monitoring,SelfLink:/api/v1/namespaces/monitoring/endpoints/grafana,UID:29d62a13-c119-437e-a7d0-2ec214c4a4c4,ResourceVersion:1715,Generation:0,CreationTimestamp:2019-09-09 09:54:47 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: grafana,chart: grafana-3.8.9,heritage: Tiller,release: grafana,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:01:24Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.13 0xc0003bbc20 ObjectReference{Kind:Pod,Namespace:monitoring,Name:grafana-df8b5bf4b-8hwqm,UID:1c3157ed-40ba-40f6-bfa8-134f5265fc05,APIVersion:,ResourceVersion:1713,FieldPath:,}}] [] [{service 3000 TCP}]}],}
I0909 18:52:04.366715 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:my-product,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/endpoints/my-product,UID:3eb2fff3-2ba3-480c-91ee-1f1bb67ac83a,ResourceVersion:86290,Generation:0,CreationTimestamp:2019-09-09 12:18:43 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{10.96.131.102 <nil> nil} {10.96.189.52 <nil> nil} {10.96.5.23 <nil> nil} {10.96.5.232 <nil> nil} {10.96.5.233 <nil> nil} {10.96.5.24 <nil> nil} {10.96.5.25 <nil> nil} {10.96.5.26 <nil> nil} {10.96.5.27 <nil> nil} {10.96.5.32 <nil> nil} {10.96.5.40 <nil> nil} {10.96.5.41 <nil> nil} {10.96.5.42 <nil> nil} {10.98.20.59 <nil> nil} {10.98.20.60 <nil> nil}] [] [{default-code-prod 30003 TCP}]}],}
I0909 18:52:04.366759 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:my-product,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/endpoints/my-product,UID:3eb2fff3-2ba3-480c-91ee-1f1bb67ac83a,ResourceVersion:86290,Generation:0,CreationTimestamp:2019-09-09 12:18:43 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{10.96.131.102 <nil> nil} {10.96.189.52 <nil> nil} {10.96.5.23 <nil> nil} {10.96.5.232 <nil> nil} {10.96.5.233 <nil> nil} {10.96.5.24 <nil> nil} {10.96.5.25 <nil> nil} {10.96.5.26 <nil> nil} {10.96.5.27 <nil> nil} {10.96.5.32 <nil> nil} {10.96.5.40 <nil> nil} {10.96.5.41 <nil> nil} {10.96.5.42 <nil> nil} {10.98.20.59 <nil> nil} {10.98.20.60 <nil> nil}] [] [{default-code-prod 30003 TCP}]}],}
I0909 18:52:04.366807 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:redis-master,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/redis-master,UID:2eee41dc-bb6d-431f-b310-06e1745cbe7e,ResourceVersion:2281,Generation:0,CreationTimestamp:2019-09-09 09:54:36 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: redis,chart: redis-9.1.7,heritage: Tiller,release: redis,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:34Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.1.16 0xc0003bbcf0 ObjectReference{Kind:Pod,Namespace:management,Name:redis-master-0,UID:40457de9-aad4-4310-a3bb-e716155cd39f,APIVersion:,ResourceVersion:2279,FieldPath:,}}] [] [{redis 6379 TCP}]}],}
I0909 18:52:04.366870 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:redis-master,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/redis-master,UID:2eee41dc-bb6d-431f-b310-06e1745cbe7e,ResourceVersion:2281,Generation:0,CreationTimestamp:2019-09-09 09:54:36 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: redis,chart: redis-9.1.7,heritage: Tiller,release: redis,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:34Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.1.16 0xc0003bbcf0 ObjectReference{Kind:Pod,Namespace:management,Name:redis-master-0,UID:40457de9-aad4-4310-a3bb-e716155cd39f,APIVersion:,ResourceVersion:2279,FieldPath:,}}] [] [{redis 6379 TCP}]}],}
I0909 18:52:04.368306 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kuberhealthy,GenerateName:,Namespace:monitoring,SelfLink:/api/v1/namespaces/monitoring/endpoints/kuberhealthy,UID:0a30b599-84f9-4028-b6f3-7f33957d643d,ResourceVersion:2221,Generation:0,CreationTimestamp:2019-09-09 09:54:40 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: kuberhealthy,release: kuberhealthy,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:19Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.4 0xc0003bbd70 ObjectReference{Kind:Pod,Namespace:monitoring,Name:kuberhealthy-5459f465b-9fsmm,UID:864d7526-de35-4d35-aa51-e4cf44e4161f,APIVersion:,ResourceVersion:945,FieldPath:,}} {100.101.1.14 0xc0003bbd80 &ObjectReference{Kind:Pod,Namespace:monitoring,Name:kuberhealthy-5459f465b-xkv89,UID:7b88679c-a022-4faa-9f24-8b74b35829fa,APIVersion:,ResourceVersion:2218,FieldPath:,}}] [] [{http 8080 TCP}]}],}
I0909 18:52:04.368402 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kuberhealthy,GenerateName:,Namespace:monitoring,SelfLink:/api/v1/namespaces/monitoring/endpoints/kuberhealthy,UID:0a30b599-84f9-4028-b6f3-7f33957d643d,ResourceVersion:2221,Generation:0,CreationTimestamp:2019-09-09 09:54:40 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: kuberhealthy,release: kuberhealthy,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:05:19Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.4 0xc0003bbd70 ObjectReference{Kind:Pod,Namespace:monitoring,Name:kuberhealthy-5459f465b-9fsmm,UID:864d7526-de35-4d35-aa51-e4cf44e4161f,APIVersion:,ResourceVersion:945,FieldPath:,}} {100.101.1.14 0xc0003bbd80 &ObjectReference{Kind:Pod,Namespace:monitoring,Name:kuberhealthy-5459f465b-xkv89,UID:7b88679c-a022-4faa-9f24-8b74b35829fa,APIVersion:,ResourceVersion:2218,FieldPath:,}}] [] [{http 8080 TCP}]}],}
I0909 18:52:04.368802 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:elasticsearch-master,GenerateName:,Namespace:logging,SelfLink:/api/v1/namespaces/logging/endpoints/elasticsearch-master,UID:7de8eb1e-65d9-4970-a809-aaed438867f9,ResourceVersion:2364,Generation:0,CreationTimestamp:2019-09-09 09:58:17 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: elasticsearch-master,chart: elasticsearch-7.3.0,heritage: Tiller,release: elasticsearch,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:09Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.12 0xc0003bbe60 ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-2,UID:ad89dec2-81eb-402d-9968-fd6200c6b08b,APIVersion:,ResourceVersion:1759,FieldPath:,}} {100.101.1.15 0xc0003bbe70 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-1,UID:28515245-4060-4c4c-8bdd-cf551ade1305,APIVersion:,ResourceVersion:2362,FieldPath:,}} {100.101.2.5 0xc0003bbe80 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-0,UID:ef7d0b10-ec17-4e87-8f4a-b50497c19045,APIVersion:,ResourceVersion:1788,FieldPath:,}}] [] [{transport 9300 TCP} {http 9200 TCP}]}],}
I0909 18:52:04.369051 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:elasticsearch-master,GenerateName:,Namespace:logging,SelfLink:/api/v1/namespaces/logging/endpoints/elasticsearch-master,UID:7de8eb1e-65d9-4970-a809-aaed438867f9,ResourceVersion:2364,Generation:0,CreationTimestamp:2019-09-09 09:58:17 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: elasticsearch-master,chart: elasticsearch-7.3.0,heritage: Tiller,release: elasticsearch,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:06:09Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.12 0xc0003bbe60 ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-2,UID:ad89dec2-81eb-402d-9968-fd6200c6b08b,APIVersion:,ResourceVersion:1759,FieldPath:,}} {100.101.1.15 0xc0003bbe70 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-1,UID:28515245-4060-4c4c-8bdd-cf551ade1305,APIVersion:,ResourceVersion:2362,FieldPath:,}} {100.101.2.5 0xc0003bbe80 &ObjectReference{Kind:Pod,Namespace:logging,Name:elasticsearch-master-0,UID:ef7d0b10-ec17-4e87-8f4a-b50497c19045,APIVersion:,ResourceVersion:1788,FieldPath:,}}] [] [{transport 9300 TCP} {http 9200 TCP}]}],}
I0909 18:52:04.369153 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:postgresql-headless,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/postgresql-headless,UID:bd874806-0390-4833-aef1-36f173a88103,ResourceVersion:1661,Generation:0,CreationTimestamp:2019-09-09 09:54:32 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: postgresql,chart: postgresql-6.3.4,heritage: Tiller,release: postgresql,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:00:57Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.9 postgresql-postgresql-0 0xc0003bbf40 ObjectReference{Kind:Pod,Namespace:management,Name:postgresql-postgresql-0,UID:7b3f85cb-2861-48f3-bab4-4fb14f18f6e6,APIVersion:,ResourceVersion:1659,FieldPath:,}}] [] [{postgresql 5432 TCP}]}],}
I0909 18:52:04.369206 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:postgresql-headless,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/postgresql-headless,UID:bd874806-0390-4833-aef1-36f173a88103,ResourceVersion:1661,Generation:0,CreationTimestamp:2019-09-09 09:54:32 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: postgresql,chart: postgresql-6.3.4,heritage: Tiller,release: postgresql,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T10:00:57Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.9 postgresql-postgresql-0 0xc0003bbf40 ObjectReference{Kind:Pod,Namespace:management,Name:postgresql-postgresql-0,UID:7b3f85cb-2861-48f3-bab4-4fb14f18f6e6,APIVersion:,ResourceVersion:1659,FieldPath:,}}] [] [{postgresql 5432 TCP}]}],}
I0909 18:52:04.369258 8 status.go:86] new leader elected: ingress-nginx-ingress-controller-59958b8945-sl2p5
I0909 18:52:04.369254 8 nginx.go:373] Event CREATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:tiller-deploy,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/tiller-deploy,UID:241a0478-8101-4c4d-b035-148d11afb213,ResourceVersion:458,Generation:0,CreationTimestamp:2019-09-09 09:43:24 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: helm,name: tiller,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T09:53:57Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.2 0xc0003bbfc0 ObjectReference{Kind:Pod,Namespace:management,Name:tiller-deploy-ff594c4f7-r4vxd,UID:dfc5d09e-3ca3-4e2a-889f-d0b79ef41f8b,APIVersion:,ResourceVersion:457,FieldPath:,}}] [] [{tiller 44134 TCP}]}],}
I0909 18:52:04.373991 8 nginx.go:520] Adjusting ServerNameHashBucketSize variable to 64
I0909 18:52:04.374012 8 nginx.go:534] Number of worker processes: 8
I0909 18:52:04.374019 8 util.go:71] rlimit.max=1048576
I0909 18:52:04.374025 8 nginx.go:539] Maximum number of open file descriptors: 130048
I0909 18:52:04.374031 8 nginx.go:544] Adjusting MaxWorkerOpenFiles variable to 130048
I0909 18:52:04.374115 8 util.go:56] net.core.somaxconn=128 (using system default)
I0909 18:52:04.369299 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:tiller-deploy,GenerateName:,Namespace:management,SelfLink:/api/v1/namespaces/management/endpoints/tiller-deploy,UID:241a0478-8101-4c4d-b035-148d11afb213,ResourceVersion:458,Generation:0,CreationTimestamp:2019-09-09 09:43:24 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: helm,name: tiller,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T09:53:57Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.0.2 0xc0003bbfc0 ObjectReference{Kind:Pod,Namespace:management,Name:tiller-deploy-ff594c4f7-r4vxd,UID:dfc5d09e-3ca3-4e2a-889f-d0b79ef41f8b,APIVersion:,ResourceVersion:457,FieldPath:,}}] [] [{tiller 44134 TCP}]}],}
I0909 18:52:04.374932 8 nginx.go:373] Event CREATE received - object &Pod{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-59958b8945-n97s6,GenerateName:ingress-nginx-ingress-controller-59958b8945-,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/pods/ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,ResourceVersion:87686,Generation:0,CreationTimestamp:2019-09-09 18:52:02 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,component: controller,pod-template-hash: 59958b8945,release: ingress,},Annotations:map[string]string{},OwnerReferences:[{apps/v1 ReplicaSet ingress-nginx-ingress-controller-59958b8945 f86eaf79-f960-4ee3-89dd-1429288898e6 0xc00060cb8a 0xc00060cb8b}],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:PodSpec{Volumes:[{ingress-nginx-ingress-token-tmmb6 {nil nil nil nil nil SecretVolumeSource{SecretName:ingress-nginx-ingress-token-tmmb6,Items:[],DefaultMode:*420,Optional:nil,} nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil}}],Containers:[{nginx-ingress-controller quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 [] [/nginx-ingress-controller --election-id=ingress-controller-leader --ingress-class=nginx --configmap=kube-system/nginx-ingress-config-map -v=3 --default-ssl-certificate=kube-system/default-ssl-cert] [{http 0 80 TCP } {https 0 443 TCP } {metrics 0 10254 TCP }] [] [{POD_NAME EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}} {POD_NAMESPACE &EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}}] {map[] map[]} [{ingress-nginx-ingress-token-tmmb6 true /var/run/secrets/kubernetes.io/serviceaccount <nil> }] [] &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} nil /dev/termination-log File IfNotPresent &SecurityContext{Capabilities:&Capabilities{Add:[NET_BIND_SERVICE],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*33,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,} false false false}],RestartPolicy:Always,TerminationGracePeriodSeconds:*60,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:ingress-nginx-ingress,DeprecatedServiceAccount:ingress-nginx-ingress,NodeName:cc-stage-stage-7dwr2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[],WindowsOptions:nil,},ImagePullSecrets:[],Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[],AutomountServiceAccountToken:nil,Tolerations:[{node.kubernetes.io/not-ready Exists NoExecute 0xc00060cd80} {node.kubernetes.io/unreachable Exists NoExecute 0xc00060cda0}],HostAliases:[],PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[],RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:nil,},Status:PodStatus{Phase:Pending,Conditions:[{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC }],Message:,Reason:,HostIP:10.180.100.20,PodIP:,StartTime:2019-09-09 18:52:02 +0000 UTC,ContainerStatuses:[{nginx-ingress-controller {ContainerStateWaiting{Reason:ContainerCreating,Message:,} nil nil} {nil nil nil} false 0 quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 }],QOSClass:BestEffort,InitContainerStatuses:[],NominatedNodeName:,},}
I0909 18:52:04.375627 8 queue.go:87] queuing item &Pod{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-59958b8945-n97s6,GenerateName:ingress-nginx-ingress-controller-59958b8945-,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/pods/ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,ResourceVersion:87686,Generation:0,CreationTimestamp:2019-09-09 18:52:02 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,component: controller,pod-template-hash: 59958b8945,release: ingress,},Annotations:map[string]string{},OwnerReferences:[{apps/v1 ReplicaSet ingress-nginx-ingress-controller-59958b8945 f86eaf79-f960-4ee3-89dd-1429288898e6 0xc00060cb8a 0xc00060cb8b}],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:PodSpec{Volumes:[{ingress-nginx-ingress-token-tmmb6 {nil nil nil nil nil SecretVolumeSource{SecretName:ingress-nginx-ingress-token-tmmb6,Items:[],DefaultMode:*420,Optional:nil,} nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil}}],Containers:[{nginx-ingress-controller quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 [] [/nginx-ingress-controller --election-id=ingress-controller-leader --ingress-class=nginx --configmap=kube-system/nginx-ingress-config-map -v=3 --default-ssl-certificate=kube-system/default-ssl-cert] [{http 0 80 TCP } {https 0 443 TCP } {metrics 0 10254 TCP }] [] [{POD_NAME EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}} {POD_NAMESPACE &EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}}] {map[] map[]} [{ingress-nginx-ingress-token-tmmb6 true /var/run/secrets/kubernetes.io/serviceaccount <nil> }] [] &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} nil /dev/termination-log File IfNotPresent &SecurityContext{Capabilities:&Capabilities{Add:[NET_BIND_SERVICE],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*33,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,} false false false}],RestartPolicy:Always,TerminationGracePeriodSeconds:*60,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:ingress-nginx-ingress,DeprecatedServiceAccount:ingress-nginx-ingress,NodeName:cc-stage-stage-7dwr2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[],WindowsOptions:nil,},ImagePullSecrets:[],Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[],AutomountServiceAccountToken:nil,Tolerations:[{node.kubernetes.io/not-ready Exists NoExecute 0xc00060cd80} {node.kubernetes.io/unreachable Exists NoExecute 0xc00060cda0}],HostAliases:[],PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[],RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:nil,},Status:PodStatus{Phase:Pending,Conditions:[{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC }],Message:,Reason:,HostIP:10.180.100.20,PodIP:,StartTime:2019-09-09 18:52:02 +0000 UTC,ContainerStatuses:[{nginx-ingress-controller {ContainerStateWaiting{Reason:ContainerCreating,Message:,} nil nil} {nil nil nil} false 0 quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 }],QOSClass:BestEffort,InitContainerStatuses:[],NominatedNodeName:,},}
I0909 18:52:04.375815 8 nginx.go:373] Event CONFIGURATION received - object &ConfigMap{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:nginx-ingress-config-map,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/configmaps/nginx-ingress-config-map,UID:628bedcf-5cef-4ca3-b328-23c683bfba13,ResourceVersion:80836,Generation:0,CreationTimestamp:2019-09-09 16:57:56 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress-config-map,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Data:map[string]string{hsts: false,},BinaryData:map[string][]byte{},}
I0909 18:52:04.375847 8 queue.go:87] queuing item &ObjectMeta{Name:configmap-change,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],}
I0909 18:52:04.375870 8 nginx.go:373] Event UPDATE received - object &Ingress{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:dummy,GenerateName:,Namespace:dummy,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:IngressSpec{Backend:nil,TLS:[],Rules:[],},Status:IngressStatus{LoadBalancer:k8s_io_api_core_v1.LoadBalancerStatus{Ingress:[],},},}
I0909 18:52:04.375894 8 queue.go:87] queuing item &Ingress{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:dummy,GenerateName:,Namespace:dummy,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:IngressSpec{Backend:nil,TLS:[],Rules:[],},Status:IngressStatus{LoadBalancer:k8s_io_api_core_v1.LoadBalancerStatus{Ingress:[],},},}
I0909 18:52:04.375919 8 nginx.go:373] Event UPDATE received - object &Pod{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-59958b8945-n97s6,GenerateName:ingress-nginx-ingress-controller-59958b8945-,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/pods/ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,ResourceVersion:87693,Generation:0,CreationTimestamp:2019-09-09 18:52:02 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,component: controller,pod-template-hash: 59958b8945,release: ingress,},Annotations:map[string]string{},OwnerReferences:[{apps/v1 ReplicaSet ingress-nginx-ingress-controller-59958b8945 f86eaf79-f960-4ee3-89dd-1429288898e6 0xc00060daaa 0xc00060daab}],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:PodSpec{Volumes:[{ingress-nginx-ingress-token-tmmb6 {nil nil nil nil nil SecretVolumeSource{SecretName:ingress-nginx-ingress-token-tmmb6,Items:[],DefaultMode:*420,Optional:nil,} nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil}}],Containers:[{nginx-ingress-controller quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 [] [/nginx-ingress-controller --election-id=ingress-controller-leader --ingress-class=nginx --configmap=kube-system/nginx-ingress-config-map -v=3 --default-ssl-certificate=kube-system/default-ssl-cert] [{http 0 80 TCP } {https 0 443 TCP } {metrics 0 10254 TCP }] [] [{POD_NAME EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}} {POD_NAMESPACE &EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}}] {map[] map[]} [{ingress-nginx-ingress-token-tmmb6 true /var/run/secrets/kubernetes.io/serviceaccount <nil> }] [] &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} nil /dev/termination-log File IfNotPresent &SecurityContext{Capabilities:&Capabilities{Add:[NET_BIND_SERVICE],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*33,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,} false false false}],RestartPolicy:Always,TerminationGracePeriodSeconds:*60,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:ingress-nginx-ingress,DeprecatedServiceAccount:ingress-nginx-ingress,NodeName:cc-stage-stage-7dwr2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[],WindowsOptions:nil,},ImagePullSecrets:[],Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[],AutomountServiceAccountToken:nil,Tolerations:[{node.kubernetes.io/not-ready Exists NoExecute 0xc00060dca0} {node.kubernetes.io/unreachable Exists NoExecute 0xc00060dcc0}],HostAliases:[],PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[],RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:nil,},Status:PodStatus{Phase:Running,Conditions:[{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC }],Message:,Reason:,HostIP:10.180.100.20,PodIP:100.101.4.231,StartTime:2019-09-09 18:52:02 +0000 UTC,ContainerStatuses:[{nginx-ingress-controller {nil ContainerStateRunning{StartedAt:2019-09-09 18:52:02 +0000 UTC,} nil} {nil nil nil} false 0 quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 docker-pullable://quay.io/kubernetes-ingress-controller/nginx-ingress-controller@sha256:0c4941fa8c812dd44297b5f4900e3b26c3e6a8a42940e48fe9a1a585fe8f7e25 docker://f3b69ec8e70f068a8d53f2b4447bc61ff8141e64a1b974303b79b1b4201cf7af}],QOSClass:BestEffort,InitContainerStatuses:[],NominatedNodeName:,},}
I0909 18:52:04.376080 8 queue.go:87] queuing item &Pod{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-59958b8945-n97s6,GenerateName:ingress-nginx-ingress-controller-59958b8945-,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/pods/ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,ResourceVersion:87693,Generation:0,CreationTimestamp:2019-09-09 18:52:02 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,component: controller,pod-template-hash: 59958b8945,release: ingress,},Annotations:map[string]string{},OwnerReferences:[{apps/v1 ReplicaSet ingress-nginx-ingress-controller-59958b8945 f86eaf79-f960-4ee3-89dd-1429288898e6 0xc00060daaa 0xc00060daab}],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:PodSpec{Volumes:[{ingress-nginx-ingress-token-tmmb6 {nil nil nil nil nil SecretVolumeSource{SecretName:ingress-nginx-ingress-token-tmmb6,Items:[],DefaultMode:*420,Optional:nil,} nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil}}],Containers:[{nginx-ingress-controller quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 [] [/nginx-ingress-controller --election-id=ingress-controller-leader --ingress-class=nginx --configmap=kube-system/nginx-ingress-config-map -v=3 --default-ssl-certificate=kube-system/default-ssl-cert] [{http 0 80 TCP } {https 0 443 TCP } {metrics 0 10254 TCP }] [] [{POD_NAME EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}} {POD_NAMESPACE &EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}}] {map[] map[]} [{ingress-nginx-ingress-token-tmmb6 true /var/run/secrets/kubernetes.io/serviceaccount <nil> }] [] &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} &Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10254,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:10,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} nil /dev/termination-log File IfNotPresent &SecurityContext{Capabilities:&Capabilities{Add:[NET_BIND_SERVICE],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*33,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,} false false false}],RestartPolicy:Always,TerminationGracePeriodSeconds:*60,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:ingress-nginx-ingress,DeprecatedServiceAccount:ingress-nginx-ingress,NodeName:cc-stage-stage-7dwr2,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[],WindowsOptions:nil,},ImagePullSecrets:[],Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[],AutomountServiceAccountToken:nil,Tolerations:[{node.kubernetes.io/not-ready Exists NoExecute 0xc00060dca0} {node.kubernetes.io/unreachable Exists NoExecute 0xc00060dcc0}],HostAliases:[],PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[],RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:nil,},Status:PodStatus{Phase:Running,Conditions:[{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC ContainersNotReady containers with unready status: [nginx-ingress-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-09-09 18:52:02 +0000 UTC }],Message:,Reason:,HostIP:10.180.100.20,PodIP:100.101.4.231,StartTime:2019-09-09 18:52:02 +0000 UTC,ContainerStatuses:[{nginx-ingress-controller {nil ContainerStateRunning{StartedAt:2019-09-09 18:52:02 +0000 UTC,} nil} {nil nil nil} false 0 quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.25.1 docker-pullable://quay.io/kubernetes-ingress-controller/nginx-ingress-controller@sha256:0c4941fa8c812dd44297b5f4900e3b26c3e6a8a42940e48fe9a1a585fe8f7e25 docker://f3b69ec8e70f068a8d53f2b4447bc61ff8141e64a1b974303b79b1b4201cf7af}],QOSClass:BestEffort,InitContainerStatuses:[],NominatedNodeName:,},}
I0909 18:52:04.376208 8 nginx.go:373] Event UPDATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller,UID:88972a13-bd36-4842-baa9-6e738923d5af,ResourceVersion:87694,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:02Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[] [{100.101.4.231 0xc0005e3eb0 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87693,FieldPath:,}}] [{http 80 TCP} {https 443 TCP}]}],}
I0909 18:52:04.376239 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller,UID:88972a13-bd36-4842-baa9-6e738923d5af,ResourceVersion:87694,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:02Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[] [{100.101.4.231 0xc0005e3eb0 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87693,FieldPath:,}}] [{http 80 TCP} {https 443 TCP}]}],}
I0909 18:52:04.376271 8 nginx.go:373] Event UPDATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-metrics,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller-metrics,UID:d13bea76-17e1-44be-a7c2-8607bdd92271,ResourceVersion:87695,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:02Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[] [{100.101.4.231 0xc0005e3fa0 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87693,FieldPath:,}}] [{metrics 10254 TCP}]}],}
I0909 18:52:04.376299 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-metrics,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller-metrics,UID:d13bea76-17e1-44be-a7c2-8607bdd92271,ResourceVersion:87695,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:02Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[] [{100.101.4.231 0xc0005e3fa0 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87693,FieldPath:,}}] [{metrics 10254 TCP}]}],}
I0909 18:52:04.376409 8 nginx.go:373] Event UPDATE received - object &Ingress{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:dummy,GenerateName:,Namespace:dummy,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:IngressSpec{Backend:nil,TLS:[],Rules:[],},Status:IngressStatus{LoadBalancer:k8s_io_api_core_v1.LoadBalancerStatus{Ingress:[],},},}
I0909 18:52:04.376432 8 queue.go:87] queuing item &Ingress{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:dummy,GenerateName:,Namespace:dummy,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:IngressSpec{Backend:nil,TLS:[],Rules:[],},Status:IngressStatus{LoadBalancer:k8s_io_api_core_v1.LoadBalancerStatus{Ingress:[],},},}
I0909 18:52:04.376459 8 nginx.go:373] Event CREATE received - object &Ingress{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:my-product,GenerateName:,Namespace:default,SelfLink:/apis/networking.k8s.io/v1beta1/namespaces/default/ingresses/my-product,UID:c4088e8f-b1f3-4129-af7e-3b023121dd71,ResourceVersion:87647,Generation:4,CreationTimestamp:2019-09-09 16:49:44 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: my-product,},Annotations:map[string]string{nginx.ingress.kubernetes.io/auth-tls-secret: kube-system/sso-ca,nginx.ingress.kubernetes.io/auth-tls-verify-client: on,nginx.ingress.kubernetes.io/auth-tls-verify-depth: 10,nginx.ingress.kubernetes.io/ssl-redirect: true,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:IngressSpec{Backend:nil,TLS:[{[product.internal.domain] }],Rules:[{product.internal.domain {HTTPIngressRuleValue{Paths:[{/ {my-product {0 30003 }}}],}}}],},Status:IngressStatus{LoadBalancer:k8s_io_api_core_v1.LoadBalancerStatus{Ingress:[],},},}
I0909 18:52:04.376490 8 queue.go:87] queuing item &Ingress{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:my-product,GenerateName:,Namespace:default,SelfLink:/apis/networking.k8s.io/v1beta1/namespaces/default/ingresses/my-product,UID:c4088e8f-b1f3-4129-af7e-3b023121dd71,ResourceVersion:87647,Generation:4,CreationTimestamp:2019-09-09 16:49:44 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: my-product,},Annotations:map[string]string{nginx.ingress.kubernetes.io/auth-tls-secret: kube-system/sso-ca,nginx.ingress.kubernetes.io/auth-tls-verify-client: on,nginx.ingress.kubernetes.io/auth-tls-verify-depth: 10,nginx.ingress.kubernetes.io/ssl-redirect: true,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Spec:IngressSpec{Backend:nil,TLS:[{[product.internal.domain] }],Rules:[{product.internal.domain {HTTPIngressRuleValue{Paths:[{/ {my-product {0 30003 }}}],}}}],},Status:IngressStatus{LoadBalancer:k8s_io_api_core_v1.LoadBalancerStatus{Ingress:[],},},}
I0909 18:52:04.377690 8 template.go:106] NGINX configuration: { "ProxySetHeaders": {}, "AddHeaders": {}, "BacklogSize": 511, "Backends": [ { "name": "default-my-product-30003", "service": { "metadata": { "name": "my-product", "namespace": "default", "selfLink": "/api/v1/namespaces/default/services/my-product", "uid": "c998aa36-ba5e-4027-b201-b389e53bfcb4", "resourceVersion": "26796", "creationTimestamp": "2019-09-09T12:18:43Z" }, "spec": { "ports": [ { "name": "default-code-prod", "protocol": "TCP", "port": 30003, "targetPort": 30003 } ], "clusterIP": "None", "type": "ClusterIP", "externalIPs": [ "10.96.5.32", "10.96.5.25", "10.96.5.24", "10.98.20.60", "10.96.5.42", "10.96.131.102", "10.96.5.23", "10.96.5.233", "10.96.5.41", "10.96.5.232", "10.96.5.40", "10.96.5.26", "10.98.20.59", "10.96.5.27", "10.96.189.52" ], "sessionAffinity": "None", "publishNotReadyAddresses": true }, "status": { "loadBalancer": {} } }, "port": 30003, "secureCACert": { "secret": "", "caFilename": "", "pemSha": "" }, "sslPassthrough": false, "endpoints": [ { "address": "10.96.131.102", "port": "30003" }, { "address": "10.96.189.52", "port": "30003" }, { "address": "10.96.5.23", "port": "30003" }, { "address": "10.96.5.232", "port": "30003" }, { "address": "10.96.5.233", "port": "30003" }, { "address": "10.96.5.24", "port": "30003" }, { "address": "10.96.5.25", "port": "30003" }, { "address": "10.96.5.26", "port": "30003" }, { "address": "10.96.5.27", "port": "30003" }, { "address": "10.96.5.32", "port": "30003" }, { "address": "10.96.5.40", "port": "30003" }, { "address": "10.96.5.41", "port": "30003" }, { "address": "10.96.5.42", "port": "30003" }, { "address": "10.98.20.59", "port": "30003" }, { "address": "10.98.20.60", "port": "30003" } ], "sessionAffinityConfig": { "name": "", "cookieSessionAffinity": { "name": "" } }, "upstreamHashByConfig": { "upstream-hash-by-subset-size": 3 }, "noServer": false, "trafficShapingPolicy": { "weight": 0, "header": "", "headerValue": "", "cookie": "" } } ], "PassthroughBackends": null, "Servers": [ { "hostname": "_", "sslPassthrough": false, "sslCert": { "metadata": { "name": "default-ssl-cert", "namespace": "kube-system", "creationTimestamp": null }, "certificate": { "SignatureAlgorithm": 4, "PublicKeyAlgorithm": 1, "Version": 3, "SerialNumber": 155004, "Issuer": { "Country": [ "DE" ], "Organization": [ "X" ], "OrganizationalUnit": null, "Locality": [ "X" ], "Province": null, "StreetAddress": null, "PostalCode": null, "SerialNumber": "", "CommonName": "XY", "Names": [ { "Type": [ 2, 5, 4, 6 ], "Value": "X" }, { "Type": [ 2, 5, 4, 7 ], "Value": "Y" }, { "Type": [ 2, 5, 4, 10 ], "Value": "X" }, { "Type": [ 2, 5, 4, 3 ], "Value": "Y" } ], "ExtraNames": null }, "Subject": { "Country": [ "X" ], "Organization": [ "Y" ], "OrganizationalUnit": [ "X" ], "Locality": null, "Province": null, "StreetAddress": null, "PostalCode": null, "SerialNumber": "", "CommonName": "product.internal.domain", "Names": [ { "Type": [ 2, 5, 4, 6 ], "Value": "X" }, { "Type": [ 2, 5, 4, 10 ], "Value": "Y" }, { "Type": [ 2, 5, 4, 11 ], "Value": "Z" }, { "Type": [ 2, 5, 4, 3 ], "Value": "product.internal.domain" } ], "ExtraNames": null }, "NotBefore": "2019-09-09T15:51:00Z", "NotAfter": "2021-09-09T15:51:00Z", "KeyUsage": 5, "Extensions": [ { "Id": [ 2, 5, 29, 37 ], "Critical": false, "Value": "==" }, { "Id": [ 2, 5, 29, 35 ], "Critical": false, "Value": "+QPPwbIVr/" }, { "Id": [ 1, 3, 6, 1, 5, 5, 7, 1, 1 ], "Critical": false, "Value": "==" }, { "Id": [ 2, 5, 29, 31 ], "Critical": false, "Value": "=" }, { "Id": [ 2, 5, 29, 14 ], "Critical": false, "Value": "==" }, { "Id": [ 2, 5, 29, 15 ], "Critical": true, "Value": "==" }, { "Id": [ 2, 5, 29, 17 ], "Critical": false, "Value": "==" }, { "Id": [ 2, 5, 29, 19 ], "Critical": true, "Value": "=" } ], "ExtraExtensions": null, "UnhandledCriticalExtensions": null, "ExtKeyUsage": [ 1, 2 ], "UnknownExtKeyUsage": null, "BasicConstraintsValid": true, "IsCA": false, "MaxPathLen": -1, "MaxPathLenZero": false, "SubjectKeyId": "=", "AuthorityKeyId": "", "OCSPServer": null, "IssuingCertificateURL": [ "http://..." ], "DNSNames": [ "*.product.internal.domain", "product.internal.domain" ], "EmailAddresses": [ "usermail" ], "IPAddresses": null, "URIs": null, "PermittedDNSDomainsCritical": false, "PermittedDNSDomains": null, "ExcludedDNSDomains": null, "PermittedIPRanges": null, "ExcludedIPRanges": null, "PermittedEmailAddresses": null, "ExcludedEmailAddresses": null, "PermittedURIDomains": null, "ExcludedURIDomains": null, "CRLDistributionPoints": [], "PolicyIdentifiers": null }, "caFileName": "/etc/ingress-controller/ssl/kube-system-default-ssl-cert.pem", "pemFileName": "/etc/ingress-controller/ssl/default-fake-certificate.pem", "pemSha": "", "cn": [ "product.internal.domain" ], "expires": "2021-09-09T15:51:00Z", "pemCertKey": "-----BEGIN PRIVATE KEY----....------END PRIVATE KEY-----" }, "locations": [ { "path": "/", "isDefBackend": false, "ingress": { "metadata": { "name": "my-product", "namespace": "default", "selfLink": "/apis/networking.k8s.io/v1beta1/namespaces/default/ingresses/my-product", "uid": "c4088e8f-b1f3-4129-af7e-3b023121dd71", "resourceVersion": "87647", "generation": 4, "creationTimestamp": "2019-09-09T16:49:44Z", "labels": { "app": "my-product" }, "annotations": { "nginx.ingress.kubernetes.io/auth-tls-secret": "kube-system/sso-ca", "nginx.ingress.kubernetes.io/auth-tls-verify-client": "on", "nginx.ingress.kubernetes.io/auth-tls-verify-depth": "10", "nginx.ingress.kubernetes.io/ssl-redirect": "true" } }, "spec": { "tls": [ { "hosts": [ "product.internal.domain" ] } ], "rules": [ { "host": "product.internal.domain", "http": { "paths": [ { "path": "/", "backend": { "serviceName": "my-product", "servicePort": 30003 } } ] } } ] }, "status": { "loadBalancer": {} }, "parsedAnnotations": { "name": "my-product", "namespace": "default", "selfLink": "/apis/networking.k8s.io/v1beta1/namespaces/default/ingresses/my-product", "uid": "c4088e8f-b1f3-4129-af7e-3b023121dd71", "resourceVersion": "87647", "generation": 4, "creationTimestamp": "2019-09-09T16:49:44Z", "labels": { "app": "my-product" }, "annotations": { "nginx.ingress.kubernetes.io/auth-tls-secret": "kube-system/sso-ca", "nginx.ingress.kubernetes.io/auth-tls-verify-client": "on", "nginx.ingress.kubernetes.io/auth-tls-verify-depth": "10", "nginx.ingress.kubernetes.io/ssl-redirect": "true" }, "BackendProtocol": "HTTP", "Alias": "", "BasicDigestAuth": { "type": "", "realm": "", "file": "", "secured": false, "fileSha": "", "secret": "" }, "Canary": { "Enabled": false, "Weight": 0, "Header": "", "HeaderValue": "", "Cookie": "" }, "CertificateAuth": { "secret": "kube-system/sso-ca", "caFilename": "/etc/ingress-controller/ssl/ca-kube-system-sso-ca.pem", "pemSha": "c7993d0454004c693dcc326d6444ef14ba90f662", "verify_client": "on", "validationDepth": 10, "errorPage": "", "passCertToUpstream": false, "AuthTLSError": "" }, "ClientBodyBufferSize": "", "ConfigurationSnippet": "", "Connection": { "header": "", "enabled": false }, "CorsConfig": { "corsEnabled": false, "corsAllowOrigin": "*", "corsAllowMethods": "GET, PUT, POST, DELETE, PATCH, OPTIONS", "corsAllowHeaders": "DNT,X-CustomHeader,Keep-Alive,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Authorization", "corsAllowCredentials": true, "corsMaxAge": 1728000 }, "CustomHTTPErrors": null, "DefaultBackend": null, "FastCGI": { "index": "", "params": null }, "Denied": null, "ExternalAuth": { "url": "", "host": "", "signinUrl": "", "method": "", "requestRedirect": "", "authSnippet": "", "authCacheKey": "", "authCacheDuration": null }, "EnableGlobalAuth": true, "HTTP2PushPreload": false, "Proxy": { "bodySize": "1m", "connectTimeout": 5, "sendTimeout": 60, "readTimeout": 60, "buffersNumber": 4, "bufferSize": "4k", "cookieDomain": "off", "cookiePath": "off", "nextUpstream": "error timeout", "nextUpstreamTimeout": 0, "nextUpstreamTries": 3, "proxyRedirectFrom": "off", "proxyRedirectTo": "off", "requestBuffering": "on", "proxyBuffering": "off", "proxyHTTPVersion": "1.1" }, "RateLimit": { "connections": { "name": "", "limit": 0, "burst": 0, "sharedSize": 0 }, "rps": { "name": "", "limit": 0, "burst": 0, "sharedSize": 0 }, "rpm": { "name": "", "limit": 0, "burst": 0, "sharedSize": 0 }, "limit-rate": 0, "limit-rate-after": 0, "name": "", "id": "", "whitelist": null }, "Redirect": { "url": "", "code": 0, "fromToWWW": false }, "Rewrite": { "target": "", "sslRedirect": true, "forceSSLRedirect": false, "appRoot": "", "useRegex": false }, "Satisfy": "", "SecureUpstream": { "caCert": { "secret": "", "caFilename": "", "pemSha": "" } }, "ServerSnippet": "", "ServiceUpstream": false, "SessionAffinity": { "type": "", "name": "", "expires": "", "maxage": "", "path": "", "changeonfailure": false }, "SSLPassthrough": false, "UsePortInRedirects": false, "UpstreamHashBy": { "upstream-hash-by-subset-size": 3 }, "LoadBalancing": "", "UpstreamVhost": "", "Whitelist": {}, "XForwardedPrefix": "", "SSLCiphers": "", "Logs": { "accessLog": true, "rewriteLog": false }, "LuaRestyWAF": { "mode": "", "debug": false, "ignored-rulesets": null, "extra-ruleset-string": "", "score-threshold": 0, "allow-unknown-content-types": false, "process-multipart-body": false }, "InfluxDB": { "influxDBEnabled": false, "influxDBMeasurement": "default", "influxDBPort": "8089", "influxDBHost": "127.0.0.1", "influxDBServerName": "nginx-ingress" }, "ModSecurity": { "enable-modsecurity": false, "enable-owasp-core-rules": false, "modsecurity-transaction-id": "", "modsecurity-snippet": "" }, "Mirror": { "uri": "", "requestBody": "on" } } }, "backend": "default-my-product-30003", "service": { "metadata": { "name": "my-product", "namespace": "default", "selfLink": "/api/v1/namespaces/default/services/my-product", "uid": "c998aa36-ba5e-4027-b201-b389e53bfcb4", "resourceVersion": "26796", "creationTimestamp": "2019-09-09T12:18:43Z" }, "spec": { "ports": [ { "name": "default-code-prod", "protocol": "TCP", "port": 30003, "targetPort": 30003 } ], "clusterIP": "None", "type": "ClusterIP", "externalIPs": [ "10.96.5.32", "10.96.5.25", "10.96.5.24", "10.98.20.60", "10.96.5.42", "10.96.131.102", "10.96.5.23", "10.96.5.233", "10.96.5.41", "10.96.5.232", "10.96.5.40", "10.96.5.26", "10.98.20.59", "10.96.5.27", "10.96.189.52" ], "sessionAffinity": "None", "publishNotReadyAddresses": true }, "status": { "loadBalancer": {} } }, "port": 30003, "upstream-vhost": "", "basicDigestAuth": { "type": "", "realm": "", "file": "", "secured": false, "fileSha": "", "secret": "" }, "corsConfig": { "corsEnabled": false, "corsAllowOrigin": "*", "corsAllowMethods": "GET, PUT, POST, DELETE, PATCH, OPTIONS", "corsAllowHeaders": "DNT,X-CustomHeader,Keep-Alive,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Authorization", "corsAllowCredentials": true, "corsMaxAge": 1728000 }, "externalAuth": { "url": "", "host": "", "signinUrl": "", "method": "", "requestRedirect": "", "authSnippet": "", "authCacheKey": "", "authCacheDuration": null }, "enableGlobalAuth": true, "rateLimit": { "connections": { "name": "", "limit": 0, "burst": 0, "sharedSize": 0 }, "rps": { "name": "", "limit": 0, "burst": 0, "sharedSize": 0 }, "rpm": { "name": "", "limit": 0, "burst": 0, "sharedSize": 0 }, "limit-rate": 0, "limit-rate-after": 0, "name": "", "id": "", "whitelist": null }, "redirect": { "url": "", "code": 0, "fromToWWW": false }, "rewrite": { "target": "", "sslRedirect": true, "forceSSLRedirect": false, "appRoot": "", "useRegex": false }, "whitelist": {}, "proxy": { "bodySize": "1m", "connectTimeout": 5, "sendTimeout": 60, "readTimeout": 60, "buffersNumber": 4, "bufferSize": "4k", "cookieDomain": "off", "cookiePath": "off", "nextUpstream": "error timeout", "nextUpstreamTimeout": 0, "nextUpstreamTries": 3, "proxyRedirectFrom": "off", "proxyRedirectTo": "off", "requestBuffering": "on", "proxyBuffering": "off", "proxyHTTPVersion": "1.1" }, "usePortInRedirects": false, "configurationSnippet": "", "connection": { "header": "", "enabled": false }, "defaultBackendUpstreamName": "upstream-default-backend", "logs": { "accessLog": true, "rewriteLog": false }, "luaRestyWAF": { "mode": "", "debug": false, "ignored-rulesets": null, "extra-ruleset-string": "", "score-threshold": 0, "allow-unknown-content-types": false, "process-multipart-body": false }, "influxDB": { "influxDBEnabled": false, "influxDBMeasurement": "default", "influxDBPort": "8089", "influxDBHost": "127.0.0.1", "influxDBServerName": "nginx-ingress" }, "backend-protocol": "HTTP", "fastcgi": { "index": "", "params": null }, "custom-http-errors": null, "modsecurity": { "enable-modsecurity": false, "enable-owasp-core-rules": false, "modsecurity-transaction-id": "", "modsecurity-snippet": "" }, "satisfy": "", "mirror": { "uri": "", "requestBody": "on" } } ], "certificateAuth": { "secret": "kube-system/sso-ca", "caFilename": "/etc/ingress-controller/ssl/ca-kube-system-sso-ca.pem", "pemSha": "c7993d0454004c693dcc326d6444ef14ba90f662", "verify_client": "on", "validationDepth": 10, "errorPage": "", "passCertToUpstream": false, "AuthTLSError": "" }, "serverSnippet": "" } ], "TCPBackends": [], "UDPBackends": [], "HealthzURI": "/healthz", "Cfg": { "app-root": "", "custom-http-errors": null, "proxy-body-size": "1m", "proxy-connect-timeout": 5, "proxy-read-timeout": 60, "proxy-send-timeout": 60, "proxy-buffers-number": 4, "proxy-buffer-size": "4k", "proxy-cookie-path": "off", "proxy-cookie-domain": "off", "proxy-next-upstream": "error timeout", "proxy-next-upstream-timeout": 0, "proxy-next-upstream-tries": 3, "proxy-redirect-from": "off", "proxy-redirect-to": "off", "proxy-request-buffering": "on", "Resolver": [ "198.18.128.2" ], "skip-access-log-urls": [], "ssl-redirect": true, "force-ssl-redirect": false, "use-port-in-redirects": false, "upstream-hash-by": "", "upstream-hash-by-subset": false, "upstream-hash-by-subset-size": 0, "load-balance": "", "whitelist-source-range": [], "limit-rate": 0, "limit-rate-after": 0, "proxy-buffering": "off", "allow-backend-server-header": false, "enable-access-log-for-default-backend": false, "access-log-path": "/var/log/nginx/access.log", "error-log-path": "/var/log/nginx/error.log", "enable-modsecurity": false, "enable-owasp-modsecurity-crs": false, "client-header-buffer-size": "1k", "client-header-timeout": 60, "client-body-buffer-size": "8k", "client-body-timeout": 60, "disable-ipv6-dns": true, "enable-underscores-in-headers": false, "ignore-invalid-headers": true, "retry-non-idempotent": false, "error-log-level": "notice", "http2-max-field-size": "4k", "http2-max-header-size": "16k", "http2-max-requests": 1000, "hsts-include-subdomains": true, "hsts-max-age": "15724800", "keep-alive": 75, "keep-alive-requests": 100, "large-client-header-buffers": "4 8k", "log-format-upstream": "%v - [$the_real_ip] - $remote_user [$time_local] \"$request\" $status $body_bytes_sent \"$http_referer\" \"$http_user_agent\" $request_length $request_time [$proxy_upstream_name] [$proxy_alternative_upstream_name] $upstream_addr $upstream_response_length $upstream_response_time $upstream_status $req_id", "log-format-stream": "[$time_local] $protocol $status $bytes_sent $bytes_received $session_time", "enable-multi-accept": true, "max-worker-connections": 16384, "max-worker-open-files": 130048, "map-hash-bucket-size": 64, "nginx-status-ipv4-whitelist": [ "127.0.0.1" ], "nginx-status-ipv6-whitelist": [ "::1" ], "proxy-real-ip-cidr": [ "0.0.0.0/0" ], "server-name-hash-max-size": 1024, "server-name-hash-bucket-size": 64, "proxy-headers-hash-max-size": 512, "proxy-headers-hash-bucket-size": 64, "server-tokens": true, "ssl-ciphers": "ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256", "ssl-ecdh-curve": "auto", "ssl-protocols": "TLSv1.2", "ssl-session-cache": true, "ssl-session-cache-size": "10m", "ssl-session-tickets": true, "ssl-session-timeout": "10m", "ssl-buffer-size": "4k", "proxy-protocol-header-timeout": 5000000000, "use-gzip": true, "use-geoip": true, "brotli-level": 4, "brotli-types": "application/xml+rss application/atom+xml application/javascript application/x-javascript application/json application/rss+xml application/vnd.ms-fontobject application/x-font-ttf application/x-web-app-manifest+json application/xhtml+xml application/xml font/opentype image/svg+xml image/x-icon text/css text/javascript text/plain text/x-component", "use-http2": true, "gzip-level": 5, "gzip-types": "application/atom+xml application/javascript application/x-javascript application/json application/rss+xml application/vnd.ms-fontobject application/x-font-ttf application/x-web-app-manifest+json application/xhtml+xml application/xml font/opentype image/svg+xml image/x-icon text/css text/javascript text/plain text/x-component", "worker-processes": "8", "worker-shutdown-timeout": "10s", "variables-hash-bucket-size": 128, "variables-hash-max-size": 2048, "upstream-keepalive-connections": 32, "upstream-keepalive-timeout": 60, "upstream-keepalive-requests": 100, "limit-conn-zone-variable": "$binary_remote_addr", "proxy-stream-timeout": "600s", "proxy-stream-responses": 1, "proxy-http-version": "", "use-forwarded-headers": false, "forwarded-for-header": "X-Forwarded-For", "generate-request-id": true, "proxy-add-original-uri-header": true, "enable-opentracing": false, "zipkin-collector-host": "", "zipkin-collector-port": 9411, "zipkin-service-name": "nginx", "zipkin-sample-rate": 1, "jaeger-collector-host": "", "jaeger-collector-port": 6831, "jaeger-service-name": "nginx", "jaeger-sampler-type": "const", "jaeger-sampler-param": "1", "jaeger-sampler-host": "http://127.0.0.1", "jaeger-sampler-port": 5778, "datadog-collector-host": "", "datadog-collector-port": 8126, "datadog-service-name": "nginx", "datadog-operation-name-override": "nginx.handle", "main-snippet": "", "http-snippet": "", "server-snippet": "", "location-snippet": "", "http-redirect-code": 308, "reuse-port": true, "hide-headers": [], "limit-req-status-code": 503, "limit-conn-status-code": 503, "enable-syslog": false, "syslog-host": "", "syslog-port": 514, "no-tls-redirect-locations": "/.well-known/acme-challenge", "no-auth-locations": "/.well-known/acme-challenge", "global-external-auth": { "url": "", "host": "", "signinUrl": "", "method": "", "responseHeaders": [ "" ], "requestRedirect": "", "authSnippet": "", "authCacheKey": "", "authCacheDuration": [] }, "disable-lua-resty-waf": false, "enable-influxdb": false, "block-cidrs": [], "block-user-agents": [], "block-referers": [], "lua-shared-dicts": {} }, "IsIPV6Enabled": false, "IsSSLPassthroughEnabled": false, "NginxStatusIpv4Whitelist": [ "127.0.0.1" ], "NginxStatusIpv6Whitelist": [ "::1" ], "RedirectServers": [], "ListenPorts": { "HTTP": 80, "HTTPS": 443, "Health": 10254, "Default": 8181, "SSLProxy": 442 }, "PublishService": null, "EnableDynamicCertificates": true, "EnableMetrics": true, "PID": "/tmp/nginx.pid", "StatusSocket": "/tmp/nginx-status-server.sock", "StatusPath": "/nginx_status", "StreamSocket": "/tmp/ingress-stream.sock"}
I0909 18:52:04.378661 8 template.go:776] empty byte size, hence it will not be set
I0909 18:52:04.379543 8 template.go:776] empty byte size, hence it will not be set
I0909 18:52:04.379786 8 template.go:776] empty byte size, hence it will not be set
I0909 18:52:04.414764 8 nginx.go:709] NGINX configuration diff:
--- /etc/nginx/nginx.conf 2019-08-14 20:02:21.000000000 +0000
+++ /tmp/new-nginx-cfg946777427 2019-09-09 18:52:04.000000000 +0000
@@ -1,6 +1,799 @@
-# A very simple nginx configuration file that forces nginx to start.
+
+# Configuration checksum: 6374272301038888562
+
+# setup custom paths that do not require root access
pid /tmp/nginx.pid;
-events {}
-http {}
-daemon off;
\ No newline at end of file
+daemon off;
+
+worker_processes 8;
+
+worker_rlimit_nofile 130048;
+
+worker_shutdown_timeout 10s ;
+
+events {
+ multi_accept on;
+ worker_connections 16384;
+ use epoll;
+}
+
+http {
+ lua_package_path "/usr/local/openresty/site/lualib/?.ljbc;/usr/local/openresty/site/lualib/?/init.ljbc;/usr/local/openresty/lualib/?.ljbc;/usr/local/openresty/lualib/?/init.ljbc;/usr/local/openresty/site/lualib/?.lua;/usr/local/openresty/site/lualib/?/init.lua;/usr/local/openresty/lualib/?.lua;/usr/local/openresty/lualib/?/init.lua;./?.lua;/usr/local/openresty/luajit/share/luajit-2.1.0-beta3/?.lua;/usr/local/share/lua/5.1/?.lua;/usr/local/share/lua/5.1/?/init.lua;/usr/local/openresty/luajit/share/lua/5.1/?.lua;/usr/local/openresty/luajit/share/lua/5.1/?/init.lua;/usr/local/lib/lua/?.lua;;";
+ lua_package_cpath "/usr/local/openresty/site/lualib/?.so;/usr/local/openresty/lualib/?.so;./?.so;/usr/local/lib/lua/5.1/?.so;/usr/local/openresty/luajit/lib/lua/5.1/?.so;/usr/local/lib/lua/5.1/loadall.so;/usr/local/openresty/luajit/lib/lua/5.1/?.so;;";
+
+ lua_shared_dict configuration_data 15M;
+ lua_shared_dict certificate_data 16M;
+
+ init_by_lua_block {
+ collectgarbage("collect")
+
+ local lua_resty_waf = require("resty.waf")
+ lua_resty_waf.init()
+
+ -- init modules
+ local ok, res
+
+ ok, res = pcall(require, "lua_ingress")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ lua_ingress = res
+ lua_ingress.set_config({
+ use_forwarded_headers = false,
+ is_ssl_passthrough_enabled = false,
+ http_redirect_code = 308,
+ listen_ports = { ssl_proxy = "442", https = "443" },
+ })
+ end
+
+ ok, res = pcall(require, "configuration")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ configuration = res
+ end
+
+ ok, res = pcall(require, "balancer")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ balancer = res
+ end
+
+ ok, res = pcall(require, "monitor")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ monitor = res
+ end
+
+ ok, res = pcall(require, "certificate")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ certificate = res
+ end
+
+ ok, res = pcall(require, "plugins")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ plugins = res
+ end
+ -- load all plugins that'll be used here
+ plugins.init({})
+ }
+
+ init_worker_by_lua_block {
+ lua_ingress.init_worker()
+ balancer.init_worker()
+
+ monitor.init_worker()
+
+ plugins.run()
+ }
+
+ geoip_country /etc/nginx/geoip/GeoIP.dat;
+ geoip_city /etc/nginx/geoip/GeoLiteCity.dat;
+ geoip_org /etc/nginx/geoip/GeoIPASNum.dat;
+ geoip_proxy_recursive on;
+
+ aio threads;
+ aio_write on;
+
+ tcp_nopush on;
+ tcp_nodelay on;
+
+ log_subrequest on;
+
+ reset_timedout_connection on;
+
+ keepalive_timeout 75s;
+ keepalive_requests 100;
+
+ client_body_temp_path /tmp/client-body;
+ fastcgi_temp_path /tmp/fastcgi-temp;
+ proxy_temp_path /tmp/proxy-temp;
+ ajp_temp_path /tmp/ajp-temp;
+
+ client_header_buffer_size 1k;
+ client_header_timeout 60s;
+ large_client_header_buffers 4 8k;
+ client_body_buffer_size 8k;
+ client_body_timeout 60s;
+
+ http2_max_field_size 4k;
+ http2_max_header_size 16k;
+ http2_max_requests 1000;
+
+ types_hash_max_size 2048;
+ server_names_hash_max_size 1024;
+ server_names_hash_bucket_size 64;
+ map_hash_bucket_size 64;
+
+ proxy_headers_hash_max_size 512;
+ proxy_headers_hash_bucket_size 64;
+
+ variables_hash_bucket_size 128;
+ variables_hash_max_size 2048;
+
+ underscores_in_headers off;
+ ignore_invalid_headers on;
+
+ limit_req_status 503;
+ limit_conn_status 503;
+
+ include /etc/nginx/mime.types;
+ default_type text/html;
+
+ gzip on;
+ gzip_comp_level 5;
+ gzip_http_version 1.1;
+ gzip_min_length 256;
+ gzip_types application/atom+xml application/javascript application/x-javascript application/json application/rss+xml application/vnd.ms-fontobject application/x-font-ttf application/x-web-app-manifest+json application/xhtml+xml application/xml font/opentype image/svg+xml image/x-icon text/css text/javascript text/plain text/x-component;
+ gzip_proxied any;
+ gzip_vary on;
+
+ # Custom headers for response
+
+ server_tokens on;
+
+ # disable warnings
+ uninitialized_variable_warn off;
+
+ # Additional available variables:
+ # $namespace
+ # $ingress_name
+ # $service_name
+ # $service_port
+ log_format upstreaminfo '$the_real_ip - [$the_real_ip] - $remote_user [$time_local] "$request" $status $body_bytes_sent "$http_referer" "$http_user_agent" $request_length $request_time [$proxy_upstream_name] [$proxy_alternative_upstream_name] $upstream_addr $upstream_response_length $upstream_response_time $upstream_status $req_id';
+
+ map $request_uri $loggable {
+
+ default 1;
+ }
+
+ access_log /var/log/nginx/access.log upstreaminfo if=$loggable;
+
+ error_log /var/log/nginx/error.log notice;
+
+ resolver 198.18.128.2 valid=30s ipv6=off;
+
+ # See https://www.nginx.com/blog/websocket-nginx
+ map $http_upgrade $connection_upgrade {
+ default upgrade;
+
+ # See http://nginx.org/en/docs/http/ngx_http_upstream_module.html#keepalive
+ '' '';
+
+ }
+
+ # The following is a sneaky way to do "set $the_real_ip $remote_addr"
+ # Needed because using set is not allowed outside server blocks.
+ map '' $the_real_ip {
+
+ default $remote_addr;
+
+ }
+
+ # Reverse proxies can detect if a client provides a X-Request-ID header, and pass it on to the backend server.
+ # If no such header is provided, it can provide a random value.
+ map $http_x_request_id $req_id {
+ default $http_x_request_id;
+
+ "" $request_id;
+
+ }
+
+ # Create a variable that contains the literal $ character.
+ # This works because the geo module will not resolve variables.
+ geo $literal_dollar {
+ default "$";
+ }
+
+ server_name_in_redirect off;
+ port_in_redirect off;
+
+ ssl_protocols TLSv1.2;
+
+ # turn on session caching to drastically improve performance
+
+ ssl_session_cache builtin:1000 shared:SSL:10m;
+ ssl_session_timeout 10m;
+
+ # allow configuring ssl session tickets
+ ssl_session_tickets on;
+
+ # slightly reduce the time-to-first-byte
+ ssl_buffer_size 4k;
+
+ # allow configuring custom ssl ciphers
+ ssl_ciphers 'ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256';
+ ssl_prefer_server_ciphers on;
+
+ ssl_ecdh_curve auto;
+
+ proxy_ssl_session_reuse on;
+
+ upstream upstream_balancer {
+ server 0.0.0.1; # placeholder
+
+ balancer_by_lua_block {
+ balancer.balance()
+ }
+
+ keepalive 32;
+
+ keepalive_timeout 60s;
+ keepalive_requests 100;
+
+ }
+
+ # Cache for internal auth checks
+ proxy_cache_path /tmp/nginx-cache-auth levels=1:2 keys_zone=auth_cache:10m max_size=128m inactive=30m use_temp_path=off;
+
+ # Global filters
+
+ ## start server _
+ server {
+ server_name _ ;
+
+ listen 80 default_server reuseport backlog=511 ;
+ listen 443 default_server reuseport backlog=511 ssl http2 ;
+
+ set $proxy_upstream_name "-";
+
+ # PEM sha: 40b129b5f855c4ed2f78d7f94afca9dbf0382de6
+ ssl_certificate /etc/ingress-controller/ssl/default-fake-certificate.pem;
+ ssl_certificate_key /etc/ingress-controller/ssl/default-fake-certificate.pem;
+
+ ssl_certificate_by_lua_block {
+ certificate.call()
+ }
+
+ location / {
+
+ set $namespace "";
+ set $ingress_name "";
+ set $service_name "";
+ set $service_port "{0 0 }";
+ set $location_path "/";
+
+ rewrite_by_lua_block {
+ lua_ingress.rewrite({
+ force_ssl_redirect = false,
+ use_port_in_redirects = false,
+ })
+ balancer.rewrite()
+ plugins.run()
+ }
+
+ header_filter_by_lua_block {
+
+ plugins.run()
+ }
+ body_filter_by_lua_block {
+
+ }
+
+ log_by_lua_block {
+
+ balancer.log()
+
+ monitor.call()
+
+ plugins.run()
+ }
+
+ access_log off;
+
+ port_in_redirect off;
+
+ set $balancer_ewma_score -1;
+ set $proxy_upstream_name "upstream-default-backend";
+ set $proxy_host $proxy_upstream_name;
+ set $pass_access_scheme $scheme;
+ set $pass_server_port $server_port;
+ set $best_http_host $http_host;
+ set $pass_port $pass_server_port;
+
+ set $proxy_alternative_upstream_name "";
+
+ client_max_body_size 1m;
+
+ proxy_set_header Host $best_http_host;
+
+ # Pass the extracted client certificate to the backend
+
+ # Allow websocket connections
+ proxy_set_header Upgrade $http_upgrade;
+
+ proxy_set_header Connection $connection_upgrade;
+
+ proxy_set_header X-Request-ID $req_id;
+ proxy_set_header X-Real-IP $the_real_ip;
+
+ proxy_set_header X-Forwarded-For $the_real_ip;
+
+ proxy_set_header X-Forwarded-Host $best_http_host;
+ proxy_set_header X-Forwarded-Port $pass_port;
+ proxy_set_header X-Forwarded-Proto $pass_access_scheme;
+
+ proxy_set_header X-Original-URI $request_uri;
+
+ proxy_set_header X-Scheme $pass_access_scheme;
+
+ # Pass the original X-Forwarded-For
+ proxy_set_header X-Original-Forwarded-For $http_x_forwarded_for;
+
+ # mitigate HTTPoxy Vulnerability
+ # https://www.nginx.com/blog/mitigating-the-httpoxy-vulnerability-with-nginx/
+ proxy_set_header Proxy "";
+
+ # Custom headers to proxied server
+
+ proxy_connect_timeout 5s;
+ proxy_send_timeout 60s;
+ proxy_read_timeout 60s;
+
+ proxy_buffering off;
+ proxy_buffer_size 4k;
+ proxy_buffers 4 4k;
+ proxy_request_buffering on;
+ proxy_http_version 1.1;
+
+ proxy_cookie_domain off;
+ proxy_cookie_path off;
+
+ # In case of errors try the next upstream server before returning an error
+ proxy_next_upstream error timeout;
+ proxy_next_upstream_timeout 0;
+ proxy_next_upstream_tries 3;
+
+ proxy_pass http://upstream_balancer;
+
+ proxy_redirect off;
+
+ }
+
+ # health checks in cloud providers require the use of port 80
+ location /healthz {
+
+ access_log off;
+ return 200;
+ }
+
+ # this is required to avoid error if nginx is being monitored
+ # with an external software (like sysdig)
+ location /nginx_status {
+
+ allow 127.0.0.1;
+
+ deny all;
+
+ access_log off;
+ stub_status on;
+ }
+
+ }
+ ## end server _
+
+ ## start server product.internal.domain
+ server {
+ server_name product.internal.domain ;
+
+ listen 80 ;
+ listen 443 ssl http2 ;
+
+ set $proxy_upstream_name "-";
+
+ # PEM sha: 40b129b5f855c4ed2f78d7f94afca9dbf0382de6
+ ssl_certificate /etc/ingress-controller/ssl/default-fake-certificate.pem;
+ ssl_certificate_key /etc/ingress-controller/ssl/default-fake-certificate.pem;
+
+ ssl_certificate_by_lua_block {
+ certificate.call()
+ }
+
+ # PEM sha: c7993d0454004c693dcc326d6444ef14ba90f662
+ ssl_client_certificate /etc/ingress-controller/ssl/ca-kube-system-sso-ca.pem;
+ ssl_verify_client on;
+ ssl_verify_depth 10;
+
+ location / {
+
+ set $namespace "default";
+ set $ingress_name "my-product";
+ set $service_name "my-product";
+ set $service_port "{0 30003 }";
+ set $location_path "/";
+
+ rewrite_by_lua_block {
+ lua_ingress.rewrite({
+ force_ssl_redirect = true,
+ use_port_in_redirects = false,
+ })
+ balancer.rewrite()
+ plugins.run()
+ }
+
+ header_filter_by_lua_block {
+
+ plugins.run()
+ }
+ body_filter_by_lua_block {
+
+ }
+
+ log_by_lua_block {
+
+ balancer.log()
+
+ monitor.call()
+
+ plugins.run()
+ }
+
+ port_in_redirect off;
+
+ set $balancer_ewma_score -1;
+ set $proxy_upstream_name "default-my-product-30003";
+ set $proxy_host $proxy_upstream_name;
+ set $pass_access_scheme $scheme;
+ set $pass_server_port $server_port;
+ set $best_http_host $http_host;
+ set $pass_port $pass_server_port;
+
+ set $proxy_alternative_upstream_name "";
+
+ client_max_body_size 1m;
+
+ proxy_set_header Host $best_http_host;
+
+ # Pass the extracted client certificate to the backend
+
+ proxy_set_header ssl-client-verify $ssl_client_verify;
+ proxy_set_header ssl-client-subject-dn $ssl_client_s_dn;
+ proxy_set_header ssl-client-issuer-dn $ssl_client_i_dn;
+
+ # Allow websocket connections
+ proxy_set_header Upgrade $http_upgrade;
+
+ proxy_set_header Connection $connection_upgrade;
+
+ proxy_set_header X-Request-ID $req_id;
+ proxy_set_header X-Real-IP $the_real_ip;
+
+ proxy_set_header X-Forwarded-For $the_real_ip;
+
+ proxy_set_header X-Forwarded-Host $best_http_host;
+ proxy_set_header X-Forwarded-Port $pass_port;
+ proxy_set_header X-Forwarded-Proto $pass_access_scheme;
+
+ proxy_set_header X-Original-URI $request_uri;
+
+ proxy_set_header X-Scheme $pass_access_scheme;
+
+ # Pass the original X-Forwarded-For
+ proxy_set_header X-Original-Forwarded-For $http_x_forwarded_for;
+
+ # mitigate HTTPoxy Vulnerability
+ # https://www.nginx.com/blog/mitigating-the-httpoxy-vulnerability-with-nginx/
+ proxy_set_header Proxy "";
+
+ # Custom headers to proxied server
+
+ proxy_connect_timeout 5s;
+ proxy_send_timeout 60s;
+ proxy_read_timeout 60s;
+
+ proxy_buffering off;
+ proxy_buffer_size 4k;
+ proxy_buffers 4 4k;
+ proxy_request_buffering on;
+ proxy_http_version 1.1;
+
+ proxy_cookie_domain off;
+ proxy_cookie_path off;
+
+ # In case of errors try the next upstream server before returning an error
+ proxy_next_upstream error timeout;
+ proxy_next_upstream_timeout 0;
+ proxy_next_upstream_tries 3;
+
+ proxy_pass http://upstream_balancer;
+
+ proxy_redirect off;
+
+ }
+
+ }
+ ## end server product.internal.domain
+
+ # backend for when default-backend-service is not configured or it does not have endpoints
+ server {
+ listen 8181 default_server reuseport backlog=511;
+
+ set $proxy_upstream_name "internal";
+
+ access_log off;
+
+ location / {
+ return 404;
+ }
+ }
+
+ # default server, used for NGINX healthcheck and access to nginx stats
+ server {
+ listen unix:/tmp/nginx-status-server.sock;
+ set $proxy_upstream_name "internal";
+
+ keepalive_timeout 0;
+ gzip off;
+
+ access_log off;
+
+ location /healthz {
+ return 200;
+ }
+
+ location /is-dynamic-lb-initialized {
+ content_by_lua_block {
+ local configuration = require("configuration")
+ local backend_data = configuration.get_backends_data()
+ if not backend_data then
+ ngx.exit(ngx.HTTP_INTERNAL_SERVER_ERROR)
+ return
+ end
+
+ ngx.say("OK")
+ ngx.exit(ngx.HTTP_OK)
+ }
+ }
+
+ location /nginx_status {
+ stub_status on;
+ }
+
+ location /configuration {
+ # this should be equals to configuration_data dict
+ client_max_body_size 10m;
+ client_body_buffer_size 10m;
+ proxy_buffering off;
+
+ content_by_lua_block {
+ configuration.call()
+ }
+ }
+
+ location / {
+ content_by_lua_block {
+ ngx.exit(ngx.HTTP_NOT_FOUND)
+ }
+ }
+ }
+}
+
+stream {
+ lua_package_cpath "/usr/local/lib/lua/?.so;/usr/lib/lua-platform-path/lua/5.1/?.so;;";
+ lua_package_path "/etc/nginx/lua/?.lua;/etc/nginx/lua/vendor/?.lua;/usr/local/lib/lua/?.lua;;";
+
+ lua_shared_dict tcp_udp_configuration_data 5M;
+
+ init_by_lua_block {
+ collectgarbage("collect")
+
+ -- init modules
+ local ok, res
+
+ ok, res = pcall(require, "configuration")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ configuration = res
+ end
+
+ ok, res = pcall(require, "tcp_udp_configuration")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ tcp_udp_configuration = res
+ end
+
+ ok, res = pcall(require, "tcp_udp_balancer")
+ if not ok then
+ error("require failed: " .. tostring(res))
+ else
+ tcp_udp_balancer = res
+ end
+ }
+
+ init_worker_by_lua_block {
+ tcp_udp_balancer.init_worker()
+ }
+
+ lua_add_variable $proxy_upstream_name;
+
+ log_format log_stream [$time_local] $protocol $status $bytes_sent $bytes_received $session_time;
+
+ access_log /var/log/nginx/access.log log_stream ;
+
+ error_log /var/log/nginx/error.log;
+
+ upstream upstream_balancer {
+ server 0.0.0.1:1234; # placeholder
+
+ balancer_by_lua_block {
+ tcp_udp_balancer.balance()
+ }
+ }
+
+ server {
+ listen unix:/tmp/ingress-stream.sock;
+
+ access_log off;
+
+ content_by_lua_block {
+ tcp_udp_configuration.call()
+ }
+ }
+
+ # TCP services
+
+ # UDP services
+
+}
+
I0909 18:52:04.438857 8 controller.go:149] Backend successfully reloaded.
I0909 18:52:04.438897 8 controller.go:158] Initial sync, sleeping for 1 second.
I0909 18:52:05.440481 8 controller.go:172] Dynamic reconfiguration succeeded.
I0909 18:52:08.142456 8 nginx_status.go:168] start scraping socket: /nginx_status
I0909 18:52:08.142944 8 socket.go:344] removing ingresses [] from metrics
I0909 18:52:08.143135 8 nginx_status.go:168] start scraping socket: /nginx_status
I0909 18:52:08.178138 8 queue.go:128] syncing management/postgresql
I0909 18:52:08.178319 8 controller.go:740] Creating upstream "default-my-product-30003"
I0909 18:52:08.178337 8 controller.go:845] Obtaining ports information for Service "default/my-product"
I0909 18:52:08.178346 8 endpoints.go:93] Getting Endpoints for Service "default/my-product" and port &ServicePort{Name:default-code-prod,Protocol:TCP,Port:30003,TargetPort:30003,NodePort:0,}
I0909 18:52:08.178364 8 endpoints.go:136] Endpoints found for Service "default/my-product": [{10.96.131.102 30003 nil} {10.96.189.52 30003 nil} {10.96.5.23 30003 nil} {10.96.5.232 30003 nil} {10.96.5.233 30003 nil} {10.96.5.24 30003 nil} {10.96.5.25 30003 nil} {10.96.5.26 30003 nil} {10.96.5.27 30003 nil} {10.96.5.32 30003 nil} {10.96.5.40 30003 nil} {10.96.5.41 30003 nil} {10.96.5.42 30003 nil} {10.98.20.59 30003 nil} {10.98.20.60 30003 nil}]
I0909 18:52:08.178434 8 controller.go:1094] Host "product.internal.domain" is listed in the TLS section but secretName is empty. Using default certificate.
I0909 18:52:08.178639 8 controller.go:515] Replacing location "/" for server "product.internal.domain" with upstream "upstream-default-backend" to use upstream "default-my-product-30003" (Ingress "default/my-product")
I0909 18:52:08.178699 8 controller.go:126] No configuration change detected, skipping backend reload.
I0909 18:52:08.178720 8 queue.go:122] skipping management/redis-slave sync (1568055128178131610 > 1568055124364896643)
I0909 18:52:08.178730 8 queue.go:122] skipping logging/kibana-kibana sync (1568055128178131610 > 1568055124364964735)
I0909 18:52:08.178734 8 queue.go:122] skipping kube-system/ingress-nginx-ingress-controller-metrics sync (1568055128178131610 > 1568055124365013008)
I0909 18:52:08.178739 8 queue.go:122] skipping kube-system/kubelet sync (1568055128178131610 > 1568055124365085205)
I0909 18:52:08.178743 8 queue.go:122] skipping kube-system/kube-dns sync (1568055128178131610 > 1568055124365166995)
I0909 18:52:08.178747 8 queue.go:122] skipping monitoring/influx-influxdb sync (1568055128178131610 > 1568055124365225874)
I0909 18:52:08.178751 8 queue.go:122] skipping default/kubernetes sync (1568055128178131610 > 1568055124365283392)
I0909 18:52:08.178774 8 queue.go:122] skipping kube-system/ingress-nginx-ingress-controller sync (1568055128178131610 > 1568055124365572511)
I0909 18:52:08.178779 8 queue.go:122] skipping management/redis-headless sync (1568055128178131610 > 1568055124365664278)
I0909 18:52:08.178783 8 queue.go:122] skipping kube-system/tiller-deploy sync (1568055128178131610 > 1568055124365774240)
I0909 18:52:08.178789 8 queue.go:122] skipping logging/elasticsearch-master-headless sync (1568055128178131610 > 1568055124366598511)
I0909 18:52:08.178793 8 queue.go:122] skipping monitoring/grafana sync (1568055128178131610 > 1568055124366686092)
I0909 18:52:08.178797 8 queue.go:122] skipping default/my-product sync (1568055128178131610 > 1568055124366757567)
I0909 18:52:08.178801 8 queue.go:122] skipping management/redis-master sync (1568055128178131610 > 1568055124366833746)
I0909 18:52:08.178805 8 queue.go:122] skipping monitoring/kuberhealthy sync (1568055128178131610 > 1568055124368390209)
I0909 18:52:08.178813 8 queue.go:122] skipping logging/elasticsearch-master sync (1568055128178131610 > 1568055124369042152)
I0909 18:52:08.178817 8 queue.go:122] skipping management/postgresql-headless sync (1568055128178131610 > 1568055124369203738)
I0909 18:52:08.178821 8 queue.go:122] skipping management/tiller-deploy sync (1568055128178131610 > 1568055124369297435)
I0909 18:52:08.178825 8 queue.go:122] skipping kube-system/ingress-nginx-ingress-controller-59958b8945-n97s6 sync (1568055128178131610 > 1568055124375601487)
I0909 18:52:08.178849 8 queue.go:128] syncing configmap-change
I0909 18:52:11.511774 8 controller.go:740] Creating upstream "default-my-product-30003"
I0909 18:52:11.511781 8 controller.go:845] Obtaining ports information for Service "default/my-product"
I0909 18:52:11.511793 8 endpoints.go:93] Getting Endpoints for Service "default/my-product" and port &ServicePort{Name:default-code-prod,Protocol:TCP,Port:30003,TargetPort:30003,NodePort:0,}
I0909 18:52:11.511819 8 endpoints.go:136] Endpoints found for Service "default/my-product": [{10.96.131.102 30003 nil} {10.96.189.52 30003 nil} {10.96.5.23 30003 nil} {10.96.5.232 30003 nil} {10.96.5.233 30003 nil} {10.96.5.24 30003 nil} {10.96.5.25 30003 nil} {10.96.5.26 30003 nil} {10.96.5.27 30003 nil} {10.96.5.32 30003 nil} {10.96.5.40 30003 nil} {10.96.5.41 30003 nil} {10.96.5.42 30003 nil} {10.98.20.59 30003 nil} {10.98.20.60 30003 nil}]
I0909 18:52:11.511861 8 controller.go:1094] Host "product.internal.domain" is listed in the TLS section but secretName is empty. Using default certificate.
I0909 18:52:11.511875 8 controller.go:515] Replacing location "/" for server "product.internal.domain" with upstream "upstream-default-backend" to use upstream "default-my-product-30003" (Ingress "default/my-product")
I0909 18:52:11.511918 8 controller.go:126] No configuration change detected, skipping backend reload.
I0909 18:52:11.511930 8 queue.go:122] skipping dummy/dummy sync (1568055128178846477 > 1568055124375892954)
I0909 18:52:11.511936 8 queue.go:122] skipping kube-system/ingress-nginx-ingress-controller-59958b8945-n97s6 sync (1568055128178846477 > 1568055124376077755)
I0909 18:52:11.511941 8 queue.go:122] skipping kube-system/ingress-nginx-ingress-controller sync (1568055128178846477 > 1568055124376237110)
I0909 18:52:11.511945 8 queue.go:122] skipping kube-system/ingress-nginx-ingress-controller-metrics sync (1568055128178846477 > 1568055124376297872)
I0909 18:52:11.511954 8 queue.go:122] skipping dummy/dummy sync (1568055128178846477 > 1568055124376430269)
I0909 18:52:11.511958 8 queue.go:122] skipping default/my-product sync (1568055128178846477 > 1568055124376488663)
I0909 18:52:12.812410 8 nginx.go:373] Event UPDATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-metrics,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller-metrics,UID:d13bea76-17e1-44be-a7c2-8607bdd92271,ResourceVersion:87705,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:12Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.4.231 0xc00044c010 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87704,FieldPath:,}}] [] [{metrics 10254 TCP}]}],}
I0909 18:52:12.812500 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller-metrics,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller-metrics,UID:d13bea76-17e1-44be-a7c2-8607bdd92271,ResourceVersion:87705,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:12Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.4.231 0xc00044c010 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87704,FieldPath:,}}] [] [{metrics 10254 TCP}]}],}
I0909 18:52:12.812542 8 queue.go:128] syncing kube-system/ingress-nginx-ingress-controller-metrics
I0909 18:52:12.813719 8 nginx.go:373] Event UPDATE received - object &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller,UID:88972a13-bd36-4842-baa9-6e738923d5af,ResourceVersion:87707,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:12Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.4.231 0xc00044c550 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87704,FieldPath:,}}] [] [{http 80 TCP} {https 443 TCP}]}],}
I0909 18:52:12.813787 8 queue.go:87] queuing item &Endpoints{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ingress-nginx-ingress-controller,GenerateName:,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/endpoints/ingress-nginx-ingress-controller,UID:88972a13-bd36-4842-baa9-6e738923d5af,ResourceVersion:87707,Generation:0,CreationTimestamp:2019-09-09 09:54:29 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: nginx-ingress,chart: nginx-ingress-1.19.1,component: controller,heritage: Tiller,release: ingress,},Annotations:map[string]string{endpoints.kubernetes.io/last-change-trigger-time: 2019-09-09T18:52:12Z,},OwnerReferences:[],Finalizers:[],ClusterName:,ManagedFields:[],},Subsets:[{[{100.101.4.231 0xc00044c550 ObjectReference{Kind:Pod,Namespace:kube-system,Name:ingress-nginx-ingress-controller-59958b8945-n97s6,UID:5a836873-6f23-4d3b-a94e-9bca8814b08a,APIVersion:,ResourceVersion:87704,FieldPath:,}}] [] [{http 80 TCP} {https 443 TCP}]}],}
10.180.100.28 - [10.180.100.28] - - [09/Sep/2019:18:52:14 +0000] "GET / HTTP/2.0" 400 221 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:69.0) Gecko/20100101 Firefox/69.0" 221 0.000 [] [] - - - - 574fbb05dec4ddf1a7e33b3bf7e40ae7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment