Skip to content

Instantly share code, notes, and snippets.

@jcrossley3
Created November 27, 2018 16:10
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jcrossley3/8702dae7b39320ebcd0dcbe84ed3798f to your computer and use it in GitHub Desktop.
Save jcrossley3/8702dae7b39320ebcd0dcbe84ed3798f to your computer and use it in GitHub Desktop.
[jim@localhost knative-operators]$ oc describe pod -n openshift-web-console webconsole-949868c96-dhjkz
Name: webconsole-949868c96-dhjkz
Namespace: openshift-web-console
Priority: 0
PriorityClassName: <none>
Node: localhost/192.168.122.6
Start Time: Tue, 27 Nov 2018 10:54:59 -0500
Labels: app=openshift-web-console
pod-template-hash=505424752
webconsole=true
Annotations: openshift.io/scc=anyuid
operator.openshift.io/force=c3cd4a83-f25c-11e8-9a61-0242ac110007
Status: Running
IP: 172.17.0.8
Controlled By: ReplicaSet/webconsole-949868c96
Containers:
webconsole:
Container ID: docker://6efc2a2803131c6a161d3244480dfd2d473f1a9cb8d9572e72871821d4cc993d
Image: openshift/origin-web-console:v3.11.0
Image ID: docker-pullable://docker.io/openshift/origin-web-console@sha256:20c14ce54de73b9203f03b7ee19f81769b9f404bb7dd81ed0ee4a1b8baecf6d1
Port: 8443/TCP
Host Port: 0/TCP
Command:
/usr/bin/origin-web-console
--audit-log-path=-
--config=/var/webconsole-config/webconsole-config.yaml
Args:
-v=0
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 255
Started: Tue, 27 Nov 2018 11:06:33 -0500
Finished: Tue, 27 Nov 2018 11:06:33 -0500
Ready: False
Restart Count: 8
Requests:
cpu: 100m
memory: 100Mi
Liveness: exec [/bin/sh -i -c if [[ ! -f /tmp/webconsole-config.hash ]]; then \
md5sum /var/webconsole-config/webconsole-config.yaml > /tmp/webconsole-config.hash; \
elif [[ $(md5sum /var/webconsole-config/webconsole-config.yaml) != $(cat /tmp/webconsole-config.hash) ]]; then \
exit 1; \
fi && curl -k -f https://0.0.0.0:8443/console/] delay=0s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get https://:8443/healthz delay=0s timeout=1s period=10s #success=1 #failure=3
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from webconsole-token-8r58d (ro)
/var/serving-cert from serving-cert (rw)
/var/webconsole-config from webconsole-config (rw)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
serving-cert:
Type: Secret (a volume populated by a Secret)
SecretName: webconsole-serving-cert
Optional: false
webconsole-config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: webconsole-config
Optional: false
webconsole-token-8r58d:
Type: Secret (a volume populated by a Secret)
SecretName: webconsole-token-8r58d
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/memory-pressure:NoSchedule
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 12m default-scheduler Successfully assigned openshift-web-console/webconsole-949868c96-dhjkz to localhost
Normal Created 12m kubelet, localhost Created container
Normal Started 12m kubelet, localhost Started container
Normal Pulled 12m (x2 over 12m) kubelet, localhost Container image "openshift/origin-web-console:v3.11.0" already present on machine
Normal Created 10m (x4 over 12m) kubelet, localhost Created container
Normal Started 10m (x4 over 12m) kubelet, localhost Started container
Normal Pulled 6m (x6 over 12m) kubelet, localhost Container image "openshift/origin-web-console:v3.11.0" already present on machine
Warning BackOff 1m (x53 over 11m) kubelet, localhost Back-off restarting failed container
[jim@localhost knative-operators]$ oc logs -n openshift-web-console webconsole-949868c96-dhjkz
W1127 16:06:33.361925 1 start.go:93] Warning: config.clusterInfo.loggingPublicURL: Invalid value: "": required to view aggregated container logs in the console, web console start will continue.
W1127 16:06:33.362068 1 start.go:93] Warning: config.clusterInfo.metricsPublicURL: Invalid value: "": required to view cluster metrics in the console, web console start will continue.
Error: unable to load server certificate: open /var/serving-cert/tls.crt: permission denied
Usage:
origin-web-console [flags]
Flags:
--alsologtostderr log to standard error as well as files
--audit-log-format string Format of saved audits. "legacy" indicates 1-line text format for each event. "json" indicates structured json format. Requires the 'AdvancedAuditing' feature gate. Known formats are legacy,json. (default "json")
--audit-log-maxage int The maximum number of days to retain old audit log files based on the timestamp encoded in their filename.
--audit-log-maxbackup int The maximum number of old audit log files to retain.
--audit-log-maxsize int The maximum size in megabytes of the audit log file before it gets rotated.
--audit-log-path string If set, all requests coming to the apiserver will be logged to this file. '-' means standard out.
--audit-policy-file string Path to the file that defines the audit policy configuration. Requires the 'AdvancedAuditing' feature gate. With AdvancedAuditing, a profile is required to enable auditing.
--audit-webhook-batch-buffer-size int The size of the buffer to store events before batching and sending to the webhook. Only used in batch mode. (default 10000)
--audit-webhook-batch-initial-backoff duration The amount of time to wait before retrying the first failed requests. Only used in batch mode. (default 10s)
--audit-webhook-batch-max-size int The maximum size of a batch sent to the webhook. Only used in batch mode. (default 400)
--audit-webhook-batch-max-wait duration The amount of time to wait before force sending the batch that hadn't reached the max size. Only used in batch mode. (default 30s)
--audit-webhook-batch-throttle-burst int Maximum number of requests sent at the same moment if ThrottleQPS was not utilized before. Only used in batch mode. (default 15)
--audit-webhook-batch-throttle-qps float32 Maximum average number of requests per second. Only used in batch mode. (default 10)
--audit-webhook-config-file string Path to a kubeconfig formatted file that defines the audit webhook configuration. Requires the 'AdvancedAuditing' feature gate.
--audit-webhook-mode string Strategy for sending audit events. Blocking indicates sending events should block server responses. Batch causes the webhook to buffer and send events asynchronously. Known modes are batch,blocking. (default "batch")
--config string filename containing the WebConsoleConfig
--contention-profiling Enable lock contention profiling, if profiling is enabled
--enable-swagger-ui Enables swagger ui on the apiserver at /swagger-ui
--log-flush-frequency duration Maximum number of seconds between log flushes (default 5s)
--log_backtrace_at traceLocation when logging hits line file:N, emit a stack trace (default :0)
--log_dir string If non-empty, write log files in this directory
--logtostderr log to standard error instead of files (default true)
--profiling Enable profiling via web interface host:port/debug/pprof/ (default true)
--stderrthreshold severity logs at or above this threshold go to stderr (default 2)
-v, --v Level log level for V logs
--vmodule moduleSpec comma-separated list of pattern=N settings for file-filtered logging
F1127 16:06:33.363990 1 console.go:35] unable to load server certificate: open /var/serving-cert/tls.crt: permission denied
[jim@localhost knative-operators]$ oc debug -n openshift-web-console webconsole-949868c96-dhjkz
Defaulting container name to webconsole.
Use 'oc describe pod/webconsole-949868c96-dhjkz-debug -n openshift-web-console' to see all of the containers in this pod.
Debugging with pod/webconsole-949868c96-dhjkz-debug, original command: /usr/bin/origin-web-console --audit-log-path=- --config=/var/webconsole-config/webconsole-config.yaml -v=0
Waiting for pod to start ...
If you don't see a command prompt, try pressing enter.
sh-4.2$ ls -laR /var/serving-cert
ls -laR /var/serving-cert
/var/serving-cert:
total 0
drwxrwxrwt. 3 root root 120 Nov 27 16:08 .
drwxr-xr-x. 1 root root 51 Nov 27 16:08 ..
drwxr-xr-x. 2 root root 80 Nov 27 16:08 ..2018_11_27_16_08_30.757458443
lrwxrwxrwx. 1 root root 31 Nov 27 16:08 ..data -> ..2018_11_27_16_08_30.757458443
lrwxrwxrwx. 1 root root 14 Nov 27 16:08 tls.crt -> ..data/tls.crt
lrwxrwxrwx. 1 root root 14 Nov 27 16:08 tls.key -> ..data/tls.key
/var/serving-cert/..2018_11_27_16_08_30.757458443:
total 8
drwxr-xr-x. 2 root root 80 Nov 27 16:08 .
drwxrwxrwt. 3 root root 120 Nov 27 16:08 ..
-rw--w----. 1 root root 2469 Nov 27 16:08 tls.crt
-rw--w----. 1 root root 1679 Nov 27 16:08 tls.key
sh-4.2$ exit
exit
exit
Removing debug pod ...
[jim@localhost knative-operators]$ minishift config view
- cpus : 4
- disk-size : 50g
- image-caching : true
- memory : 8GB
- openshift-version : v3.11.0
[jim@localhost knative-operators]$
@SvenVD
Copy link

SvenVD commented Mar 27, 2019

I have the same problem, what did you do to fix it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment