Skip to content

Instantly share code, notes, and snippets.

@lukemarsden
Created March 23, 2021 14:45
Show Gist options
  • Save lukemarsden/3122960d1f3c768251e7265da66f9a49 to your computer and use it in GitHub Desktop.
Save lukemarsden/3122960d1f3c768251e7265da66f9a49 to your computer and use it in GitHub Desktop.
controller-0: 14:18:45 INFO juju.cmd running jujud [2.9-rc7 0 d2ad8833d051366ca4d392fa42da40fba506311e gc go1.14.15]
controller-0: 14:18:45 INFO juju.worker.upgradesteps upgrade steps for 2.9-rc7 have already been run.
controller-0: 14:18:45 INFO juju.state using client-side transactions
controller-0: 14:18:45 INFO juju.state starting standard state workers
controller-0: 14:18:45 INFO juju.state creating cloud image metadata storage
controller-0: 14:18:45 INFO juju.state started state for model-9a364618-ad44-4329-8238-9d9b7644ba21 successfully
controller-0: 14:18:45 INFO juju.cmd.jujud juju database opened
controller-0: 14:18:45 INFO juju.state using client-side transactions
controller-0: 14:18:45 INFO juju.state.allwatcher allwatcher loaded for model "9a364618-ad44-4329-8238-9d9b7644ba21" in 57.421562ms
controller-0: 14:18:45 INFO juju.state starting standard state workers
controller-0: 14:18:45 INFO juju.state creating cloud image metadata storage
controller-0: 14:18:45 INFO juju.state started state for model-9a364618-ad44-4329-8238-9d9b7644ba21 successfully
controller-0: 14:18:45 INFO juju.worker.httpserver listening on "[::]:17070"
controller-0: 14:18:46 ERROR juju.worker.dependency "api-caller" manifold worker returned unexpected error: [9a3646] "controller-0" cannot open api: unable to connect to API: dial tcp [::1]:17070: connect: cannot assign requested address
controller-0: 14:18:48 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:48 INFO juju.state using client-side transactions
controller-0: 14:18:48 INFO juju.state starting standard state workers
controller-0: 14:18:48 INFO juju.state creating cloud image metadata storage
controller-0: 14:18:48 INFO juju.state started state for model-0f017f83-1b8f-42bf-884f-4bbc0acabc3b successfully
controller-0: 14:18:48 INFO juju.state creating logs collection for 0f017f83-1b8f-42bf-884f-4bbc0acabc3b, capped at 20 MiB
controller-0: 14:18:48 INFO juju.state using client-side transactions
controller-0: 14:18:48 INFO juju.state starting standard state workers
controller-0: 14:18:48 INFO juju.state creating cloud image metadata storage
controller-0: 14:18:48 INFO juju.state started state for model-0f017f83-1b8f-42bf-884f-4bbc0acabc3b successfully
controller-0: 14:18:49 INFO juju.api connection established to "wss://localhost:17070/model/9a364618-ad44-4329-8238-9d9b7644ba21/api"
controller-0: 14:18:49 INFO juju.worker.apicaller [9a3646] "controller-0" successfully connected to "localhost:17070"
controller-0: 14:18:49 INFO juju.apiserver.common setting mongo password for "controller-0"
controller-0: 14:18:49 INFO juju.apiserver.common setting password for "controller-0"
controller-0: 14:18:50 INFO juju.worker.caasupgrader abort check blocked until version event received
controller-0: 14:18:50 INFO juju.worker.caasupgrader unblocking abort check
controller-0: 14:18:50 INFO juju.api connection established to "wss://localhost:17070/model/0f017f83-1b8f-42bf-884f-4bbc0acabc3b/api"
controller-0: 14:18:50 INFO juju.worker.migrationminion migration phase is now: NONE
controller-0: 14:18:50 INFO juju.worker.logger logger worker started
controller-0: 14:18:50 INFO juju.agent removing system identity file
controller-0: 14:18:50 INFO juju.api connection established to "wss://localhost:17070/model/9a364618-ad44-4329-8238-9d9b7644ba21/api"
controller-0: 14:18:50 WARNING juju.worker.proxyupdater unable to set snap core settings [proxy.http= proxy.https= proxy.store=]: exec: "snap": executable file not found in $PATH, output: ""
controller-0: 14:18:50 INFO juju.worker.apicaller [9a3646] "controller-0" successfully connected to "localhost:17070"
controller-0: 14:18:50 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:51 INFO juju.worker.raft.raftclusterer server "0" (Voter) address changed from "localhost" to "10.110.40.0:17070"
controller-0: 14:18:53 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:54 WARNING juju.core.raftlease response timeout waiting for Command(ver: 1, op: claim, ns: singular-controller, model: 9a3646, lease: 555d9e6e-ccf3-40ad-8e36-1c182ced657f, holder: controller-0) to be processed
controller-0: 14:18:55 WARNING juju.core.raftlease response timeout waiting for Command(ver: 1, op: claim, ns: singular-controller, model: 9a3646, lease: 9a364618-ad44-4329-8238-9d9b7644ba21, holder: controller-0) to be processed
controller-0: 14:18:55 WARNING juju.core.raftlease response timeout waiting for Command(ver: 1, op: claim, ns: singular-controller, model: 0f017f, lease: 0f017f83-1b8f-42bf-884f-4bbc0acabc3b, holder: controller-0) to be processed
controller-0: 14:18:55 INFO juju.worker.logforwarder config change - log forwarding not enabled
controller-0: 14:18:55 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:55 INFO juju.worker.logger logger worker started
controller-0: 14:18:55 INFO juju.worker.pruner.statushistory status history config: max age: 336h0m0s, max collection size 5120M for controller (9a364618-ad44-4329-8238-9d9b7644ba21)
controller-0: 14:18:55 INFO juju.worker.pruner.action status history config: max age: 336h0m0s, max collection size 5120M for controller (9a364618-ad44-4329-8238-9d9b7644ba21)
controller-0: 14:18:55 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:55 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:55 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:55 INFO juju.charmstore retrieving revision information for 1 charms
controller-0: 14:18:55 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:56 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:56 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:56 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:56 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:56 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:18:56 INFO juju.apiserver.common setting password for "model-9a364618-ad44-4329-8238-9d9b7644ba21"
controller-0: 14:18:56 INFO juju.apiserver.common setting password for "model-0f017f83-1b8f-42bf-884f-4bbc0acabc3b"
controller-0: 14:19:00 INFO juju.apiserver.common setting password for "application-admission-webhook"
controller-0: 14:19:04 INFO juju.apiserver.common setting password for "application-argo-controller"
controller-0: 14:19:05 INFO juju.apiserver.connection agent login: application-admission-webhook for 0f017f83-1b8f-42bf-884f-4bbc0acabc3b
controller-0: 14:19:05 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:10 INFO juju.apiserver.connection agent login: application-argo-controller for 0f017f83-1b8f-42bf-884f-4bbc0acabc3b
controller-0: 14:19:10 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:10 INFO juju.apiserver.common setting password for "application-argo-ui"
controller-0: 14:19:10 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:12 INFO juju.kubernetes.klog Throttling request took 1.037209794s, request: GET:https://10.96.0.1:443/apis/apps/v1/namespaces/kf/statefulsets/juju-operator-istio-ingressgateway
controller-0: 14:19:13 INFO juju.apiserver.connection agent login: application-argo-ui for 0f017f83-1b8f-42bf-884f-4bbc0acabc3b
controller-0: 14:19:13 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:15 INFO juju.apiserver.common setting password for "application-dex-auth"
controller-0: 14:19:19 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:19 INFO juju.kubernetes.provider ensuring custom resource definition "poddefaults.kubeflow.org" with version "v1beta1"
controller-0: 14:19:20 INFO juju.kubernetes.provider ensuring mutating webhook "kf-admission-webhook" with version "v1beta1"
controller-0: 14:19:20 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:20 INFO juju.apiserver.common setting password for "application-istio-ingressgateway"
controller-0: 14:19:23 INFO juju.apiserver.connection agent login: application-dex-auth for 0f017f83-1b8f-42bf-884f-4bbc0acabc3b
controller-0: 14:19:23 INFO juju.apiserver.connection agent disconnected: application-dex-auth for 0f017f83-1b8f-42bf-884f-4bbc0acabc3b
controller-0: 14:19:23 INFO juju.apiserver.connection agent login: application-dex-auth for 0f017f83-1b8f-42bf-884f-4bbc0acabc3b
controller-0: 14:19:23 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:24 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:24 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:25 INFO juju.kubernetes.klog Throttling request took 1.110022382s, request: GET:https://10.96.0.1:443/apis/apps/v1/namespaces/kf/statefulsets?labelSelector=app.kubernetes.io%2Fname%3Djupyter-web&limit=500&resourceVersion=0
controller-0: 14:19:26 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:28 INFO juju.apiserver.common setting password for "application-istio-pilot"
controller-0: 14:19:30 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:30 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:32 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:32 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:33 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:34 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:35 INFO juju.apiserver.common setting password for "application-jupyter-controller"
controller-0: 14:19:38 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:39 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:40 INFO juju.apiserver.common setting password for "application-jupyter-web"
controller-0: 14:19:44 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:46 INFO juju.apiserver.common setting password for "application-katib-controller"
controller-0: 14:19:48 INFO juju.apiserver.common setting password for "application-katib-db"
controller-0: 14:19:48 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:19:50 INFO juju.kubernetes.klog Throttling request took 1.059916012s, request: GET:https://10.96.0.1:443/api/v1/namespaces/kf/configmaps/katib-manager-operator-config
controller-0: 14:19:53 INFO juju.apiserver.common setting password for "application-katib-manager"
controller-0: 14:19:55 INFO juju.apiserver.common setting password for "application-katib-ui"
controller-0: 14:20:01 INFO juju.apiserver.common setting password for "application-kubeflow-dashboard"
controller-0: 14:20:03 INFO juju.apiserver.common setting password for "application-kubeflow-profiles"
controller-0: 14:20:05 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:05 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:10 INFO juju.apiserver.common setting password for "application-metadata-api"
controller-0: 14:20:16 INFO juju.apiserver.common setting password for "application-metadata-db"
controller-0: 14:20:18 INFO juju.apiserver.common setting password for "application-metadata-envoy"
controller-0: 14:20:20 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:20 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:23 INFO juju.apiserver.common setting password for "application-metadata-grpc"
controller-0: 14:20:24 INFO juju.kubernetes.provider ensuring custom resource definition "authcodes.dex.coreos.com" with version "v1beta1"
controller-0: 14:20:25 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:27 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:28 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:28 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:28 INFO juju.apiserver.common setting password for "application-metadata-ui"
controller-0: 14:20:29 INFO juju.kubernetes.klog Throttling request took 1.162735491s, request: GET:https://10.96.0.1:443/apis/apps/v1/namespaces/kf/statefulsets/juju-operator-dex-auth
controller-0: 14:20:30 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:34 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:20:37 INFO juju.apiserver.common setting password for "application-minio"
controller-0: 14:20:39 INFO juju.kubernetes.klog Throttling request took 1.456339018s, request: GET:https://10.96.0.1:443/apis/apps/v1/namespaces/kf/statefulsets/juju-operator-pipelines-scheduledworkflow
controller-0: 14:20:44 INFO juju.apiserver.common setting password for "application-oidc-gatekeeper"
controller-0: 14:20:49 INFO juju.kubernetes.klog Throttling request took 1.049211328s, request: GET:https://10.96.0.1:443/apis/apps/v1/namespaces/kf/statefulsets/juju-operator-pipelines-api
controller-0: 14:20:51 INFO juju.apiserver.common setting password for "application-pipelines-api"
controller-0: 14:20:58 INFO juju.apiserver.common setting password for "application-pipelines-db"
controller-0: 14:21:04 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:04 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:04 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:05 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:06 INFO juju.apiserver.common setting password for "application-pipelines-persistence"
controller-0: 14:21:06 INFO juju.apiserver.common setting password for "application-pipelines-scheduledworkflow"
controller-0: 14:21:11 INFO juju.apiserver.common setting password for "application-pipelines-ui"
controller-0: 14:21:11 INFO juju.apiserver.common setting password for "application-pipelines-viewer"
controller-0: 14:21:15 INFO juju.apiserver.common setting password for "application-pipelines-visualization"
controller-0: 14:21:19 INFO juju.apiserver.common setting password for "application-pytorch-operator"
controller-0: 14:21:19 INFO juju.apiserver.common setting password for "application-seldon-core"
controller-0: 14:21:24 INFO juju.apiserver.common setting password for "application-tf-job-operator"
controller-0: 14:21:43 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:46 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:48 INFO juju.charm charm is not versioned, charm path "/tmp/charm-download092615391/extracted"
controller-0: 14:21:51 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:51 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:51 INFO juju.apiserver.common setting password for "application-mlflow"
controller-0: 14:21:54 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:54 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:21:56 INFO juju.apiserver.common setting password for "application-mysql"
controller-0: 14:21:57 INFO juju.charm charm is not versioned, charm path "/tmp/charm-download163993384/extracted"
controller-0: 14:22:00 INFO juju.apiserver.common setting password for "application-prometheus"
controller-0: 14:22:03 INFO juju.apiserver.common setting password for "application-worker"
controller-0: 14:23:22 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:23:47 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:24:07 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:24:35 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:28:48 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:28:58 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:29:04 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:30:14 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:33:45 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:33:47 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:34:38 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:34:55 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:38:44 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:39:09 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:39:10 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:40:42 INFO juju.kubernetes.provider using in-cluster config
controller-0: 14:43:33 INFO juju.kubernetes.provider using in-cluster config
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment