Skip to content

Instantly share code, notes, and snippets.

@devilankur18

devilankur18/services-status.md

Last active August 29, 2015 14:25
Show Gist options
  • Save devilankur18/e0a401e96d1413edcbc6 to your computer and use it in GitHub Desktop.
Save devilankur18/e0a401e96d1413edcbc6 to your computer and use it in GitHub Desktop.
Download ZIP
coreos multinode cluster errors
Raw
services-status.md 
$fleetctl list-machines
MACHINE   IP    METADATA
0f61935f... 128.199.80.59 role=node
c225ca77... 128.199.188.212 role=master
core@master /etc/systemd/system $ sudo systemctl status *
● flanneld.service.d.service
   Loaded: not-found (Reason: No such file or directory)
   Active: inactive (dead)

● generate-serviceaccount-key.service - Generate service-account key file
   Loaded: loaded (/etc/systemd/system/generate-serviceaccount-key.service; static; vendor preset: disabled)
   Active: active (exited) since Wed 2015-07-22 17:26:42 UTC; 3h 50min ago
  Process: 600 ExecStart=/bin/openssl genrsa -out /opt/bin/kube-serviceaccount.key 2048 2>/dev/null (code=exited, status=0/SUCCESS)
  Process: 598 ExecStartPre=/usr/bin/mkdir -p /opt/bin (code=exited, status=0/SUCCESS)
 Main PID: 600 (code=exited, status=0/SUCCESS)
   Memory: 0B
      CPU: 0
   CGroup: /system.slice/generate-serviceaccount-key.service

Jul 22 17:26:42 master systemd[1]: Starting Generate service-account key file...
Jul 22 17:26:42 master openssl[600]: Generating RSA private key, 2048 bit long modulus
Jul 22 17:26:42 master openssl[600]: ......+++
Jul 22 17:26:42 master openssl[600]: ........................................................+++
Jul 22 17:26:42 master openssl[600]: unable to write 'random state'
Jul 22 17:26:42 master openssl[600]: e is 65537 (0x10001)
Jul 22 17:26:42 master systemd[1]: Started Generate service-account key file.

● kube-apiserver.service - Kubernetes API Server
   Loaded: loaded (/etc/systemd/system/kube-apiserver.service; static; vendor preset: disabled)
   Active: active (running) since Wed 2015-07-22 17:27:30 UTC; 3h 49min ago
     Docs: https://github.com/GoogleCloudPlatform/kubernetes
  Process: 742 ExecStartPre=/opt/bin/wupiao 127.0.0.1:2379/v2/machines (code=exited, status=0/SUCCESS)
  Process: 738 ExecStartPre=/usr/bin/chmod +x /opt/bin/kube-apiserver (code=exited, status=0/SUCCESS)
  Process: 675 ExecStartPre=/usr/bin/curl -L -o /opt/bin/kube-apiserver -z /opt/bin/kube-apiserver https://storage.googleapis.com/kubernetes-release/release/v0.19.3/bin/linux/amd64/kube-apiserver (code=exited, status=0/SUCCESS)
  Process: 673 ExecStartPre=/usr/bin/mkdir -p /opt/bin (code=exited, status=0/SUCCESS)
 Main PID: 745 (kube-apiserver)
   Memory: 47.1M
      CPU: 1min 4.583s
   CGroup: /system.slice/kube-apiserver.service
           └─745 /opt/bin/kube-apiserver --service_account_key_file=/opt/bin/kube-serviceaccount.key --service_account_lookup=false --admission_control=NamespaceLifecycle,NamespaceAutoProvision,LimitRanger,SecurityContextDeny,ServiceAc...

Jul 22 21:16:38 master kube-apiserver[745]: W0722 21:16:38.436365     745 controller.go:203] Resetting endpoints for master service "kubernetes" to &{{ } {kubernetes  default    0001-01-01 00:00:00 +0000 UTC <nil> map[... [{ 6443 TCP}]}]}
Jul 22 21:16:38 master kube-apiserver[745]: E0722 21:16:38.437302     745 controller.go:95] unable to sync kubernetes service: Endpoints "kubernetes" is invalid: subsets[0].addresses[0].ip: invalid value '169.254.91.15... (169.254.0.0/16)
Jul 22 21:16:48 master kube-apiserver[745]: W0722 21:16:48.441382     745 controller.go:203] Resetting endpoints for master service "kubernetes" to &{{ } {kubernetes  default    0001-01-01 00:00:00 +0000 UTC <nil> map[... [{ 6443 TCP}]}]}
Jul 22 21:16:48 master kube-apiserver[745]: E0722 21:16:48.443949     745 controller.go:95] unable to sync kubernetes service: Endpoints "kubernetes" is invalid: subsets[0].addresses[0].ip: invalid value '169.254.91.15... (169.254.0.0/16)
Jul 22 21:16:58 master kube-apiserver[745]: W0722 21:16:58.447577     745 controller.go:203] Resetting endpoints for master service "kubernetes" to &{{ } {kubernetes  default    0001-01-01 00:00:00 +0000 UTC <nil> map[... [{ 6443 TCP}]}]}
Jul 22 21:16:58 master kube-apiserver[745]: E0722 21:16:58.449902     745 controller.go:95] unable to sync kubernetes service: Endpoints "kubernetes" is invalid: subsets[0].addresses[0].ip: invalid value '169.254.91.15... (169.254.0.0/16)
Jul 22 21:17:08 master kube-apiserver[745]: W0722 21:17:08.453983     745 controller.go:203] Resetting endpoints for master service "kubernetes" to &{{ } {kubernetes  default    0001-01-01 00:00:00 +0000 UTC <nil> map[... [{ 6443 TCP}]}]}
Jul 22 21:17:08 master kube-apiserver[745]: E0722 21:17:08.456519     745 controller.go:95] unable to sync kubernetes service: Endpoints "kubernetes" is invalid: subsets[0].addresses[0].ip: invalid value '169.254.91.15... (169.254.0.0/16)
Jul 22 21:17:18 master kube-apiserver[745]: W0722 21:17:18.459210     745 controller.go:203] Resetting endpoints for master service "kubernetes" to &{{ } {kubernetes  default    0001-01-01 00:00:00 +0000 UTC <nil> map[... [{ 6443 TCP}]}]}
Jul 22 21:17:18 master kube-apiserver[745]: E0722 21:17:18.460349     745 controller.go:95] unable to sync kubernetes service: Endpoints "kubernetes" is invalid: subsets[0].addresses[0].ip: invalid value '169.254.91.15... (169.254.0.0/16)

● kube-controller-manager.service - Kubernetes Controller Manager
   Loaded: loaded (/etc/systemd/system/kube-controller-manager.service; static; vendor preset: disabled)
   Active: active (running) since Wed 2015-07-22 17:27:32 UTC; 3h 49min ago
     Docs: https://github.com/GoogleCloudPlatform/kubernetes
  Process: 753 ExecStartPre=/usr/bin/chmod +x /opt/bin/kube-controller-manager (code=exited, status=0/SUCCESS)
  Process: 751 ExecStartPre=/usr/bin/curl -L -o /opt/bin/kube-controller-manager -z /opt/bin/kube-controller-manager https://storage.googleapis.com/kubernetes-release/release/v0.19.3/bin/linux/amd64/kube-controller-manager (code=exited, status=0/SUCCESS)
 Main PID: 757 (kube-controller)
   Memory: 13.3M
      CPU: 53.313s
   CGroup: /system.slice/kube-controller-manager.service
           └─757 /opt/bin/kube-controller-manager --service_account_private_key_file=/opt/bin/kube-serviceaccount.key --master=127.0.0.1:8080 --logtostderr=true

Jul 22 20:56:32 master kube-controller-manager[757]: W0722 20:56:32.501567     757 request.go:302] field selector: v1 - secrets - type - kubernetes.io/service-account-token: need to check if this is versioned correctly.
Jul 22 20:56:32 master kube-controller-manager[757]: W0722 20:56:32.505055     757 request.go:302] field selector: v1 - secrets - type - kubernetes.io/service-account-token: need to check if this is versioned correctly.
Jul 22 20:59:29 master kube-controller-manager[757]: W0722 20:59:29.530417     757 request.go:302] field selector: v1 - serviceAccounts - metadata.name - default: need to check if this is versioned correctly.
Jul 22 20:59:29 master kube-controller-manager[757]: E0722 20:59:29.537439     757 reflector.go:183] watch of *api.ServiceAccount ended with: 401: The event in requested index is outdated and cleared (the requested hist.../10414]) [13213]
Jul 22 20:59:30 master kube-controller-manager[757]: W0722 20:59:30.537683     757 request.go:302] field selector: v1 - serviceAccounts - metadata.name - default: need to check if this is versioned correctly.
Jul 22 20:59:30 master kube-controller-manager[757]: W0722 20:59:30.540228     757 request.go:302] field selector: v1 - serviceAccounts - metadata.name - default: need to check if this is versioned correctly.
Jul 22 21:00:05 master kube-controller-manager[757]: I0722 21:00:05.435242     757 event.go:203] Event(api.ObjectReference{Kind:"Node", Namespace:"", Name:"169.254.31.190", UID:"169.254.31.190", APIVersion:"", ResourceV...ow: NodeNotReady
Jul 22 21:04:02 master kube-controller-manager[757]: I0722 21:04:02.146933     757 event.go:203] Event(api.ObjectReference{Kind:"ReplicationController", Namespace:"default", Name:"my-nginx", UID:"587fa4b5-30af-11e5-98da...: my-nginx-t0xs9
Jul 22 21:04:02 master kube-controller-manager[757]: I0722 21:04:02.164553     757 event.go:203] Event(api.ObjectReference{Kind:"ReplicationController", Namespace:"default", Name:"my-nginx", UID:"587fa4b5-30af-11e5-98da...: my-nginx-uawww
Jul 22 21:15:10 master kube-controller-manager[757]: E0722 21:15:10.498857     757 reflector.go:183] watch of *api.Namespace ended with: 401: The event in requested index is outdated and cleared (the requested history h.../10926]) [14355]

● kube-scheduler.service - Kubernetes Scheduler
   Loaded: loaded (/etc/systemd/system/kube-scheduler.service; static; vendor preset: disabled)
   Active: active (running) since Wed 2015-07-22 17:27:34 UTC; 3h 49min ago
     Docs: https://github.com/GoogleCloudPlatform/kubernetes
  Process: 793 ExecStartPre=/usr/bin/chmod +x /opt/bin/kube-scheduler (code=exited, status=0/SUCCESS)
  Process: 760 ExecStartPre=/usr/bin/curl -L -o /opt/bin/kube-scheduler -z /opt/bin/kube-scheduler https://storage.googleapis.com/kubernetes-release/release/v0.19.3/bin/linux/amd64/kube-scheduler (code=exited, status=0/SUCCESS)
 Main PID: 797 (kube-scheduler)
   Memory: 7.8M
      CPU: 42.735s
   CGroup: /system.slice/kube-scheduler.service
           └─797 /opt/bin/kube-scheduler --master=127.0.0.1:8080

Jul 22 20:35:38 master kube-scheduler[797]: E0722 20:35:38.304471     797 reflector.go:183] watch of *api.Service ended with: 401: The event in requested index is outdated and cleared (the requested history has been cl...56/8304]) [11555]
Jul 22 20:54:29 master kube-scheduler[797]: W0722 20:54:29.288090     797 request.go:302] field selector: v1 - nodes - spec.unschedulable - false: need to check if this is versioned correctly.
Jul 22 20:57:18 master kube-scheduler[797]: W0722 20:57:18.339090     797 request.go:302] field selector: v1 - pods - spec.host - : need to check if this is versioned correctly.
Jul 22 20:57:18 master kube-scheduler[797]: E0722 20:57:18.344431     797 reflector.go:183] watch of *api.Pod ended with: 401: The event in requested index is outdated and cleared (the requested history has been cleare...7/10730]) [13056]
Jul 22 20:57:19 master kube-scheduler[797]: W0722 20:57:19.344674     797 request.go:302] field selector: v1 - pods - spec.host - : need to check if this is versioned correctly.
Jul 22 20:57:19 master kube-scheduler[797]: W0722 20:57:19.349485     797 request.go:302] field selector: v1 - pods - spec.host - : need to check if this is versioned correctly.
Jul 22 21:04:02 master kube-scheduler[797]: I0722 21:04:02.181953     797 event.go:203] Event(api.ObjectReference{Kind:"Pod", Namespace:"default", Name:"my-nginx-t0xs9", UID:"2dde281c-30b5-11e5-98da-04015f6d5701", APIVersion:"v1", Reso...
Jul 22 21:04:02 master kube-scheduler[797]: I0722 21:04:02.195931     797 event.go:203] Event(api.ObjectReference{Kind:"Pod", Namespace:"default", Name:"my-nginx-uawww", UID:"2dde08dd-30b5-11e5-98da-04015f6d5701", APIVersion:"v1", Reso...
Jul 22 21:05:31 master kube-scheduler[797]: W0722 21:05:31.316939     797 request.go:302] field selector: v1 - pods - spec.host - : need to check if this is versioned correctly.
Jul 22 21:16:23 master kube-scheduler[797]: E0722 21:16:23.311039     797 reflector.go:183] watch of *api.Service ended with: 401: The event in requested index is outdated and cleared (the requested history has been cl...0/12878]) [14439]

● setup-network-environment.service - Setup Network Environment
   Loaded: loaded (/etc/systemd/system/setup-network-environment.service; static; vendor preset: disabled)
   Active: active (exited) since Wed 2015-07-22 17:27:28 UTC; 3h 49min ago
     Docs: https://github.com/kelseyhightower/setup-network-environment
  Process: 624 ExecStart=/opt/bin/setup-network-environment (code=exited, status=0/SUCCESS)
  Process: 621 ExecStartPre=/usr/bin/chmod +x /opt/bin/setup-network-environment (code=exited, status=0/SUCCESS)
  Process: 606 ExecStartPre=/usr/bin/curl -L -o /opt/bin/setup-network-environment -z /opt/bin/setup-network-environment https://github.com/kelseyhightower/setup-network-environment/releases/download/v1.0.0/setup-network-environment (code=exited, status=0/SUCCESS)
  Process: 604 ExecStartPre=/usr/bin/mkdir -p /opt/bin (code=exited, status=0/SUCCESS)
 Main PID: 624 (code=exited, status=0/SUCCESS)
   Memory: 0B
      CPU: 0
   CGroup: /system.slice/setup-network-environment.service

Jul 22 17:26:42 master systemd[1]: Starting Setup Network Environment...
Jul 22 17:26:42 master curl[606]: Warning: Illegal date format for -z, --timecond (and not a file name).
Jul 22 17:26:42 master curl[606]: Warning: Disabling time condition. See curl_getdate(3) for valid date syntax.
Jul 22 17:26:47 master curl[606]: % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Jul 22 17:26:47 master curl[606]: Dload  Upload   Total   Spent    Left  Speed
Jul 22 17:27:13 master curl[606]: [293B blob data]
Jul 22 17:27:20 master curl[606]: [293B blob data]
Jul 22 17:27:28 master curl[606]: [293B blob data]
Jul 22 17:27:28 master systemd[1]: Started Setup Network Environment.
Hint: Some lines were ellipsized, use -l to show in full.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment