Skip to content

Instantly share code, notes, and snippets.

@julia-stripe
Last active October 2, 2017 14:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save julia-stripe/55eac5af6f76043f7cb3c924b10aae21 to your computer and use it in GitHub Desktop.
Save julia-stripe/55eac5af6f76043f7cb3c924b10aae21 to your computer and use it in GitHub Desktop.
I1002 11:31:23.299897 1 leaderelection.go:204] successfully renewed lease kube-system/kube-scheduler
I1002 11:31:23.664068 1 reflector.go:405] external/com_github_kubernetes/plugin/cmd/kube-scheduler/app/server.go:100: Watch close - *v1.Pod total 6891 items received
I1002 11:31:23.669682 1 factory.go:511] About to try and schedule pod cronjob-verification-a-15067ttlqb
I1002 11:31:23.669690 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-verification-a-15067ttlqb
E1002 11:31:23.670027 1 scheduler.go:195] scheduler cache AssumePod failed: pod scheduled-tasks/cronjob-verification-a-15067ttlqb state wasn't initial but get assumed
E1002 11:31:23.670282 1 factory.go:659] Error scheduling scheduled-tasks cronjob-verification-a-15067ttlqb: pod scheduled-tasks/cronjob-verification-a-15067ttlqb state wasn't initial but get assumed; retrying
I1002 11:31:23.670314 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-verification-a-15067ttlqb to (PodScheduled==False)
I1002 11:31:23.670336 1 backoff_utils.go:77] Backing off 1s for pod &{backoff:2000000000 lastUpdate:{sec:63642540683 nsec:670322471 loc:0x8f08860} reqInFlight:1}
I1002 11:31:23.670553 1 event.go:218] Event(v1.ObjectReference{Kind:"Pod", Namespace:"scheduled-tasks", Name:"cronjob-verification-a-15067ttlqb", UID:"3430d93e-a765-11e7-a406-02708673f6f6", APIVersion:"v1", ResourceVersion:"174229102", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' AssumePod failed: pod scheduled-tasks/cronjob-verification-a- 15067ttlqb state wasn't initial but get assumed
I1002 11:31:23.673491 1 factory.go:511] About to try and schedule pod cronjob-threshold-sweeper-150672966f8v6r
I1002 11:31:23.673498 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-threshold-sweeper-150672966f8v6r
W1002 11:31:23.673950 1 cache.go:228] Pod scheduled-tasks/cronjob-threshold-sweeper-150672966f8v6r assumed to a different node than added to.
I1002 11:31:23.673964 1 factory.go:725] Attempting to bind cronjob-threshold-sweeper-150672966f8v6r to ip-10-68-24-97.us-west-2.compute.internal
I1002 11:31:23.673974 1 factory.go:511] About to try and schedule pod cronjob-alert-email-1506758400-wkzq0
I1002 11:31:23.673983 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-alert-email-1506758400-wkzq0
E1002 11:31:23.674303 1 scheduler.go:195] scheduler cache AssumePod failed: pod scheduled-tasks/cronjob-alert-email-1506758400-wkzq0 state wasn't initial but get assumed
E1002 11:31:23.674323 1 factory.go:659] Error scheduling scheduled-tasks cronjob-alert-email-1506758400-wkzq0: pod scheduled-tasks/cronjob-alert-email-1506758400-wkzq0 state wasn't initial but get assumed; retrying
I1002 11:31:23.674351 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-alert-email-1506758400-wkzq0 to (PodScheduled==False)
I1002 11:31:23.674476 1 backoff_utils.go:77] Backing off 1s for pod &{backoff:2000000000 lastUpdate:{sec:63642540683 nsec:674464124 loc:0x8f08860} reqInFlight:1}
I1002 11:31:23.674486 1 event.go:218] Event(v1.ObjectReference{Kind:"Pod", Namespace:"scheduled-tasks", Name:"cronjob-alert-email-1506758400-wkzq0", UID:"356506a8-a765-11e7-a406-02708673f6f6", APIVersion:"v1", ResourceVersion:"174229615", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' AssumePod failed: pod scheduled-tasks/cronjob-alert-email-1506758400-wkzq0 state wasn't initial but get assumed
I1002 11:31:23.676423 1 scheduler.go:233] Failed to bind pod: scheduled-tasks/cronjob-threshold-sweeper-150672966f8v6r
E1002 11:31:23.676429 1 scheduler.go:235] scheduler cache ForgetPod failed: pod scheduled-tasks/cronjob-threshold-sweeper-150672966f8v6r state wasn't assumed but get forgotten
E1002 11:31:23.676469 1 factory.go:659] Error scheduling scheduled-tasks cronjob-threshold-sweeper-150672966f8v6r: Operation cannot be fulfilled on pods/binding "cronjob-threshold-sweeper- 150672966f8v6r": pod cronjob-threshold-sweeper-150672966f8v6r is already assigned to node "ip-10-68-24-68.us-west-2.compute.internal"; retrying
I1002 11:31:23.676507 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-threshold-sweeper-150672966f8v6r to (PodScheduled==False)
E1002 11:31:23.676643 1 cache.go:263] Pod scheduled-tasks/cronjob-threshold-sweeper-150672966f8v6r updated on a different node than previously added to.
F1002 11:31:23.676658 1 cache.go:264] Schedulercache is corrupted and can badly affect scheduling decisions
I1001 16:26:20.945125 1 reflector.go:405] external/com_github_kubernetes/plugin/cmd/kube-scheduler/app/server.go:100: Watch close - *v1.Pod total 10187 items received
I1001 16:26:20.946989 1 factory.go:511] About to try and schedule pod cronjob-verification-help-1506693600-r0zcw
I1001 16:26:20.946996 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-verification-help-1506693600-r0zcw
E1001 16:26:20.947341 1 scheduler.go:195] scheduler cache AssumePod failed: pod scheduled-tasks/cronjob-verification-help-1506693600-r0zcw state wasn't initial but get assumed
E1001 16:26:20.947693 1 factory.go:659] Error scheduling scheduled-tasks cronjob-verification-help-1506693600-r0zcw: pod scheduled-tasks/cronjob-verification-help-1506693600-r0zcw state wasn't initial but get assumed; retrying
I1001 16:26:20.947727 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-verification-help-1506693600-r0zcw to (PodScheduled==False)
I1001 16:26:20.947816 1 backoff_utils.go:77] Backing off 1s for pod &{backoff:2000000000 lastUpdate:{sec:63642471980 nsec:947801925 loc:0x8f08860} reqInFlight:1}
I1001 16:26:20.947937 1 event.go:218] Event(v1.ObjectReference{Kind:"Pod", Namespace:"scheduled-tasks", Name:"cronjob-verification-help-1506693600-r0zcw", UID:"3c64dc0a-a6c5-11e7-a406-02708673f6f6", APIVersion:"v1", ResourceVersion:"159907722", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' AssumePod failed: pod scheduled-tasks/cronjob-verification-help-1506693600-r0zcw state wasn't initial but get assumed
I1001 16:26:20.949544 1 factory.go:511] About to try and schedule pod cronjob-misc-reaper-1506452040-rkvjm
I1001 16:26:20.949555 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-misc-reaper-1506452040-rkvjm
E1001 16:26:20.949853 1 scheduler.go:195] scheduler cache AssumePod failed: pod scheduled-tasks/cronjob-misc-reaper-1506452040-rkvjm state wasn't initial but get assumed
E1001 16:26:20.949868 1 factory.go:659] Error scheduling scheduled-tasks cronjob-misc-reaper-1506452040-rkvjm: pod scheduled-tasks/cronjob-misc-reaper-1506452040-rkvjm state wasn't initial but get assumed; retrying
I1001 16:26:20.949889 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-misc-reaper-1506452040-rkvjm to (PodScheduled==False)
I1001 16:26:20.950056 1 event.go:218] Event(v1.ObjectReference{Kind:"Pod", Namespace:"scheduled-tasks", Name:"cronjob-misc-reaper-1506452040-rkvjm", UID:"3cfafb05-a6c5-11e7-a406-02708673f6f6", APIVersion:"v1", ResourceVersion:"159907928", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' AssumePod failed: pod scheduled-tasks/cronjob-misc-reaper-1506452040-rkvjm state wasn't initial but get assumed
I1001 16:26:20.950052 1 backoff_utils.go:77] Backing off 1s for pod &{backoff:2000000000 lastUpdate:{sec:63642471980 nsec:950034180 loc:0x8f08860} reqInFlight:1}
I1001 16:26:20.956130 1 factory.go:511] About to try and schedule pod cronjob-internal-reviews-frida-15066rbgxk
I1001 16:26:20.956147 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-internal-reviews-frida-15066rbgxk
E1001 16:26:20.957109 1 scheduler.go:195] scheduler cache AssumePod failed: pod scheduled-tasks/cronjob-internal-reviews-frida-15066rbgxk state wasn't initial but get assumed
E1001 16:26:20.957134 1 factory.go:659] Error scheduling scheduled-tasks cronjob-internal-reviews-frida-15066rbgxk: pod scheduled-tasks/cronjob-internal-reviews-frida-15066rbgxk state wasn't initial but get assumed; retrying
I1001 16:26:20.957173 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-internal-reviews-frida-15066rbgxk to (PodScheduled==False)
I1001 16:26:20.957227 1 backoff_utils.go:77] Backing off 1s for pod &{backoff:2000000000 lastUpdate:{sec:63642471980 nsec:957206821 loc:0x8f08860} reqInFlight:1}
I1001 16:26:20.957388 1 event.go:218] Event(v1.ObjectReference{Kind:"Pod", Namespace:"scheduled-tasks", Name:"cronjob-internal-reviews-frida-15066rbgxk", UID:"3e525921-a6c5-11e7-a406-02708673f6f6", APIVersion:"v1", ResourceVersion:"159908195", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' AssumePod failed: pod scheduled-tasks/cronjob-internal-reviews-frida-15066rbgxk state wasn't initial but get assumed
I1001 16:26:20.972525 1 factory.go:511] About to try and schedule pod cronjob-move-tickets-1506693600-jnwgr
I1001 16:26:20.972542 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-move-tickets-1506693600-jnwgr
I1001 16:26:20.973056 1 factory.go:725] Attempting to bind cronjob-move-tickets-1506693600-jnwgr to ip-10-68-24-68.us-west-2.compute.internal
I1001 16:26:20.973263 1 factory.go:511] About to try and schedule pod cronjob-pending-verification-a-15067cqcgk
I1001 16:26:20.973270 1 scheduler.go:261] Attempting to schedule pod: scheduled-tasks/cronjob-pending-verification-a-15067cqcgk
I1001 16:26:20.973619 1 factory.go:725] Attempting to bind cronjob-pending-verification-a-15067cqcgk to ip-10-68-25-117.us-west-2.compute.internal
I1001 16:26:20.976650 1 scheduler.go:233] Failed to bind pod: scheduled-tasks/cronjob-move-tickets-1506693600-jnwgr
E1001 16:26:20.976672 1 factory.go:659] Error scheduling scheduled-tasks cronjob-move-tickets-1506693600-jnwgr: Operation cannot be fulfilled on pods/binding "cronjob-move-tickets-1506693600-jnwgr": pod cronjob-move-tickets-1506693600-jnwgr is already assigned to node "ip-10-68-26-81.us-west-2.compute.internal"; retrying
I1001 16:26:20.976727 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-move-tickets-1506693600-jnwgr to (PodScheduled==False)
I1001 16:26:20.976782 1 backoff_utils.go:77] Backing off 1s for pod &{backoff:2000000000 lastUpdate:{sec:63642471980 nsec:976757423 loc:0x8f08860} reqInFlight:1}
I1001 16:26:20.976908 1 event.go:218] Event(v1.ObjectReference{Kind:"Pod", Namespace:"scheduled-tasks", Name:"cronjob-move-tickets-1506693600-jnwgr", UID:"3e569b2c-a6c5-11e7-a406-02708673f6f6", APIVersion:"v1", ResourceVersion:"159908203", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' Binding rejected: Operation cannot be fulfilled on pods/binding "cronjob-move-tickets-1506693600-jnwgr": pod cronjob-move-tickets-1506693600-jnwgr is already assigned to node "ip-10-68-26-81.us-west-2.compute.internal"
I1001 16:26:20.977028 1 scheduler.go:233] Failed to bind pod: scheduled-tasks/cronjob-pending-verification-a-15067cqcgk
W1001 16:26:20.977036 1 cache.go:228] Pod scheduled-tasks/cronjob-pending-verification-a-15067cqcgk assumed to a different node than added to.
E1001 16:26:20.977055 1 scheduler.go:235] scheduler cache ForgetPod failed: pod scheduled-tasks/cronjob-pending-verification-a-15067cqcgk state wasn't assumed but get forgotten
E1001 16:26:20.977072 1 factory.go:659] Error scheduling scheduled-tasks cronjob-pending-verification-a-15067cqcgk: Operation cannot be fulfilled on pods/binding "cronjob-pending-verification-a-15067cqcgk": pod cronjob-pending-verification-a-15067cqcgk is already assigned to node "ip-10-68-24-68.us-west-2.compute.internal"; retrying
I1001 16:26:20.977181 1 factory.go:734] Updating pod condition for scheduled-tasks/cronjob-pending-verification-a-15067cqcgk to (PodScheduled==False)
I1001 16:26:20.977205 1 backoff_utils.go:77] Backing off 1s for pod &{backoff:2000000000 lastUpdate:{sec:63642471980 nsec:977186642 loc:0x8f08860} reqInFlight:1}
I1001 16:26:20.977373 1 event.go:218] Event(v1.ObjectReference{Kind:"Pod", Namespace:"scheduled-tasks", Name:"cronjob-pending-verification-a-15067cqcgk", UID:"3e5d4581-a6c5-11e7-a406-02708673f6f6", APIVersion:"v1", ResourceVersion:"159908207", FieldPath:""}): type: 'Warning' reason: 'FailedScheduling' Binding rejected: Operation cannot be fulfilled on pods/binding "cronjob-pending-verification-a-15067cqcgk": pod cronjob-pending-verification-a-15067cqcgk is already assigned to node "ip-10-68-24-68.us-west-2.compute.internal"
E1001 16:26:20.977462 1 cache.go:263] Pod scheduled-tasks/cronjob-pending-verification-a-15067cqcgk updated on a different node than previously added to.
F1001 16:26:20.977561 1 cache.go:264] Schedulercache is corrupted and can badly affect scheduling decisions
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment