Skip to content

Instantly share code, notes, and snippets.

@jbw976
Created May 2, 2017 20:13
Show Gist options
  • Save jbw976/eb3b5dc8c859d45f648c79533cfeab29 to your computer and use it in GitHub Desktop.
Save jbw976/eb3b5dc8c859d45f648c79533cfeab29 to your computer and use it in GitHub Desktop.
rook dynamic volume provisioner delete
2017-05-02 19:51:49.366554 I | cephmon: parsing mon endpoints: mon1=10.2.63.4:6790,mon2=10.2.63.5:6790,mon0=10.2.63.3:6790
2017-05-02 19:51:49.367385 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:51:49.450466 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:02.811481 I | api: 8a3fcc8c-6bf0-4372-94db-e7103cabe6e6 GET /pool GetPools (start)
2017-05-02 19:57:02.811668 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:02.816941 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:02.819468 I | api: 8a3fcc8c-6bf0-4372-94db-e7103cabe6e6 GET /pool GetPools 200 OK 7.98488ms
2017-05-02 19:57:02.820077 I | api: 35c1827a-50fc-4826-a82a-aa7a3bb98901 POST /pool CreatePool (start)
2017-05-02 19:57:02.821208 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:02.825245 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:04.078740 I | cephclient: creating pool replicapool succeeded, info: pool 'replicapool' created, buf:
2017-05-02 19:57:04.084427 I | api: 35c1827a-50fc-4826-a82a-aa7a3bb98901 POST /pool CreatePool 200 OK 1.264344687s
2017-05-02 19:57:07.363045 I | api: 89553dcb-c19f-419a-8026-ae847d294367 POST /image CreateImage (start)
2017-05-02 19:57:07.363280 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:07.368139 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:09.373871 I | api: 89553dcb-c19f-419a-8026-ae847d294367 POST /image CreateImage 200 OK 2.010823778s
2017-05-02 19:57:09.374256 I | api: 3b4a8b75-4749-40b1-8f12-6e3ed0a2add2 GET /client GetClientAccessInfo (start)
2017-05-02 19:57:09.375448 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:09.378970 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:09.381360 I | api: 3b4a8b75-4749-40b1-8f12-6e3ed0a2add2 GET /client GetClientAccessInfo 200 OK 7.103658ms
2017-05-02 19:57:14.787566 I | api: 6ec122fe-f211-4986-8f3f-6c208350e562 POST /image CreateImage (start)
2017-05-02 19:57:14.788751 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:14.792941 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:14.837065 I | api: 6ec122fe-f211-4986-8f3f-6c208350e562 POST /image CreateImage 200 OK 49.508563ms
2017-05-02 19:57:14.846335 I | api: c3bbda62-4e40-4337-8aae-631b7c9db913 GET /client GetClientAccessInfo (start)
2017-05-02 19:57:14.847079 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:14.856208 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:14.859198 I | api: c3bbda62-4e40-4337-8aae-631b7c9db913 GET /client GetClientAccessInfo 200 OK 12.860501ms
2017-05-02 20:01:45.019000 I | api: fe4d55da-ed01-4f7c-b746-539c330d0bcc GET /client GetClientAccessInfo (start)
2017-05-02 20:01:45.019413 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:01:45.024775 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:01:45.027524 I | api: fe4d55da-ed01-4f7c-b746-539c330d0bcc GET /client GetClientAccessInfo 200 OK 8.538099ms
2017-05-02 20:03:14.167254 I | api: 277b4792-db29-49a4-bfde-ee0dae2afe23 GET /image GetImages (start)
2017-05-02 20:03:14.167712 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:14.171964 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:14.196554 I | api: 277b4792-db29-49a4-bfde-ee0dae2afe23 GET /image GetImages 200 OK 29.30091ms
2017-05-02 20:03:22.110146 I | api: 8de93548-5d42-4c8e-bd4c-67af1b747d65 GET /status GetStatusDetails (start)
2017-05-02 20:03:22.110530 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:22.115350 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:22.117583 I | api: 8de93548-5d42-4c8e-bd4c-67af1b747d65 GET /status GetStatusDetails 200 OK 7.441867ms
2017-05-02 20:03:45.595698 I | api: 84385622-4e6b-4c74-a4cc-6cc733b442dc DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:03:45.596626 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:45.600331 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:45.649823 7f9d3bac1700 -1 librbd: image has watchers - not removing
2017-05-02 20:03:45.655336 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: Device or resource busy
2017-05-02 20:03:45.656999 I | api: 84385622-4e6b-4c74-a4cc-6cc733b442dc DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 61.299295ms
2017-05-02 20:03:48.849843 I | api: a1f94a5f-33b8-42bf-81c5-b97780ad5362 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:03:48.851113 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:48.854964 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:48.888852 d6ff240 -1 librbd: image has watchers - not removing
2017-05-02 20:03:48.891470 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: Device or resource busy
2017-05-02 20:03:48.894005 I | api: a1f94a5f-33b8-42bf-81c5-b97780ad5362 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 44.160808ms
2017-05-02 20:03:52.066626 I | api: c8eba1bf-47e6-4f53-8cfd-6e31a988ebab GET /pool GetPools (start)
2017-05-02 20:03:52.067676 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:52.071453 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:52.074804 I | api: c8eba1bf-47e6-4f53-8cfd-6e31a988ebab GET /pool GetPools 200 OK 8.17858ms
2017-05-02 20:03:59.256184 I | api: 82d8d3e0-1a3d-4388-b1e6-704f8a36399d DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:03:59.257237 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:59.260676 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:59.265184 I | api: b10ad346-788f-4072-a4e8-56b25f7038cd DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:03:59.265866 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:59.270194 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:59.288867 7f9d3bac1700 -1 librbd: image has watchers - not removing
2017-05-02 20:03:59.293680 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: Device or resource busy
2017-05-02 20:03:59.298320 I | api: 82d8d3e0-1a3d-4388-b1e6-704f8a36399d DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 42.135097ms
2017-05-02 20:04:07.343233 I | api: f158f431-b883-41b0-bcc5-78d834bb810b POST /filesystem CreateFileSystem (start)
2017-05-02 20:04:07.344400 I | cephmds: Creating file system registryFS
2017-05-02 20:04:07.344750 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:07.352355 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:08.272165 I | cephclient: creating pool registryFS-data succeeded, info: pool 'registryFS-data' created, buf:
2017-05-02 20:04:08.983415 I | cephclient: creating pool registryFS-metadata succeeded, info: pool 'registryFS-metadata' created, buf:
2017-05-02 20:04:09.049822 I | cephmds: created file system registryFS on data pool registryFS-data and metadata pool registryFS-metadata
2017-05-02 20:04:09.055671 I | api-k8s: Starting the MDS
2017-05-02 20:04:09.055671 I | op-mds: start running mds
2017-05-02 20:04:09.074229 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:09.084734 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:09.130154 E | api: failed to start mds: failed to create mds keyring. failed to get mds secrets. User "system:serviceaccount:rook:default" cannot get secrets in the namespace "rook". (get secrets mds)
2017-05-02 20:04:09.130263 I | api: f158f431-b883-41b0-bcc5-78d834bb810b POST /filesystem CreateFileSystem 500 Internal Server Error 1.787031175s
2017-05-02 20:04:14.019098 I | api: b10ad346-788f-4072-a4e8-56b25f7038cd DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 200 OK 14.753912446s
2017-05-02 20:04:14.257075 I | api: ec4c0225-9afc-4643-ba3a-7f5506b4b0d6 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:14.259068 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:14.275505 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:14.278363 I | api: 4c5b96dc-e21c-4dad-98fd-69be4af149c0 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:14.278669 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:14.286745 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:14.349273 7f9d3bac1700 -1 librbd: image has watchers - not removing
2017-05-02 20:04:14.350221 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:04:14.353331 I | api: 4c5b96dc-e21c-4dad-98fd-69be4af149c0 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 74.967447ms
2017-05-02 20:04:14.353874 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: Device or resource busy
2017-05-02 20:04:14.357340 I | api: ec4c0225-9afc-4643-ba3a-7f5506b4b0d6 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 100.273258ms
2017-05-02 20:04:29.257816 I | api: 89b94b0d-3b9b-4f1b-b2f2-372b6d5aec69 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:29.259161 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:29.263803 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:29.267664 I | api: 5106d8bc-5a19-4dd1-b06f-b4f1b461446d DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:29.268153 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:29.273075 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:29.293367 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:04:29.299580 I | api: 5106d8bc-5a19-4dd1-b06f-b4f1b461446d DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 31.911888ms
2017-05-02 20:04:39.779709 I | api: 89b94b0d-3b9b-4f1b-b2f2-372b6d5aec69 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 200 OK 10.521888283s
2017-05-02 20:04:44.257566 I | api: a50ba51a-b5da-4cf4-835c-4002c1f2d6be DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:44.257888 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:44.262766 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:44.270152 I | api: d113c59e-42ce-48bd-901a-52719157a3c1 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:44.270448 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:44.287513 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:44.292118 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:04:44.293271 I | api: a50ba51a-b5da-4cf4-835c-4002c1f2d6be DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 35.706573ms
2017-05-02 20:04:44.313016 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:04:44.314394 I | api: d113c59e-42ce-48bd-901a-52719157a3c1 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 44.239978ms
2017-05-02 20:04:59.257709 I | api: 59418580-1fdc-4b1e-b2bf-763804caa148 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:59.258055 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:59.262073 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:59.265249 I | api: 6ed33ef5-6d02-4805-99b8-d66411900c18 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:04:59.265965 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:59.273408 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:59.282280 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:04:59.285566 I | api: 59418580-1fdc-4b1e-b2bf-763804caa148 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.845505ms
2017-05-02 20:04:59.293401 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:04:59.295936 I | api: 6ed33ef5-6d02-4805-99b8-d66411900c18 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 30.686016ms
2017-05-02 20:05:11.049335 I | api: 58860dd6-cde2-4f2f-9506-6961834461f5 GET /image GetImages (start)
2017-05-02 20:05:11.049798 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:11.053514 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:11.062644 I | api: 58860dd6-cde2-4f2f-9506-6961834461f5 GET /image GetImages 200 OK 13.308198ms
2017-05-02 20:05:14.259222 I | api: edcf4109-d56a-4b91-9f7a-ceba2ed1b0e4 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:14.259663 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:14.266476 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:14.269076 I | api: 20e4ba6d-733d-4f1f-ac34-86f4addd677f DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:14.270874 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:14.275683 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:14.297359 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:14.300397 I | api: edcf4109-d56a-4b91-9f7a-ceba2ed1b0e4 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 41.174056ms
2017-05-02 20:05:14.302324 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:14.305027 I | api: 20e4ba6d-733d-4f1f-ac34-86f4addd677f DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 35.954895ms
2017-05-02 20:05:29.260517 I | api: fe03f693-ffd5-4d56-b055-ca2da27c87c5 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:29.260850 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:29.265568 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:29.267723 I | api: 44ce42e8-324f-46fd-ab3f-9fb7d1f99592 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:29.268207 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:29.276361 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:29.290272 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:29.291748 I | api: fe03f693-ffd5-4d56-b055-ca2da27c87c5 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 31.231011ms
2017-05-02 20:05:29.296117 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:29.298211 I | api: 44ce42e8-324f-46fd-ab3f-9fb7d1f99592 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 30.489581ms
2017-05-02 20:05:44.267885 I | api: 52803cb1-c696-4a28-afd4-8d9ab046da39 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:44.269021 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:44.271547 I | api: 5fc8e58d-590a-4a3d-b4ad-24401efddae5 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:44.276190 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:44.277869 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:44.288473 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:44.300788 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:44.302517 I | api: 52803cb1-c696-4a28-afd4-8d9ab046da39 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 34.621117ms
2017-05-02 20:05:44.306418 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:44.308744 I | api: 5fc8e58d-590a-4a3d-b4ad-24401efddae5 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 37.1913ms
2017-05-02 20:05:59.262122 I | api: ca5c58ab-6df7-4aed-b940-f56e2f0db183 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:59.263276 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:59.267317 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:59.269433 I | api: ed89250b-7532-46c3-9788-0e5053fa732f DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:05:59.270042 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:59.276661 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:59.285313 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:59.286678 I | api: ca5c58ab-6df7-4aed-b940-f56e2f0db183 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 24.557456ms
2017-05-02 20:05:59.299213 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:05:59.301231 I | api: ed89250b-7532-46c3-9788-0e5053fa732f DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 31.795698ms
2017-05-02 20:06:14.264328 I | api: 1f8639b0-4cec-4e05-800d-a53879571e1d DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:14.264916 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:14.270431 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:14.274628 I | api: 1e43cf48-1b81-48be-9e59-b68e89239efc DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:14.276956 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:14.283528 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:14.293855 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:14.296841 I | api: 1f8639b0-4cec-4e05-800d-a53879571e1d DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 32.510761ms
2017-05-02 20:06:14.305603 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:14.308426 I | api: 1e43cf48-1b81-48be-9e59-b68e89239efc DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 33.794499ms
2017-05-02 20:06:29.265718 I | api: 9595cc6a-33d7-49de-b02a-ec3e833477d4 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:29.266072 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:29.268224 I | api: bfa178ca-2e1c-42a8-b2c2-c11d9c02c884 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:29.268487 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:29.274792 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:29.276171 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:29.290013 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:29.293312 I | api: 9595cc6a-33d7-49de-b02a-ec3e833477d4 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.592332ms
2017-05-02 20:06:29.294993 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:29.297374 I | api: bfa178ca-2e1c-42a8-b2c2-c11d9c02c884 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 29.149506ms
2017-05-02 20:06:44.272355 I | api: 95ecf936-a8a5-4eb0-b5ed-d5c0732616f7 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:44.272635 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:44.276292 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:44.277785 I | api: 868d26fe-24eb-4c72-9c35-f3ebc182c25d DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:44.278840 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:44.283746 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:44.301623 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:44.303132 I | api: 95ecf936-a8a5-4eb0-b5ed-d5c0732616f7 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 30.776085ms
2017-05-02 20:06:44.306864 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:44.308863 I | api: 868d26fe-24eb-4c72-9c35-f3ebc182c25d DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 31.076148ms
2017-05-02 20:06:59.271789 I | api: e9f7aeb0-f483-48f9-ab75-20b2462a2cb2 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:59.272668 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:59.277512 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:59.281658 I | api: 3e2d842b-7c0f-4253-b4ae-682263ebfcaf DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:06:59.281932 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:59.286641 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:59.298873 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:59.300266 I | api: e9f7aeb0-f483-48f9-ab75-20b2462a2cb2 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 28.477844ms
2017-05-02 20:06:59.310768 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:06:59.312582 I | api: 3e2d842b-7c0f-4253-b4ae-682263ebfcaf DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 30.924876ms
2017-05-02 20:07:14.273241 I | api: 38914ab4-5d0a-42ac-b3a1-9f89deaca341 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:14.275107 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:14.278164 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:14.279074 I | api: b8a3d14e-3566-4ba5-b024-b073a170d383 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:14.280640 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:14.284482 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:14.300928 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:14.302675 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:14.303570 I | api: 38914ab4-5d0a-42ac-b3a1-9f89deaca341 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 30.328123ms
2017-05-02 20:07:14.305347 I | api: b8a3d14e-3566-4ba5-b024-b073a170d383 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 26.270121ms
2017-05-02 20:07:29.272647 I | api: 68ba59a2-9649-468e-8a10-9626b7c81449 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:29.273933 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:29.277224 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:29.279008 I | api: 9cbd4e16-dc47-45c0-bc51-036558cd13a5 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:29.279510 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:29.282416 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:29.297142 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:29.299571 I | api: 68ba59a2-9649-468e-8a10-9626b7c81449 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 26.922941ms
2017-05-02 20:07:29.304363 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:29.306171 I | api: 9cbd4e16-dc47-45c0-bc51-036558cd13a5 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.16992ms
2017-05-02 20:07:44.274829 I | api: 3572d708-714b-4bc1-be44-3246f67afde5 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:44.275694 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:44.279247 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:44.281054 I | api: a3916bc5-32d1-4cda-9c35-7554f9528adb DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:44.281528 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:44.284846 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:44.298323 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:44.301480 I | api: 3572d708-714b-4bc1-be44-3246f67afde5 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 26.647882ms
2017-05-02 20:07:44.306000 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:44.308619 I | api: a3916bc5-32d1-4cda-9c35-7554f9528adb DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.563203ms
2017-05-02 20:07:59.275980 I | api: 2d86b110-a3e2-4b68-839e-3be25c27dcf8 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:59.277090 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:59.281045 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:59.283459 I | api: 14de29bb-2501-4098-8ff1-a248fa7e172a DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:07:59.283900 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:59.287236 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:59.302398 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:59.305074 I | api: 2d86b110-a3e2-4b68-839e-3be25c27dcf8 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 29.08464ms
2017-05-02 20:07:59.309553 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:07:59.312855 I | api: 14de29bb-2501-4098-8ff1-a248fa7e172a DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 29.396294ms
2017-05-02 20:08:14.275564 I | api: bbdadbdc-0dfe-41b7-959e-b76e58b7b4dc DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:14.275911 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:14.279505 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:14.280894 I | api: b1b4680e-a11b-42ec-89d9-f300bc2a4ffe DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:14.281246 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:14.285551 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:14.300402 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:14.303692 I | api: bbdadbdc-0dfe-41b7-959e-b76e58b7b4dc DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 28.123624ms
2017-05-02 20:08:14.303951 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:14.305996 I | api: b1b4680e-a11b-42ec-89d9-f300bc2a4ffe DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 25.100127ms
2017-05-02 20:08:29.276641 I | api: c42ccd5c-fc75-484f-8a7f-d79abe97b163 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:29.277861 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:29.281029 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:29.282933 I | api: cdd2c6da-e995-4955-97b1-d7f1e45f5f84 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:29.283429 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:29.289255 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:29.297968 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:29.300674 I | api: c42ccd5c-fc75-484f-8a7f-d79abe97b163 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 24.030892ms
2017-05-02 20:08:29.310177 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:29.312200 I | api: cdd2c6da-e995-4955-97b1-d7f1e45f5f84 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 29.263831ms
2017-05-02 20:08:44.278375 I | api: d886ef86-9475-4d20-9165-8b4ef7278c40 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:44.278652 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:44.282406 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:44.286382 I | api: bcd4236e-86f5-4493-9536-ad1fe82cd228 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:44.286683 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:44.297150 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:44.311665 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:44.314605 I | api: d886ef86-9475-4d20-9165-8b4ef7278c40 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 35.711192ms
2017-05-02 20:08:44.317782 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:44.320423 I | api: bcd4236e-86f5-4493-9536-ad1fe82cd228 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 34.040971ms
2017-05-02 20:08:59.281596 I | api: f2886845-5501-44a2-9b8f-e03bf911a158 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:59.281823 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:59.284304 I | api: adc08350-cb47-4ebe-9eb5-09de0ac78096 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:08:59.284566 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:59.290271 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:59.290657 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:59.307344 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:59.309561 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:08:59.310211 I | api: f2886845-5501-44a2-9b8f-e03bf911a158 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 28.619351ms
2017-05-02 20:08:59.311405 I | api: adc08350-cb47-4ebe-9eb5-09de0ac78096 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.101734ms
2017-05-02 20:09:14.283198 I | api: f362d48b-19c4-4f20-a203-f13c7d4b18f0 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:14.283647 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:14.286275 I | api: cd5fd34a-49d3-43f0-b7f6-2fe6d06214af DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:14.286584 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:14.291030 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:14.291277 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:14.307901 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:14.309393 I | api: f362d48b-19c4-4f20-a203-f13c7d4b18f0 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 26.194901ms
2017-05-02 20:09:14.313651 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:14.315138 I | api: cd5fd34a-49d3-43f0-b7f6-2fe6d06214af DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 28.86061ms
2017-05-02 20:09:29.284611 I | api: 001a8d3b-f7fb-474d-86b6-c29b3a338524 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:29.284737 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:29.288434 I | api: 5e3ee17d-a96a-45bb-b332-87cc915ea0fa DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:29.288546 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:29.290906 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:29.293113 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:29.308305 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:29.309876 I | api: 001a8d3b-f7fb-474d-86b6-c29b3a338524 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 25.264344ms
2017-05-02 20:09:29.314484 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:29.315961 I | api: 5e3ee17d-a96a-45bb-b332-87cc915ea0fa DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.523988ms
2017-05-02 20:09:44.284137 I | api: 27709cc4-fda6-4585-9083-733af1590188 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:44.285142 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:44.288642 I | api: 49b6465e-f90d-4f75-bde2-6499a0b87c56 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:44.289681 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:44.293351 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:44.294283 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:44.312162 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:44.314591 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:44.315822 I | api: 27709cc4-fda6-4585-9083-733af1590188 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 31.686404ms
2017-05-02 20:09:44.316261 I | api: 49b6465e-f90d-4f75-bde2-6499a0b87c56 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.62191ms
2017-05-02 20:09:59.283783 I | api: fac2e945-37f9-4fc0-9048-13642f04f1e0 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:59.285110 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:59.288677 I | api: b11d9b8c-de53-4520-8bda-654e1a3317de DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:09:59.289672 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:59.292934 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:59.294348 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:59.313131 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:59.314633 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:09:59.316600 I | api: b11d9b8c-de53-4520-8bda-654e1a3317de DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.92097ms
2017-05-02 20:09:59.316861 I | api: fac2e945-37f9-4fc0-9048-13642f04f1e0 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 33.08347ms
2017-05-02 20:10:14.285478 I | api: 646c2ae3-3168-4202-b8c6-14e5d6bc9b40 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:14.287131 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:14.291965 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:14.294559 I | api: 0a29805f-3a54-4bf4-a543-9ba3cffa7d73 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:14.295838 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:14.300003 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:14.317086 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:14.318635 I | api: 646c2ae3-3168-4202-b8c6-14e5d6bc9b40 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 33.156719ms
2017-05-02 20:10:14.322786 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:14.324041 I | api: 0a29805f-3a54-4bf4-a543-9ba3cffa7d73 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 29.484521ms
2017-05-02 20:10:29.285757 I | api: db5e3cf9-0311-4aaa-82e1-478df339a641 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:29.287007 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:29.291804 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:29.293776 I | api: d0418354-625c-4ca0-afed-e50e7bd5ac08 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:29.294390 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:29.297694 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:29.311518 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:29.313567 I | api: db5e3cf9-0311-4aaa-82e1-478df339a641 DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.808765ms
2017-05-02 20:10:29.317653 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:29.319466 I | api: d0418354-625c-4ca0-afed-e50e7bd5ac08 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 25.68979ms
2017-05-02 20:10:44.286457 I | api: b976c436-7c19-40b0-9573-039f8c1b443f DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:44.287839 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:44.294415 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:44.296443 I | api: cfdc1ad4-00d3-4e1b-9560-ce533b1de231 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:44.297463 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:44.310247 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:44.319784 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:44.322332 I | api: b976c436-7c19-40b0-9573-039f8c1b443f DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 35.873589ms
2017-05-02 20:10:44.335249 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:44.337383 I | api: cfdc1ad4-00d3-4e1b-9560-ce533b1de231 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 40.939231ms
2017-05-02 20:10:59.286858 I | api: af4a334b-5373-4bc7-aefe-68f4f02f45c5 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:59.288492 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:59.290162 I | api: 43c9c7e8-ba44-4c57-8dc5-2ff07ac84e1e DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:10:59.290392 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:59.296432 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:59.296712 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:59.311970 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:59.314526 I | api: 43c9c7e8-ba44-4c57-8dc5-2ff07ac84e1e DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 24.360527ms
2017-05-02 20:10:59.316171 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:10:59.317787 I | api: af4a334b-5373-4bc7-aefe-68f4f02f45c5 DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 30.933392ms
2017-05-02 20:11:14.285643 I | api: a75df428-dd93-4105-911a-1a4f5a094ebc DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:11:14.286736 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:14.291414 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:11:14.294061 I | api: 077db27a-fcd1-4edd-a083-3aba1d6ebfdf DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:11:14.294702 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:14.299437 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:11:14.312808 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:11:14.315631 I | api: a75df428-dd93-4105-911a-1a4f5a094ebc DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 29.987796ms
2017-05-02 20:11:14.322811 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:11:14.324968 I | api: 077db27a-fcd1-4edd-a083-3aba1d6ebfdf DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 30.907853ms
2017-05-02 20:11:29.287732 I | api: 9d9ff1ad-c426-4817-aa1d-d462d92009ad DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:11:29.288687 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:29.292428 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:11:29.293828 I | api: a8f2217a-4a4e-4314-a118-9d5b5d10f96e DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage (start)
2017-05-02 20:11:29.294341 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:29.299487 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:11:29.313246 E | api: failed to delete image {Name:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:11:29.316765 I | api: 9d9ff1ad-c426-4817-aa1d-d462d92009ad DELETE /image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 29.032679ms
2017-05-02 20:11:29.319974 E | api: failed to delete image {Name:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02 PoolName:replicapool Size:0 Device: MountPoint:}: cephd: No such file or directory
2017-05-02 20:11:29.321433 I | api: a8f2217a-4a4e-4314-a118-9d5b5d10f96e DELETE /image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool DeleteImage 500 Internal Server Error 27.6051ms
2017-05-02 19:47:38.118116 I | rookd: starting operator
2017-05-02 19:47:38.118318 I | operator: creating cluster TPR
2017-05-02 19:47:38.152795 I | operator: creating pool TPR
2017-05-02 19:47:38.161057 I | operator: did not yet find tpr cluster. the server could not find the requested resource
2017-05-02 19:47:44.174811 I | operator: Managing clusters
2017-05-02 19:47:44.174829 I | operator: finding existing clusters...
2017-05-02 19:47:44.177619 I | operator: found 0 clusters
2017-05-02 19:47:44.177619 I | operator: start watching cluster tpr: 534
2017-05-02 19:51:13.986640 I | operator: starting new cluster rook in namespace rook
2017-05-02 19:51:13.986672 I | operator: starting cluster rook in namespace rook
2017-05-02 19:51:13.995859 I | op-mon: start running mons
2017-05-02 19:51:13.998713 I | op-mon: creating mon secrets for a new cluster
2017-05-02 19:51:14.098247 I | op-mon: saved rook-admin secret
2017-05-02 19:51:14.105755 I | op-mon: saved mon endpoints to config map mon-config
2017-05-02 19:51:14.108836 I | op-mon: there are 2 nodes available for 3 monitors
2017-05-02 19:51:14.118560 I | op-mon: waiting 6s for pod mon0 to start. status=
2017-05-02 19:51:20.123387 I | op-mon: pod mon0 started
2017-05-02 19:51:20.140110 I | op-mon: saved mon endpoints to config map mon-config
2017-05-02 19:51:20.148120 I | op-mon: waiting 6s for pod mon1 to start. status=
2017-05-02 19:51:26.154057 I | op-mon: pod mon1 started
2017-05-02 19:51:26.167457 I | op-mon: saved mon endpoints to config map mon-config
2017-05-02 19:51:26.173546 I | op-mon: waiting 6s for pod mon2 to start. status=
2017-05-02 19:51:32.182916 I | op-mon: pod mon2 started
2017-05-02 19:51:32.198679 I | op-mon: saved mon endpoints to config map mon-config
2017-05-02 19:51:32.198761 I | op-mon: mons created: 3, alreadyRunning: 0, preexisted: 0
2017-05-02 19:51:32.199072 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:51:38.224502 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:51:38.224800 I | cephmon: waiting for mon quorum
2017-05-02 19:51:38.226844 W | cephmon: initial monitor mon2 is not in quorum list
2017-05-02 19:51:43.237881 I | cephmon: Ceph monitors formed quorum
2017-05-02 19:51:43.238834 I | op-api: starting the Rook api
2017-05-02 19:51:43.260177 I | op-api: API service running at 10.3.0.5:8124
2017-05-02 19:51:43.275543 I | op-api: api deployment started
2017-05-02 19:51:43.275617 I | op-osd: start running osds in namespace rook
2017-05-02 19:51:43.284822 I | op-osd: osd replica set started for node 172.17.4.101
2017-05-02 19:51:43.309615 I | op-osd: osd replica set started for node 172.17.4.201
2017-05-02 19:51:43.309813 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:51:43.314462 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:51:43.359761 I | op-cluster: saved rook-rook-user secret
2017-05-02 19:51:43.361427 I | op-cluster: Done creating rook instance in namespace rook
2017-05-02 19:51:43.361442 I | op-cluster: retrieving rook api endpoint for namespace rook
2017-05-02 19:51:43.393352 I | op-cluster: rook api endpoint 10.3.0.5:8124 for namespace rook
2017-05-02 19:51:43.393374 I | operator: finding existing pools...
2017-05-02 19:51:43.403773 I | operator: found 0 pools. ensuring they exist.
2017-05-02 19:51:43.403791 I | operator: start watching pool tpr in namespace rook: 912
2017-05-02 19:51:53.399354 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:51:53.407940 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:52:03.424230 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:52:03.434777 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:52:13.444341 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:52:13.478709 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:52:23.493800 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:52:23.536189 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:52:33.550026 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:52:33.553745 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:52:43.566640 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:52:43.570052 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:52:53.586623 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:52:53.590048 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:53:03.598797 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:53:03.602865 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:53:13.614028 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:53:13.618008 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:53:23.627192 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:53:23.631253 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:53:33.639606 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:53:33.643301 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:53:43.652843 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:53:43.657887 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:53:53.667675 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:53:53.671695 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:54:03.682063 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:54:03.686155 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:54:13.696659 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:54:13.700578 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:54:23.711651 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:54:23.716128 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:54:33.726657 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:54:33.731417 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:54:43.741290 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:54:43.745359 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:54:53.755624 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:54:53.759881 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:55:03.770918 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:55:03.774914 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:55:13.784139 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:55:13.788059 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:55:23.798773 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:55:23.802802 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:55:33.813363 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:55:33.817305 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:55:43.825684 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:55:43.829821 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:55:53.840867 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:55:53.845548 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:56:03.856942 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:56:03.860977 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:56:13.869896 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:56:13.874028 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:56:23.884290 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:56:23.888118 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:56:33.899079 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:56:33.902741 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:56:43.910779 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:56:43.914316 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:56:53.924306 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:56:53.929346 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:02.819833 I | op-cluster: creating pool replicapool in namespace rook with replicas 1
2017-05-02 19:57:03.940886 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:03.945151 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:04.084905 I | op-cluster: created pool replicapool. pool 'replicapool' created
2017-05-02 19:57:07.362412 I | operator: VolumeOptions {Delete pvc-85571abe-2f71-11e7-8872-0800279ee0e4 &PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:mysql-pv-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/mysql-pv-claim,UID:85571abe-2f71-11e7-8872-0800279ee0e4,ResourceVersion:1366,Generation:0,CreationTimestamp:2017-05-02 19:57:07 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: wordpress,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{21474836480 0} {<nil>} 20Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*rook-block,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},},} map[pool:replicapool]}
2017-05-02 19:57:07.362512 I | operator: creating volume with configuration {pool:replicapool clusterNamespace:rook clusterName:rook}
2017-05-02 19:57:09.374098 I | operator: Rook block image created: succeeded created image k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02
2017-05-02 19:57:09.381578 I | operator: successfully created Rook Block volume &RBDVolumeSource{CephMonitors:[10.2.63.3:6790 10.2.63.4:6790 10.2.63.5:6790],RBDImage:k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02,FSType:ext4,RBDPool:replicapool,RadosUser:rook-rook-user,Keyring:,SecretRef:&LocalObjectReference{Name:rook-rook-user,},ReadOnly:false,}
2017-05-02 19:57:13.965697 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:13.974334 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:14.787146 I | operator: VolumeOptions {Delete pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4 &PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:wp-pv-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/wp-pv-claim,UID:89a71ba4-2f71-11e7-8872-0800279ee0e4,ResourceVersion:1412,Generation:0,CreationTimestamp:2017-05-02 19:57:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app: wordpress,},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{21474836480 0} {<nil>} 20Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*rook-block,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},},} map[pool:replicapool]}
2017-05-02 19:57:14.787165 I | operator: creating volume with configuration {pool:replicapool clusterNamespace:rook clusterName:rook}
2017-05-02 19:57:14.846153 I | operator: Rook block image created: succeeded created image k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02
2017-05-02 19:57:14.859423 I | operator: successfully created Rook Block volume &RBDVolumeSource{CephMonitors:[10.2.63.3:6790 10.2.63.4:6790 10.2.63.5:6790],RBDImage:k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02,FSType:ext4,RBDPool:replicapool,RadosUser:rook-rook-user,Keyring:,SecretRef:&LocalObjectReference{Name:rook-rook-user,},ReadOnly:false,}
2017-05-02 19:57:23.983639 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:23.989809 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:33.999207 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:34.004976 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:44.042381 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:44.103123 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:57:54.122316 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:57:54.128778 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:58:04.141174 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:58:04.214727 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:58:14.236849 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:58:14.248973 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:58:24.262654 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:58:24.268993 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:58:34.280291 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:58:34.284073 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:58:44.292582 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:58:44.296703 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:58:54.306210 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:58:54.309617 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:59:04.317765 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:59:04.321500 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:59:14.331665 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:59:14.335476 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:59:24.345181 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:59:24.349536 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:59:34.358732 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:59:34.363848 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:59:44.372990 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:59:44.376466 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 19:59:54.385760 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 19:59:54.389921 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:00:04.398716 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:00:04.403098 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:00:14.413687 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:00:14.417757 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:00:24.427802 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:00:24.433006 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:00:34.441675 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:00:34.445749 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:00:44.456307 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:00:44.463709 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:00:54.473930 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:00:54.478059 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:01:04.487729 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:01:04.491585 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:01:14.501326 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:01:14.505694 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:01:24.517973 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:01:24.521856 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:01:34.530735 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:01:34.535944 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:01:44.558663 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:01:44.562100 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:01:54.579822 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:01:54.586354 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:02:04.599761 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:02:04.614552 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:02:14.624671 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:02:14.628710 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:02:24.637837 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:02:24.641967 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:02:34.650881 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:02:34.654753 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:02:44.667701 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:02:44.671131 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:02:54.681652 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:02:54.685812 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:04.695127 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:04.699514 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:14.710406 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:14.714712 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:24.724089 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:24.728365 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:34.736009 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:34.739636 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:03:44.750651 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:44.754944 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:03:45.657442 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:03:45.657797 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:03:48.894491 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:03:48.894566 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
2017-05-02 20:03:52.075030 I | op-cluster: TODO: delete pool replicapool from namespace rook
2017-05-02 20:03:54.766177 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:03:54.770195 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:03:59.298594 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:03:59.298677 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:03:59.304332 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352239, nsec:298667833, loc:(*time.Location)(0x44be020)}}, Count:2, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
2017-05-02 20:04:04.782646 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:04.789992 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:04:14.353640 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:14.353948 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:14.356932 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352254, nsec:353938757, loc:(*time.Location)(0x44be020)}}, Count:2, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
E0502 20:04:14.357497 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:14.357568 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:14.359335 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352254, nsec:357562343, loc:(*time.Location)(0x44be020)}}, Count:3, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
2017-05-02 20:04:14.801500 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:14.806646 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:24.816280 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:24.820430 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:04:29.300840 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:29.300989 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:29.307468 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352269, nsec:300925082, loc:(*time.Location)(0x44be020)}}, Count:3, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:04:34.831514 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:34.835274 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:04:44.293431 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:44.293467 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:44.299461 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352284, nsec:293460422, loc:(*time.Location)(0x44be020)}}, Count:4, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:04:44.314582 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:44.314633 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:44.317811 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352284, nsec:314625107, loc:(*time.Location)(0x44be020)}}, Count:4, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:04:44.846819 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:44.850450 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:04:54.860751 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:04:54.864707 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:04:59.285826 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:59.285916 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:59.289040 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352299, nsec:285905424, loc:(*time.Location)(0x44be020)}}, Count:5, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:04:59.296148 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:59.296234 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:04:59.298944 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352299, nsec:296226026, loc:(*time.Location)(0x44be020)}}, Count:5, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:05:04.875248 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:04.879707 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:05:14.300722 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:14.300854 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:14.304462 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352314, nsec:300843758, loc:(*time.Location)(0x44be020)}}, Count:6, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:05:14.305225 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:14.305301 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:14.307096 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352314, nsec:305286825, loc:(*time.Location)(0x44be020)}}, Count:6, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:05:14.890207 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:14.894440 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:24.906146 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:24.911183 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:05:29.292015 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:29.292096 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:29.298521 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352329, nsec:292087084, loc:(*time.Location)(0x44be020)}}, Count:7, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:05:29.298633 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:29.298664 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:29.299687 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352329, nsec:298659567, loc:(*time.Location)(0x44be020)}}, Count:7, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:05:34.920652 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:34.925645 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:05:44.302762 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:44.302845 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:44.308248 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352344, nsec:302835349, loc:(*time.Location)(0x44be020)}}, Count:8, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:05:44.308963 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:44.309018 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:44.310926 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352344, nsec:309009559, loc:(*time.Location)(0x44be020)}}, Count:8, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:05:44.934655 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:44.938628 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:05:54.948659 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:05:54.953305 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:05:59.288654 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:59.288775 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:59.291206 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352359, nsec:288763746, loc:(*time.Location)(0x44be020)}}, Count:9, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:05:59.301453 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:59.301529 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:05:59.303417 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352359, nsec:301520124, loc:(*time.Location)(0x44be020)}}, Count:9, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:06:04.965254 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:04.969457 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:06:14.297654 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:14.297736 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:14.300105 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352374, nsec:297729350, loc:(*time.Location)(0x44be020)}}, Count:10, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:06:14.308697 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:14.308809 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:14.310965 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352374, nsec:308787786, loc:(*time.Location)(0x44be020)}}, Count:10, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:06:14.981639 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:14.986034 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:24.995389 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:25.000100 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:06:29.294456 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:29.294539 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:29.296620 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352389, nsec:294527244, loc:(*time.Location)(0x44be020)}}, Count:11, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:06:29.297530 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:29.297582 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:29.299449 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352389, nsec:297575747, loc:(*time.Location)(0x44be020)}}, Count:11, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:06:35.010744 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:35.014770 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:06:44.305216 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:44.305319 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:44.310002 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352404, nsec:305307733, loc:(*time.Location)(0x44be020)}}, Count:12, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:06:44.310263 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:44.310307 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:44.310933 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352404, nsec:310300817, loc:(*time.Location)(0x44be020)}}, Count:12, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:06:45.022793 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:45.026600 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:06:55.036294 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:06:55.039883 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:06:59.302487 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:59.302582 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:59.305661 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352419, nsec:302571554, loc:(*time.Location)(0x44be020)}}, Count:13, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:06:59.312772 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:59.312837 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:06:59.314641 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352419, nsec:312828651, loc:(*time.Location)(0x44be020)}}, Count:13, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:07:05.055232 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:05.059080 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:07:14.305549 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:14.305643 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:14.305960 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:14.305993 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:14.308135 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352434, nsec:305634130, loc:(*time.Location)(0x44be020)}}, Count:14, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
E0502 20:07:14.309252 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352434, nsec:305988679, loc:(*time.Location)(0x44be020)}}, Count:14, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
2017-05-02 20:07:15.068977 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:15.074311 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:25.083823 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:25.087807 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:07:29.300871 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:29.300959 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:29.303772 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352449, nsec:300949155, loc:(*time.Location)(0x44be020)}}, Count:15, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:07:29.306365 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:29.306424 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:29.308948 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352449, nsec:306413066, loc:(*time.Location)(0x44be020)}}, Count:15, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:07:35.099671 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:35.103689 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:07:44.301761 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:44.301862 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:44.304490 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352464, nsec:301851155, loc:(*time.Location)(0x44be020)}}, Count:16, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:07:44.308803 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:44.308867 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:44.309852 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352464, nsec:308859889, loc:(*time.Location)(0x44be020)}}, Count:16, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:07:45.114663 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:45.118970 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:07:55.126062 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:07:55.130078 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:07:59.306955 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:59.307071 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:59.312287 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352479, nsec:307061034, loc:(*time.Location)(0x44be020)}}, Count:17, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:07:59.313024 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:59.313068 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:07:59.314619 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352479, nsec:313063330, loc:(*time.Location)(0x44be020)}}, Count:17, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:08:05.140515 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:05.144838 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:08:14.304055 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:14.304148 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:14.306220 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:14.306277 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:14.308268 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352494, nsec:304138140, loc:(*time.Location)(0x44be020)}}, Count:18, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
E0502 20:08:14.309437 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352494, nsec:306269802, loc:(*time.Location)(0x44be020)}}, Count:18, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
2017-05-02 20:08:15.153999 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:15.159536 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:25.188884 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:25.192835 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:08:29.300898 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:29.300990 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:29.304269 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352509, nsec:300977520, loc:(*time.Location)(0x44be020)}}, Count:19, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:08:29.312419 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:29.312474 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:29.314146 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352509, nsec:312467390, loc:(*time.Location)(0x44be020)}}, Count:19, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:08:35.202596 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:35.206774 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:08:44.315514 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:44.315599 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:44.317968 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352524, nsec:315589917, loc:(*time.Location)(0x44be020)}}, Count:20, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
E0502 20:08:44.320598 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:44.320659 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:44.323666 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352524, nsec:320651744, loc:(*time.Location)(0x44be020)}}, Count:20, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
2017-05-02 20:08:45.217828 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:45.221622 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:08:55.240343 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:08:55.243923 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:08:59.311566 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:59.311646 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:59.311969 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:59.312004 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:08:59.314673 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352539, nsec:311636835, loc:(*time.Location)(0x44be020)}}, Count:21, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:08:59.315658 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352539, nsec:311999428, loc:(*time.Location)(0x44be020)}}, Count:21, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:09:05.252861 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:05.256952 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:09:14.309612 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:14.311459 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:14.313305 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352554, nsec:311444541, loc:(*time.Location)(0x44be020)}}, Count:22, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:09:14.315313 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:14.315369 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:14.318137 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352554, nsec:315362448, loc:(*time.Location)(0x44be020)}}, Count:22, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:09:15.267476 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:15.271843 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:25.280733 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:25.284754 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:09:29.310132 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:29.310207 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:29.312468 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352569, nsec:310198414, loc:(*time.Location)(0x44be020)}}, Count:23, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:09:29.316191 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:29.317188 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:29.318582 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352569, nsec:317179047, loc:(*time.Location)(0x44be020)}}, Count:23, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:09:35.293668 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:35.298543 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:09:44.316012 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:44.316180 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:44.316683 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:44.316720 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:44.318300 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352584, nsec:316170221, loc:(*time.Location)(0x44be020)}}, Count:24, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:09:44.319498 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352584, nsec:316714667, loc:(*time.Location)(0x44be020)}}, Count:24, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:09:45.312801 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:45.317150 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:09:55.328480 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:09:55.332187 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:09:59.317028 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:59.317105 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:59.317550 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:59.317596 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:09:59.320244 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352599, nsec:317095771, loc:(*time.Location)(0x44be020)}}, Count:25, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
E0502 20:09:59.321187 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352599, nsec:317590590, loc:(*time.Location)(0x44be020)}}, Count:25, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
2017-05-02 20:10:05.346642 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:05.350729 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:10:14.318844 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:14.318937 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:14.322449 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352614, nsec:318927962, loc:(*time.Location)(0x44be020)}}, Count:26, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:10:14.324215 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:14.324265 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:14.326338 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352614, nsec:324259204, loc:(*time.Location)(0x44be020)}}, Count:26, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:10:15.360726 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:15.366544 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:25.375737 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:25.380684 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:10:29.313753 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:29.313833 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:29.315458 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352629, nsec:313820588, loc:(*time.Location)(0x44be020)}}, Count:27, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:10:29.319651 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:29.319715 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:29.321526 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352629, nsec:319707235, loc:(*time.Location)(0x44be020)}}, Count:27, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:10:35.387666 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:35.392274 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:10:44.322712 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:44.322798 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:44.325365 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352644, nsec:322788420, loc:(*time.Location)(0x44be020)}}, Count:28, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:10:44.337560 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:44.337621 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:44.340000 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352644, nsec:337613376, loc:(*time.Location)(0x44be020)}}, Count:28, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:10:45.401621 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:45.405444 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:10:55.419047 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:10:55.424143 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:10:59.314770 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:59.315157 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:59.317082 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352659, nsec:315148035, loc:(*time.Location)(0x44be020)}}, Count:29, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:10:59.317922 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:59.317964 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:10:59.320505 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352659, nsec:317958195, loc:(*time.Location)(0x44be020)}}, Count:29, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:11:05.433668 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:05.438063 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:11:14.316778 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:14.316860 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:14.318493 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352674, nsec:316850416, loc:(*time.Location)(0x44be020)}}, Count:30, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:11:14.325162 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:14.325217 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:14.326433 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352674, nsec:325210393, loc:(*time.Location)(0x44be020)}}, Count:30, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:11:15.447272 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:15.451604 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:11:25.461104 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:25.466022 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:11:29.317175 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:29.317820 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:29.320244 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352689, nsec:317806916, loc:(*time.Location)(0x44be020)}}, Count:31, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
E0502 20:11:29.321574 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:29.321631 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:29.323589 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352689, nsec:321624462, loc:(*time.Location)(0x44be020)}}, Count:31, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
2017-05-02 20:11:35.475500 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:35.479698 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:11:44.321586 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:44.321782 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:44.323375 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:44.323436 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:44.323951 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352704, nsec:321771725, loc:(*time.Location)(0x44be020)}}, Count:32, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:11:44.324866 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352704, nsec:323428092, loc:(*time.Location)(0x44be020)}}, Count:32, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
2017-05-02 20:11:45.489290 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:45.493375 I | cephmon: successfully connected to cluster rook with user admin
2017-05-02 20:11:55.504657 I | cephmon: connecting to ceph cluster rook with user admin
2017-05-02 20:11:55.509436 I | cephmon: successfully connected to cluster rook with user admin
E0502 20:11:59.317640 1 controller.go:864] Deletion of volume "pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:59.317762 1 goroutinemap.go:153] operation for "delete-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4[89db9f08-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:59.323734 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2040", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4", UID:"89db9f08-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2031", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4-89cde5d2-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352225, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352719, nsec:317752820, loc:(*time.Location)(0x44be020)}}, Count:33, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-89a71ba4-2f71-11e7-8872-0800279ee0e4.14bae2a537a50dbd)' (will not retry!)
E0502 20:11:59.330389 1 controller.go:864] Deletion of volume "pvc-85571abe-2f71-11e7-8872-0800279ee0e4" failed: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:59.330442 1 goroutinemap.go:153] operation for "delete-pvc-85571abe-2f71-11e7-8872-0800279ee0e4[8697b276-2f71-11e7-8872-0800279ee0e4]" failed with: Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''
E0502 20:11:59.331333 1 event.go:199] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"2054", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:0, nsec:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-85571abe-2f71-11e7-8872-0800279ee0e4", UID:"8697b276-2f71-11e7-8872-0800279ee0e4", APIVersion:"v1", ResourceVersion:"2052", FieldPath:""}, Reason:"VolumeFailedDelete", Message:"Failed to delete rook block image replicapool/pvc-85571abe-2f71-11e7-8872-0800279ee0e4: HTTP status code 500 for query image?name=k8s-dynamic-pvc-85571abe-2f71-11e7-8872-0800279ee0e4-8560fce7-2f71-11e7-936b-0a580a023f02&pool=replicapool: ''", Source:v1.EventSource{Component:"rook.io/block rook-operator-1641293690-q8v5d 35b0f438-2f70-11e7-936b-0a580a023f02", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{sec:63629352228, nsec:0, loc:(*time.Location)(0x44be020)}}, LastTimestamp:v1.Time{Time:time.Time{sec:63629352719, nsec:330436053, loc:(*time.Location)(0x44be020)}}, Count:33, Type:"Warning"}': 'User "system:serviceaccount:default:rook-operator" cannot patch events in the namespace "default". (patch events pvc-85571abe-2f71-11e7-8872-0800279ee0e4.14bae2a5f89247fb)' (will not retry!)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment