Skip to content

Instantly share code, notes, and snippets.

@jcourtois

jcourtois/0 cinder-api call Secret

Last active August 29, 2015 14:06
Show Gist options
  • Save jcourtois/1470b0e24a14205eb592 to your computer and use it in GitHub Desktop.
Save jcourtois/1470b0e24a14205eb592 to your computer and use it in GitHub Desktop.
Download ZIP
cinder volume failing to delete in IAD
Raw
0 cinder-api call
------------
REQUEST SENT
------------
request method..: DELETE
request url.....: http://10.17.255.180:8776/v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae
request params..:
request headers.: {'Content-Length': '0', 'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/json', 'User-Agent': 'python-requests/2.4.0 CPython/2.7.5 Darwin/13.3.0', 'Connection': 'keep-alive', 'X-Auth-Token': u'08a35f2c8ebe4f28902f749c144ce3e8', 'Content-Type': 'application/json'}
request body....: None
2014-09-07 22:15:08,840: DEBUG: cafe.engine.http.client:
-----------------
RESPONSE RECEIVED
-----------------
response status..: <Response [202]>
response time....: 0.295524120331
response headers.: {'date': 'Mon, 08 Sep 2014 03:15:09 GMT', 'connection': 'keep-alive', 'content-type': 'text/html; charset=UTF-8', 'content-length': '0', 'x-openstack-request-id': 'req-1f03d63b-494f-40a0-aff8-aa100d133034'}
response body....:
-------------------------------------------------------------------------------
2014-09-07 22:15:08,841: DEBUG: cafe.engine.http.client: (<cloudcafe.blockstorage.volumes_api.v1.client.VolumesClient object at 0x107b0f790>, 'GET', 'http://10.17.255.180:8776/v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae') {'headers': {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': u'08a35f2c8ebe4f28902f749c144ce3e8'}, 'params': {}, 'verify': False, 'data': None}
2014-09-07 22:15:08,843: INFO: requests.packages.urllib3.connectionpool: Starting new HTTP connection (1): 10.17.255.180
2014-09-07 22:15:09,213: DEBUG: requests.packages.urllib3.connectionpool: "GET /v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae HTTP/1.1" 200 442
2014-09-07 22:15:09,214: DEBUG: cafe.engine.http.client:
------------
REQUEST SENT
------------
request method..: GET
request url.....: http://10.17.255.180:8776/v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae
request params..:
request headers.: {'Accept-Encoding': 'gzip, deflate', 'Accept': 'application/json', 'User-Agent': 'python-requests/2.4.0 CPython/2.7.5 Darwin/13.3.0', 'Connection': 'keep-alive', 'X-Auth-Token': u'08a35f2c8ebe4f28902f749c144ce3e8', 'Content-Type': 'application/json'}
request body....: None
2014-09-07 22:15:09,215: DEBUG: cafe.engine.http.client:
-----------------
RESPONSE RECEIVED
-----------------
response status..: <Response [200]>
response time....: 0.373455047607
response headers.: {'content-length': '442', 'x-compute-request-id': 'req-81a9bfde-a8ea-4a63-bea9-55f8876bf4f9', 'connection': 'keep-alive', 'date': 'Mon, 08 Sep 2014 03:15:09 GMT', 'content-type': 'application/json', 'x-openstack-request-id': 'req-81a9bfde-a8ea-4a63-bea9-55f8876bf4f9'}
response body....: {"volume": {"status": "deleting", "display_name": "Volume_Auf4KB8glG", "attachments": [], "availability_zone": "nova", "bootable": "false", "encrypted": false, "created_at": "2014-09-08T03:13:25.000000", "os-vol-tenant-attr:tenant_id": "9635701dc6cd4883823e27993c28ae35", "display_description": null, "volume_type": "qe_lvm", "snapshot_id": null, "source_volid": null, "metadata": {}, "id": "bfa4e9d7-e520-451d-bc90-04052f18c9ae", "size": 1}}
-------------------------------------------------------------------------------
2014-09-07 22:15:29,214: DEBUG: cafe.engine.http.client: (<cloudcafe.blockstorage.volumes_api.v1.client.VolumesClient object at 0x107b0f790>, 'GET', 'http://10.17.255.180:8776/v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae') {'headers': {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': u'08a35f2c8ebe4f28902f749c144ce3e8'}, 'params': {}, 'verify': False, 'data': None}
2014-09-07 22:15:29,217: INFO: requests.packages.urllib3.connectionpool: Starting new HTTP connection (1): 10.17.255.180
2014-09-07 22:15:29,498: DEBUG: requests.packages.urllib3.connectionpool: "GET /v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae HTTP/1.1" 200 442
2014-09-07 22:15:29,499: DEBUG: cafe.engine.http.client:
Raw
1 cinder-api.log
# on infra1 node
2014-09-08 03:15:09.499 1954 INFO cinder.api.openstack.wsgi [req-1f03d63b-494f-40a0-aff8-aa100d133034 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] DELETE http://10.17.255.180:8776/v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae
2014-09-08 03:15:09.500 1954 AUDIT cinder.api.v1.volumes [req-1f03d63b-494f-40a0-aff8-aa100d133034 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] Delete volume with id: bfa4e9d7-e520-451d-bc90-04052f18c9ae
2014-09-08 03:15:09.570 1954 INFO cinder.api.openstack.wsgi [req-1f03d63b-494f-40a0-aff8-aa100d133034 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] http://10.17.255.180:8776/v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae returned with HTTP 202
2014-09-08 03:15:09.571 1954 INFO eventlet.wsgi.server [req-1f03d63b-494f-40a0-aff8-aa100d133034 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] 192.168.96.15 - - [08/Sep/2014 03:15:09] "DELETE /v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae HTTP/1.1" 202 211 0.080891
2014-09-08 03:15:09.761 1954 INFO eventlet.wsgi.server [-] (1954) accepted ('192.168.96.15', 54773)
2014-09-08 03:15:09.771 1954 INFO cinder.api.openstack.wsgi [req-81a9bfde-a8ea-4a63-bea9-55f8876bf4f9 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] GET http://10.17.255.180:8776/v1/9635701dc6cd4883823e27993c28ae35/volumes/bfa4e9d7-e520-451d-bc90-04052f18c9ae
2014-09-08 03:15:09.806 1954 AUDIT cinder.api.v1.volumes [req-81a9bfde-a8ea-4a63-bea9-55f8876bf4f9 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] vol={'migration_status': None, 'availability_zone': u'nova', 'terminated_at': datetime.datetime(2014, 9, 8, 3, 15, 9), 'updated_at': datetime.datetime(2014, 9, 8, 3, 15, 9), 'provider_geometry': None, 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'bfa4e9d7-e520-451d-bc90-04052f18c9ae', 'size': 1L, 'user_id': u'79ad304cb30a4ad2a408ff656942d36f', 'attach_time': None, 'attached_host': None, 'display_description': None, 'volume_admin_metadata': [], 'encryption_key_id': None, 'project_id': u'9635701dc6cd4883823e27993c28ae35', 'launched_at': datetime.datetime(2014, 9, 8, 3, 13, 26), 'scheduled_at': datetime.datetime(2014, 9, 8, 3, 13, 25), 'status': u'deleting', 'volume_type_id': u'd0c3626f-539f-4431-ab6f-b6e71016e406', 'deleted': False, 'provider_location': None, 'host': u'cinder1_cinder_volumes_container-de3ec66c@lvm', 'source_volid': None, 'provider_auth': None, 'display_name': u'Volume_Auf4KB8glG', 'instance_uuid': None, 'bootable': False, 'created_at': datetime.datetime(2014, 9, 8, 3, 13, 25), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x7ff330b69a90>, '_name_id': None, 'volume_metadata': []}
Raw
2 cinder-volumes.log
# on cinder1 node
2014-09-08 03:15:09.569 889 WARNING cinder.context [-] Arguments dropped when creating context: {'user': u'79ad304cb30a4ad2a408ff656942d36f', 'tenant': u'9635701dc6cd4883823e27993c28ae35', 'user_identity': u'79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -'}
2014-09-08 03:15:09.591 889 INFO cinder.volume.manager [req-1f03d63b-494f-40a0-aff8-aa100d133034 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] volume bfa4e9d7-e520-451d-bc90-04052f18c9ae: deleting
2014-09-08 03:15:09.591 889 INFO cinder.volume.iscsi [req-1f03d63b-494f-40a0-aff8-aa100d133034 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] Skipping remove_export. No iscsi_target is presently exported for volume: bfa4e9d7-e520-451d-bc90-04052f18c9ae
2014-09-08 03:15:11.359 889 INFO cinder.volume.utils [req-1f03d63b-494f-40a0-aff8-aa100d133034 79ad304cb30a4ad2a408ff656942d36f 9635701dc6cd4883823e27993c28ae35 - - -] Performing secure delete on volume: /dev/mapper/cinder--volumes-volume--bfa4e9d7--e520--451d--bc90--04052f18c9ae
2014-09-08 03:15:41.192 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:16:41.200 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:17:41.206 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:18:41.213 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:19:41.220 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:20:41.227 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:21:41.234 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:22:41.240 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:23:41.247 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:24:41.255 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:25:41.258 889 INFO cinder.volume.manager [-] Updating volume status
2014-09-08 03:26:41.265 889 INFO cinder.volume.manager [-] Updating volume status
Raw
3 lvdisplay volume-bfa4e9d7-e520-451d-bc90-04052f18c9ae
lvdisplay /dev/mapper/cinder--volumes-volume--bfa4e9d7--e520--451d--bc90--04052f18c9ae
--- Logical volume ---
LV Path /dev/cinder-volumes/volume-bfa4e9d7-e520-451d-bc90-04052f18c9ae
LV Name volume-bfa4e9d7-e520-451d-bc90-04052f18c9ae
VG Name cinder-volumes
LV UUID 5JyFai-UwnJ-y9r2-dtjD-SCdJ-m32v-2VGKUj
LV Write Access read/write
LV Creation host, time cinder1_cinder_volumes_container-de3ec66c, 2014-09-08 03:13:26 +0000
LV Status suspended
# open 1
LV Size 1.00 GiB
Current LE 256
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 252:40
Raw
4 qe_lvm type info
MariaDB [cinder]> select * from volume_types;
+---------------------+------------+---------------------+---------+--------------------------------------+--------+--------------+
| created_at | updated_at | deleted_at | deleted | id | name | qos_specs_id |
+---------------------+------------+---------------------+---------+--------------------------------------+--------+--------------+
| 2014-09-02 22:16:07 | NULL | 2014-09-03 18:24:47 | 1 | 0e27a014-1f02-431c-b073-ee52add7f4d5 | lvm | NULL |
| 2014-09-03 18:22:13 | NULL | NULL | 0 | d0c3626f-539f-4431-ab6f-b6e71016e406 | qe_lvm | NULL |
+---------------------+------------+---------------------+---------+--------------------------------------+--------+--------------+
2 rows in set (0.00 sec)
MariaDB [cinder]> select * from volume_type_extra_specs;
+---------------------+------------+---------------------+---------+----+--------------------------------------+---------------------+-----------+
| created_at | updated_at | deleted_at | deleted | id | volume_type_id | key | value |
+---------------------+------------+---------------------+---------+----+--------------------------------------+---------------------+-----------+
| 2014-09-02 22:16:08 | NULL | 2014-09-03 18:24:47 | 1 | 1 | 0e27a014-1f02-431c-b073-ee52add7f4d5 | volume_backend_name | LVM_iSCSI |
| 2014-09-03 18:26:43 | NULL | NULL | 0 | 4 | d0c3626f-539f-4431-ab6f-b6e71016e406 | volume_backend_name | LVM_iSCSI |
+---------------------+------------+---------------------+---------+----+--------------------------------------+---------------------+-----------+
2 rows in set (0.00 sec)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment