Skip to content

Instantly share code, notes, and snippets.

@mestery

mestery/gist:d64933a318ddc45be401

Created April 6, 2015 18:43
Show Gist options
  • Save mestery/d64933a318ddc45be401 to your computer and use it in GitHub Desktop.
Save mestery/d64933a318ddc45be401 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
2015-04-06 13:57:16.804 INFO nova.api.openstack [req-01c7c2cb-9f54-4fb8-93aa-7519d144fed8 demo invisible_to_admin] http://10.0.0.5:8774/v2/7e4726cb24ff4772892a9da915d158fa/os-certificates returned with HTTP 500
2015-04-06 13:57:16.804 DEBUG nova.api.openstack.wsgi [req-01c7c2cb-9f54-4fb8-93aa-7519d144fed8 demo invisible_to_admin] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:1166
2015-04-06 13:57:16.806 INFO nova.osapi_compute.wsgi.server [req-01c7c2cb-9f54-4fb8-93aa-7519d144fed8 demo invisible_to_admin] 10.0.0.5 "POST /v2/7e4726cb24ff4772892a9da915d158fa/os-certificates HTTP/1.1" status: 500 len: 335 time: 60.0925729
2015-04-06 13:57:28.003 10563 DEBUG keystoneclient.session [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X GET http://10.0.0.5:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}2c00f2fb60b8fd845673ca9d799bcc6565907ec7" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}4ea95eb4571708adbdb6319fa7a8883259bce0cf" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195
2015-04-06 13:57:28.004 10563 DEBUG urllib3.util.retry [-] Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0) from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-04-06 13:57:28.117 10563 DEBUG keystoneclient.session [-] RESP: [200] content-length: 3979 x-subject-token: {SHA1}2c00f2fb60b8fd845673ca9d799bcc6565907ec7 vary: X-Auth-Token server: Apache/2.4.7 (Ubuntu) date: Mon, 06 Apr 2015 13:57:28 GMT content-type: application/json x-openstack-request-id: req-68130bdc-874a-4dbd-b672-a87e8e79ac51
RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "29c3efb6ee944050accec43eb9415596", "name": "admin"}], "expires_at": "2015-04-06T14:57:27.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "b49461b34ffb40eeb297b9365c4f12f9", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "93e28369ee7c424ba318b8855ce4cb27", "name": "admin"}, "audit_ids": ["uIhsvv3jQDm5vhTm4VCW8A"], "issued_at": "2015-04-06T13:57:27.925152"}}
_http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224
2015-04-06 13:57:28.120 DEBUG nova.api.openstack.wsgi [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] Action: 'create', calling method: <bound method CertificatesController.create of <nova.api.openstack.compute.contrib.certificates.CertificatesController object at 0x7fef13cfee50>>, body: {} _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:780
2015-04-06 13:58:28.123 ERROR nova.api.openstack [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] Caught error: Timed out waiting for a reply to message ID 60da02e9aaf644e5b81d865adedda977
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack Traceback (most recent call last):
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 125, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return req.get_response(self.application)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1320, in send
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack application, catch_exc_info=False)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1284, in call_application
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack app_iter = application(self.environ, start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 634, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return self._call_app(env, start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 554, in _call_app
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return self._app(env, _fake_start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/routes/middleware.py", line 136, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack response = self.app(environ, start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return self.func(req, *args, **kwargs)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 756, in __call__
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack content_type, body, accept)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 821, in _process_stack
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack action_result = self.dispatch(meth, request, action_args)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 911, in dispatch
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return method(req=request, **action_args)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/contrib/certificates.py", line 58, in create
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack user_id=context.user_id, project_id=context.project_id)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/cert/rpcapi.py", line 89, in generate_x509_cert
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack project_id=project_id)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 156, in call
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack retry=self.retry)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack timeout=timeout, retry=retry)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 350, in send
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack retry=retry)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 339, in _send
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack result = self._waiter.wait(msg_id, timeout)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 243, in wait
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack message = self.waiters.get(msg_id, timeout=timeout)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 149, in get
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack 'to message ID %s' % msg_id)
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack MessagingTimeout: Timed out waiting for a reply to message ID 60da02e9aaf644e5b81d865adedda977
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack
2015-04-06 13:58:28.124 INFO nova.api.openstack [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] http://10.0.0.5:8774/v2/b49461b34ffb40eeb297b9365c4f12f9/os-certificates returned with HTTP 500
2015-04-06 13:58:28.124 DEBUG nova.api.openstack.wsgi [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:1166
2015-04-06 13:58:28.127 INFO nova.osapi_compute.wsgi.server [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] 10.0.0.5 "POST /v2/b49461b34ffb40eeb297b9365c4f12f9/os-certificates HTTP/1.1" status: 500 len: 335 time: 60.1252139
@docanaebi
Copy link

Hi,

I'm having the same problem, I'm not able to download the EC2 credentials for using the Nova EC2 API because the following call hangs:

from novaclient.v1_1 import client as nova

nova = nova.Client(username, password, tenant, auth_url)
credentials = nova.certs.create()

Having a look at the nova logs, I see exactly the same error, did you manage to solve it?

Thanks.

** SOLVED: Never mind, digging a bit more, just realized the service nova-cert is not running in our controllers, that is why the call hangs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment