Created
April 6, 2015 18:43
-
-
Save mestery/d64933a318ddc45be401 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2015-04-06 13:57:16.804 INFO nova.api.openstack [req-01c7c2cb-9f54-4fb8-93aa-7519d144fed8 demo invisible_to_admin] http://10.0.0.5:8774/v2/7e4726cb24ff4772892a9da915d158fa/os-certificates returned with HTTP 500 | |
2015-04-06 13:57:16.804 DEBUG nova.api.openstack.wsgi [req-01c7c2cb-9f54-4fb8-93aa-7519d144fed8 demo invisible_to_admin] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:1166 | |
2015-04-06 13:57:16.806 INFO nova.osapi_compute.wsgi.server [req-01c7c2cb-9f54-4fb8-93aa-7519d144fed8 demo invisible_to_admin] 10.0.0.5 "POST /v2/7e4726cb24ff4772892a9da915d158fa/os-certificates HTTP/1.1" status: 500 len: 335 time: 60.0925729 | |
2015-04-06 13:57:28.003 10563 DEBUG keystoneclient.session [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X GET http://10.0.0.5:35357/v3/auth/tokens -H "X-Subject-Token: {SHA1}2c00f2fb60b8fd845673ca9d799bcc6565907ec7" -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}4ea95eb4571708adbdb6319fa7a8883259bce0cf" _http_log_request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:195 | |
2015-04-06 13:57:28.004 10563 DEBUG urllib3.util.retry [-] Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0) from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155 | |
2015-04-06 13:57:28.117 10563 DEBUG keystoneclient.session [-] RESP: [200] content-length: 3979 x-subject-token: {SHA1}2c00f2fb60b8fd845673ca9d799bcc6565907ec7 vary: X-Auth-Token server: Apache/2.4.7 (Ubuntu) date: Mon, 06 Apr 2015 13:57:28 GMT content-type: application/json x-openstack-request-id: req-68130bdc-874a-4dbd-b672-a87e8e79ac51 | |
RESP BODY: {"token": {"methods": ["password", "token"], "roles": [{"id": "29c3efb6ee944050accec43eb9415596", "name": "admin"}], "expires_at": "2015-04-06T14:57:27.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "b49461b34ffb40eeb297b9365c4f12f9", "name": "admin"}, "catalog": "<removed>", "extras": {}, "user": {"domain": {"id": "default", "name": "Default"}, "id": "93e28369ee7c424ba318b8855ce4cb27", "name": "admin"}, "audit_ids": ["uIhsvv3jQDm5vhTm4VCW8A"], "issued_at": "2015-04-06T13:57:27.925152"}} | |
_http_log_response /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:224 | |
2015-04-06 13:57:28.120 DEBUG nova.api.openstack.wsgi [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] Action: 'create', calling method: <bound method CertificatesController.create of <nova.api.openstack.compute.contrib.certificates.CertificatesController object at 0x7fef13cfee50>>, body: {} _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:780 | |
2015-04-06 13:58:28.123 ERROR nova.api.openstack [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] Caught error: Timed out waiting for a reply to message ID 60da02e9aaf644e5b81d865adedda977 | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack Traceback (most recent call last): | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 125, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return req.get_response(self.application) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1320, in send | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack application, catch_exc_info=False) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1284, in call_application | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack app_iter = application(self.environ, start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 634, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return self._call_app(env, start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 554, in _call_app | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return self._app(env, _fake_start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/routes/middleware.py", line 136, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack response = self.app(environ, start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return resp(environ, start_response) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack resp = self.call_func(req, *args, **self.kwargs) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return self.func(req, *args, **kwargs) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 756, in __call__ | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack content_type, body, accept) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 821, in _process_stack | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack action_result = self.dispatch(meth, request, action_args) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 911, in dispatch | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack return method(req=request, **action_args) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/contrib/certificates.py", line 58, in create | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack user_id=context.user_id, project_id=context.project_id) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/opt/stack/nova/nova/cert/rpcapi.py", line 89, in generate_x509_cert | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack project_id=project_id) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 156, in call | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack retry=self.retry) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack timeout=timeout, retry=retry) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 350, in send | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack retry=retry) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 339, in _send | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack result = self._waiter.wait(msg_id, timeout) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 243, in wait | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack message = self.waiters.get(msg_id, timeout=timeout) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 149, in get | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack 'to message ID %s' % msg_id) | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack MessagingTimeout: Timed out waiting for a reply to message ID 60da02e9aaf644e5b81d865adedda977 | |
2015-04-06 13:58:28.123 10563 TRACE nova.api.openstack | |
2015-04-06 13:58:28.124 INFO nova.api.openstack [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] http://10.0.0.5:8774/v2/b49461b34ffb40eeb297b9365c4f12f9/os-certificates returned with HTTP 500 | |
2015-04-06 13:58:28.124 DEBUG nova.api.openstack.wsgi [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:1166 | |
2015-04-06 13:58:28.127 INFO nova.osapi_compute.wsgi.server [req-c891f15a-cfc0-4b5c-86cf-638c4a93fd15 admin admin] 10.0.0.5 "POST /v2/b49461b34ffb40eeb297b9365c4f12f9/os-certificates HTTP/1.1" status: 500 len: 335 time: 60.1252139 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
I'm having the same problem, I'm not able to download the EC2 credentials for using the Nova EC2 API because the following call hangs:
Having a look at the nova logs, I see exactly the same error, did you manage to solve it?
Thanks.
** SOLVED: Never mind, digging a bit more, just realized the service nova-cert is not running in our controllers, that is why the call hangs.