Skip to content

Instantly share code, notes, and snippets.

@KevoTran

KevoTran/controller_error_log

Created May 26, 2016 23:03
Show Gist options
  • Save KevoTran/61b42936506465f08ad2775f3af0c87d to your computer and use it in GitHub Desktop.
Save KevoTran/61b42936506465f08ad2775f3af0c87d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
controller_error_log
016-05-26 22:45:41.991 32561 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.
2016-05-26 22:45:53.001 32561 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.
2016-05-26 22:45:56.673 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.amphora_driver_tasks.AmphoraPostVIPPlug' (0cdf3464-aeb6-47ce-82cf-cb37c7289363) transitioned into state 'FAILURE' from state 'RUNNING'
9 predecessors (most recent first):
Atom 'octavia.controller.worker.tasks.network_tasks.GetAmphoraeNetworkConfigs' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f2c6d68bb10>}, 'provides': {u'acb4ac42-34c9-44d1-bf29-6ef8cabe315f': <octavia.network.data_models.AmphoraNetworkConfig object at 0x7f2c6d64c790>}}
|__Atom 'reload-lb-after-plug-vip' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': u'4c44b230-778f-4de3-a63b-aa8abd7dbf2a'}, 'provides': <octavia.common.data_models.LoadBalancer object at 0x7f2c6d68bb10>}
|__Atom 'octavia.controller.worker.tasks.database_tasks.UpdateAmphoraVIPData' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'amps_data': [<octavia.common.data_models.Amphora object at 0x7f2c6f8a6f90>]}, 'provides': None}
|__Atom 'octavia.controller.worker.tasks.network_tasks.PlugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f2c6d6bcc50>}, 'provides': [<octavia.common.data_models.Amphora object at 0x7f2c6f8a6f90>]}
|__Atom 'octavia.controller.worker.tasks.database_tasks.UpdateVIPAfterAllocation' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'vip': <octavia.common.data_models.Vip object at 0x7f2c6d68b2d0>, 'loadbalancer_id': u'4c44b230-778f-4de3-a63b-aa8abd7dbf2a'}, 'provides': <octavia.common.data_models.LoadBalancer object at 0x7f2c6d6bcc50>}
|__Atom 'octavia.controller.worker.tasks.network_tasks.AllocateVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f2c6d68b350>}, 'provides': <octavia.common.data_models.Vip object at 0x7f2c6d68b2d0>}
|__Flow 'octavia-new-loadbalancer-net-subflow'
|__Atom 'post-amphora-association-octavia-post-loadbalancer-amp_association-subflow-reload-lb-after-amp-assoc' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': u'4c44b230-778f-4de3-a63b-aa8abd7dbf2a'}, 'provides': <octavia.common.data_models.LoadBalancer object at 0x7f2c6d68b350>}
|__Flow 'post-amphora-association-octavia-post-loadbalancer-amp_association-subflow'
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last):
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments)
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/controller/worker/tasks/amphora_driver_tasks.py", line 229, in execute
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker loadbalancer, amphorae_network_config)
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/amphorae/drivers/haproxy/rest_api_driver.py", line 130, in post_vip_plug
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker net_info)
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/amphorae/drivers/haproxy/rest_api_driver.py", line 325, in plug_vip
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker return exc.check_exception(r)
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/amphorae/drivers/haproxy/exceptions.py", line 32, in check_exception
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker raise responses[status_code]()
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker NotFound: Not Found
2016-05-26 22:45:56.673 32561 ERROR octavia.controller.worker.controller_worker
2016-05-26 22:45:56.692 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.amphora_driver_tasks.AmphoraPostVIPPlug' (0cdf3464-aeb6-47ce-82cf-cb37c7289363) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:56.698 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.network_tasks.GetAmphoraeNetworkConfigs' (73daa0c7-25f1-4b4b-bec6-e5eef6e92eef) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:56.705 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'reload-lb-after-plug-vip' (67cf5031-e2cd-41af-bfa8-993825a83776) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:56.711 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.database_tasks.UpdateAmphoraVIPData' (07ce37aa-7af7-4655-8339-f5d6f7260c80) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:56.715 32561 WARNING octavia.controller.worker.tasks.network_tasks [-] Unable to plug VIP for loadbalancer id 4c44b230-778f-4de3-a63b-aa8abd7dbf2a
2016-05-26 22:45:58.084 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.network_tasks.PlugVIP' (26ecf0b7-1619-417b-9ed8-dd8559eb40ff) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:58.089 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.database_tasks.UpdateVIPAfterAllocation' (11de9738-8518-45b5-b092-f9938eeb9ae0) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:58.106 32561 WARNING octavia.controller.worker.tasks.network_tasks [-] Deallocating vip 10.200.0.120
2016-05-26 22:45:58.248 32561 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port e421550f-c60e-4b42-81c0-654c5d2dab03 will not be deleted by Octavia as it was not created by Octavia.
2016-05-26 22:45:58.452 32561 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group b06daeae-3949-4d3d-8a5d-2c77f54d81b2 from port e421550f-c60e-4b42-81c0-654c5d2dab03
2016-05-26 22:45:59.696 32561 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group b06daeae-3949-4d3d-8a5d-2c77f54d81b2
2016-05-26 22:45:59.703 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'octavia.controller.worker.tasks.network_tasks.AllocateVIP' (9cda54da-e00f-41ca-9c58-9474837265ff) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:59.714 32561 WARNING octavia.controller.worker.controller_worker [-] Task 'post-amphora-association-octavia-post-loadbalancer-amp_association-subflow-reload-lb-after-amp-assoc' (854355ac-5236-461f-9f98-a87350291797) transitioned into state 'REVERTED' from state 'REVERTING'
2016-05-26 22:45:59.725 32561 WARNING octavia.controller.worker.controller_worker [-] Flow 'post-amphora-association-octavia-post-loadbalancer-amp_association-subflow' (05f75661-daf3-44c0-bae1-8b2f9a965efa) transitioned into state 'REVERTED' from state 'RUNNING'
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server [-] Exception during handling message
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 153, in dispatch
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 122, in _do_dispatch
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 45, in create_load_balancer
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server self.worker.create_load_balancer(load_balancer_id)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 322, in create_load_balancer
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server post_lb_amp_assoc.run()
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 246, in run
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout):
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 339, in run_iter
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(fails)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server failures[0].reraise()
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 82, in _execute_task
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server result = task.execute(**arguments)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/controller/worker/tasks/amphora_driver_tasks.py", line 229, in execute
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server loadbalancer, amphorae_network_config)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/amphorae/drivers/haproxy/rest_api_driver.py", line 130, in post_vip_plug
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server net_info)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/amphorae/drivers/haproxy/rest_api_driver.py", line 325, in plug_vip
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server return exc.check_exception(r)
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server File "/opt/bbc/openstack-11.0-master/neutron/local/lib/python2.7/site-packages/octavia/amphorae/drivers/haproxy/exceptions.py", line 32, in check_exception
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server raise responses[status_code]()
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server NotFound: Not Found
2016-05-26 22:45:59.729 32561 ERROR oslo_messaging.rpc.server
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment