gistfile1.txt

0225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', 'addr', 'show', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:14:48.921 4556 DEBUG neutron.agent.linux.utils [req-631d56e0-bf85-4c0a-93a5-2b6a0f00bbc8 de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-HUP', '6158'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:15:05.117 4556 DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process._check_child_processes" :: waited 0.000s inner /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273
2019-02-26 18:15:05.120 4556 DEBUG neutron.agent.linux.dhcp [req-631d56e0-bf85-4c0a-93a5-2b6a0f00bbc8 de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Reloading allocations for network: 0048fce6-c715-4106-a810-473620326cb0 reload_allocations /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:524
2019-02-26 18:15:05.121 4556 DEBUG neutron.agent.linux.utils [req-631d56e0-bf85-4c0a-93a5-2b6a0f00bbc8 de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-4', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:15:11.979 4556 DEBUG neutron.agent.linux.utils [req-631d56e0-bf85-4c0a-93a5-2b6a0f00bbc8 de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-6', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:17:35.787 4556 ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae2a8a6-605a-4f7d-bd0e-46f015d60db3] AMQP server on 172.24.0.97:5671 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: ConnectionForced: Too many heartbeats missed
2019-02-26 18:17:35.788 4556 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 104] Connection reset by peer
2019-02-26 18:17:35.798 4556 DEBUG oslo_concurrency.lockutils [req-631d56e0-bf85-4c0a-93a5-2b6a0f00bbc8 de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Releasing semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228
2019-02-26 18:17:35.799 4556 DEBUG oslo_concurrency.lockutils [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Acquired semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
2019-02-26 18:17:35.800 4556 INFO neutron.agent.dhcp.agent [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=kvm1-sjc1.vexxhost.us, binding:profile=, binding:vif_details=, binding:vif_type=unbound, binding:vnic_type=normal, created_at=2019-02-21T12:10:00Z, description=, device_id=72b8bcee-83fd-4a14-9f2e-584b900d510e, device_owner=compute:nova, dns_assignment=[{u'hostname': u'ubuntu-xenial-vexxhost-sjc1-0002830897', u'ip_address': u'38.108.68.141', u'fqdn': u'ubuntu-xenial-vexxhost-sjc1-0002830897.vexxhost.local.'}], dns_name=ubuntu-xenial-vexxhost-sjc1-0002830897, extra_dhcp_opts=[], fixed_ips=[{u'subnet_id': u'05a55a42-ff5e-4b53-a6a7-e9f4d1cc5a56', u'ip_address': u'38.108.68.141'}], id=3951d0e8-3dcc-4233-a80f-4db781693474, mac_address=fa:16:3e:5b:d4:df, name=, network_id=0048fce6-c715-4106-a810-473620326cb0, port_security_enabled=True, project_id=86bbbcfa8ad043109d2d7af530225c72, revision_number=2, security_groups=[u'dc28a434-9cc2-4d7e-8589-977513143754'], status=DOWN, tags=[], tenant_id=86bbbcfa8ad043109d2d7af530225c72, updated_at=2019-02-21T12:10:01Z
2019-02-26 18:17:35.804 4556 DEBUG neutron.agent.dhcp.agent [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Calling driver for network: 0048fce6-c715-4106-a810-473620326cb0 action: reload_allocations call_driver /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py:135
2019-02-26 18:17:35.807 4556 DEBUG neutron.agent.linux.dhcp [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Building host file: /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:695
2019-02-26 18:17:35.812 4556 DEBUG neutron.agent.linux.dhcp [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Done building host file /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:734
2019-02-26 18:17:35.816 4556 DEBUG neutron.agent.linux.utils [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', 'addr', 'show', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:17:41.650 4556 DEBUG neutron.agent.linux.utils [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-HUP', '6158'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:17:52.812 4556 ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae2a8a6-605a-4f7d-bd0e-46f015d60db3] AMQP server on 172.24.0.97:5671 is unreachable: <AMQPError: unknown error>. Trying again in 1 seconds.: RecoverableConnectionError: <AMQPError: unknown error>
2019-02-26 18:17:52.814 4556 DEBUG neutron.agent.linux.dhcp [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Reloading allocations for network: 0048fce6-c715-4106-a810-473620326cb0 reload_allocations /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:524
2019-02-26 18:17:52.815 4556 DEBUG neutron.agent.linux.utils [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-4', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:17:59.510 4556 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 104] Connection reset by peer
2019-02-26 18:17:59.513 4556 DEBUG neutron.agent.linux.utils [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-6', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:18:10.428 4556 ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae2a8a6-605a-4f7d-bd0e-46f015d60db3] AMQP server on 172.24.0.97:5671 is unreachable: <AMQPError: unknown error>. Trying again in 1 seconds.: RecoverableConnectionError: <AMQPError: unknown error>
2019-02-26 18:18:10.438 4556 DEBUG oslo_concurrency.lockutils [req-81a4b3f2-c763-45cb-9588-c8a317b66655 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Releasing semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228
2019-02-26 18:18:10.440 4556 DEBUG oslo_concurrency.lockutils [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Acquired semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
2019-02-26 18:18:10.440 4556 INFO neutron.agent.dhcp.agent [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=, binding:profile=, binding:vif_details=, binding:vif_type=unbound, binding:vnic_type=normal, created_at=2019-02-21T12:10:01Z, description=, device_id=79c814f4-7b9f-46e1-a5f7-4f56eb2878fe, device_owner=, dns_assignment=[{u'hostname': u'host-38-108-68-108', u'ip_address': u'38.108.68.108', u'fqdn': u'host-38-108-68-108.vexxhost.local.'}], dns_name=, extra_dhcp_opts=[], fixed_ips=[{u'subnet_id': u'05a55a42-ff5e-4b53-a6a7-e9f4d1cc5a56', u'ip_address': u'38.108.68.108'}], id=5180a74d-cb55-4cca-a7f1-cf42487a2d87, mac_address=fa:16:3e:dd:e0:1c, name=, network_id=0048fce6-c715-4106-a810-473620326cb0, port_security_enabled=True, project_id=86bbbcfa8ad043109d2d7af530225c72, revision_number=1, security_groups=[u'dc28a434-9cc2-4d7e-8589-977513143754'], status=DOWN, tags=[], tenant_id=86bbbcfa8ad043109d2d7af530225c72, updated_at=2019-02-21T12:10:01Z
2019-02-26 18:18:10.444 4556 DEBUG neutron.agent.dhcp.agent [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Calling driver for network: 0048fce6-c715-4106-a810-473620326cb0 action: reload_allocations call_driver /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py:135
2019-02-26 18:18:10.448 4556 DEBUG neutron.agent.linux.dhcp [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Building host file: /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:695
2019-02-26 18:18:10.453 4556 DEBUG neutron.agent.linux.dhcp [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Done building host file /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:734
2019-02-26 18:18:10.457 4556 DEBUG neutron.agent.linux.utils [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', 'addr', 'show', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:18:17.148 4556 DEBUG neutron.agent.linux.utils [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-HUP', '6158'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:18:27.437 4556 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 104] Connection reset by peer
2019-02-26 18:18:27.438 4556 DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" released by "neutron.agent.linux.external_process._check_child_processes" :: held 202.321s inner /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285
2019-02-26 18:18:27.440 4556 DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process._check_child_processes" :: waited 51.650s inner /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273
2019-02-26 18:18:27.441 4556 DEBUG neutron.agent.linux.dhcp [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Reloading allocations for network: 0048fce6-c715-4106-a810-473620326cb0 reload_allocations /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:524
2019-02-26 18:18:27.442 4556 DEBUG neutron.agent.linux.utils [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-4', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:18:28.224 4556 ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae2a8a6-605a-4f7d-bd0e-46f015d60db3] AMQP server on 172.24.0.97:5671 is unreachable: <AMQPError: unknown error>. Trying again in 1 seconds.: RecoverableConnectionError: <AMQPError: unknown error>
2019-02-26 18:18:34.363 4556 DEBUG neutron.agent.linux.utils [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-6', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent [req-ee60c938-c506-4186-987b-ba6825e19102 - - - - -] Failed reporting state!: MessagingTimeout: Timed out waiting for a reply to message ID 56e76272c8fc4b76ae9c716eb1a9b401
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent Traceback (most recent call last):
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py", line 762, in _report_state
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     ctx, self.agent_state, True)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/rpc.py", line 97, in report_state
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     return method(context, 'report_state', **kwargs)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 179, in call
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     retry=self.retry)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_messaging/transport.py", line 133, in _send
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     retry=retry)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 584, in send
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     call_monitor_timeout, retry=retry)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 573, in _send
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     call_monitor_timeout)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 459, in wait
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     message = self.waiters.get(msg_id, timeout=timeout)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent   File "/openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 336, in get
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent     'to message ID %s' % msg_id)
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent MessagingTimeout: Timed out waiting for a reply to message ID 56e76272c8fc4b76ae9c716eb1a9b401
2019-02-26 18:18:50.231 4556 ERROR neutron.agent.dhcp.agent 
2019-02-26 18:18:50.233 4556 WARNING oslo.service.loopingcall [req-ee60c938-c506-4186-987b-ba6825e19102 - - - - -] Function 'neutron.agent.dhcp.agent.DhcpAgentWithStateReport._report_state' run outlasted interval by 14.45 sec
2019-02-26 18:18:50.235 4556 ERROR neutron.common.rpc [req-a6d12a63-f2f1-48b6-8abf-ea84f815ac48 - - - - -] Timeout in RPC method dhcp_ready_on_ports. Waiting for 7 seconds before next attempt. If the server is not down, consider increasing the rpc_response_timeout option as Neutron server(s) may be overloaded and unable to respond quickly enough.: MessagingTimeout: Timed out waiting for a reply to message ID 84a59f9f7fbf4aa29bfe8dac544a8031
2019-02-26 18:18:50.236 4556 WARNING neutron.common.rpc [req-a6d12a63-f2f1-48b6-8abf-ea84f815ac48 - - - - -] Increasing timeout for dhcp_ready_on_ports calls to 120 seconds. Restart the agent to restore it to the default value.: MessagingTimeout: Timed out waiting for a reply to message ID 84a59f9f7fbf4aa29bfe8dac544a8031
2019-02-26 18:18:50.245 4556 ERROR oslo.messaging._drivers.impl_rabbit [-] [1ae2a8a6-605a-4f7d-bd0e-46f015d60db3] AMQP server on 172.24.0.97:5671 is unreachable: <AMQPError: unknown error>. Trying again in 1 seconds.: RecoverableConnectionError: <AMQPError: unknown error>
2019-02-26 18:18:50.256 4556 DEBUG oslo_concurrency.lockutils [req-59a33be2-fc0b-4bc7-bfe4-300c78841adb de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - - -] Releasing semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228
2019-02-26 18:18:50.257 4556 DEBUG oslo_concurrency.lockutils [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Acquired semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
2019-02-26 18:18:50.257 4556 INFO neutron.agent.dhcp.agent [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=kvm11-sjc1.vexxhost.us, binding:profile=, binding:vif_details=datapath_type=system, ovs_hybrid_plug=True, port_filter=True, binding:vif_type=ovs, binding:vnic_type=normal, created_at=2019-02-21T12:09:59Z, description=, device_id=327e7cbc-1139-4a0a-b5d4-842a7d540e7b, device_owner=compute:nova, dns_assignment=[{u'hostname': u'ubuntu-xenial-vexxhost-sjc1-0002830891', u'ip_address': u'38.108.68.142', u'fqdn': u'ubuntu-xenial-vexxhost-sjc1-0002830891.vexxhost.local.'}], dns_name=ubuntu-xenial-vexxhost-sjc1-0002830891, extra_dhcp_opts=[], fixed_ips=[{u'subnet_id': u'05a55a42-ff5e-4b53-a6a7-e9f4d1cc5a56', u'ip_address': u'38.108.68.142'}], id=2d0ddf44-24a7-4e0c-8c5b-31b43843b2d4, mac_address=fa:16:3e:02:fb:72, name=, network_id=0048fce6-c715-4106-a810-473620326cb0, port_security_enabled=True, project_id=86bbbcfa8ad043109d2d7af530225c72, revision_number=3, security_groups=[u'dc28a434-9cc2-4d7e-8589-977513143754'], status=DOWN, tags=[], tenant_id=86bbbcfa8ad043109d2d7af530225c72, updated_at=2019-02-21T12:10:02Z
2019-02-26 18:18:50.261 4556 DEBUG neutron.agent.dhcp.agent [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Calling driver for network: 0048fce6-c715-4106-a810-473620326cb0 action: reload_allocations call_driver /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py:135
2019-02-26 18:18:50.266 4556 DEBUG neutron.agent.linux.dhcp [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Building host file: /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:695
2019-02-26 18:18:50.272 4556 DEBUG neutron.agent.linux.dhcp [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Done building host file /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:734
2019-02-26 18:18:50.276 4556 DEBUG neutron.agent.linux.utils [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', 'addr', 'show', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:09.119 4556 ERROR neutron.agent.dhcp.agent [req-a6d12a63-f2f1-48b6-8abf-ea84f815ac48 - - - - -] Timeout notifying server of ports ready. Retrying...: MessagingTimeout: Timed out waiting for a reply to message ID 84a59f9f7fbf4aa29bfe8dac544a8031
2019-02-26 18:19:09.121 4556 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 104] Connection reset by peer
2019-02-26 18:19:09.127 4556 DEBUG neutron.agent.linux.utils [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-HUP', '6158'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:09.854 4556 DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" released by "neutron.agent.linux.external_process._check_child_processes" :: held 42.414s inner /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285
2019-02-26 18:19:09.855 4556 DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" acquired by "neutron.agent.linux.external_process._check_child_processes" :: waited 19.609s inner /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:273
2019-02-26 18:19:09.858 4556 INFO oslo.messaging._drivers.impl_rabbit [-] [1ae2a8a6-605a-4f7d-bd0e-46f015d60db3] Reconnected to AMQP server on 172.24.0.97:5671 via [amqp] client with port 50016.
2019-02-26 18:19:09.860 4556 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 56e76272c8fc4b76ae9c716eb1a9b401
2019-02-26 18:19:09.861 4556 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 84a59f9f7fbf4aa29bfe8dac544a8031
2019-02-26 18:19:09.867 4556 DEBUG oslo_concurrency.lockutils [-] Lock "_check_child_processes" released by "neutron.agent.linux.external_process._check_child_processes" :: held 0.012s inner /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:285
2019-02-26 18:19:10.164 4556 DEBUG neutron.agent.linux.dhcp [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Reloading allocations for network: 0048fce6-c715-4106-a810-473620326cb0 reload_allocations /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:524
2019-02-26 18:19:10.165 4556 DEBUG neutron.agent.linux.utils [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-4', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:11.296 4556 DEBUG neutron.agent.linux.utils [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-6', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:12.416 4556 DEBUG oslo_concurrency.lockutils [req-45d8c7c7-bc91-4ca0-a04c-461421766f42 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Releasing semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228
2019-02-26 18:19:12.418 4556 DEBUG oslo_concurrency.lockutils [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Acquired semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
2019-02-26 18:19:12.419 4556 INFO neutron.agent.dhcp.agent [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=kvm8-sjc1.vexxhost.us, binding:profile=, binding:vif_details=, binding:vif_type=unbound, binding:vnic_type=normal, created_at=2019-02-21T12:10:01Z, description=, device_id=7d8e4b63-87d2-4fec-b424-bb42e337f988, device_owner=compute:nova, dns_assignment=[{u'hostname': u'ubuntu-xenial-vexxhost-sjc1-0002830898', u'ip_address': u'38.108.68.83', u'fqdn': u'ubuntu-xenial-vexxhost-sjc1-0002830898.vexxhost.local.'}], dns_name=ubuntu-xenial-vexxhost-sjc1-0002830898, extra_dhcp_opts=[], fixed_ips=[{u'subnet_id': u'05a55a42-ff5e-4b53-a6a7-e9f4d1cc5a56', u'ip_address': u'38.108.68.83'}], id=1f27e548-7ea9-47b1-8f89-5b51b64c618a, mac_address=fa:16:3e:3b:77:23, name=, network_id=0048fce6-c715-4106-a810-473620326cb0, port_security_enabled=True, project_id=86bbbcfa8ad043109d2d7af530225c72, revision_number=2, security_groups=[u'dc28a434-9cc2-4d7e-8589-977513143754'], status=DOWN, tags=[], tenant_id=86bbbcfa8ad043109d2d7af530225c72, updated_at=2019-02-21T12:10:02Z
2019-02-26 18:19:12.423 4556 DEBUG neutron.agent.dhcp.agent [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Calling driver for network: 0048fce6-c715-4106-a810-473620326cb0 action: reload_allocations call_driver /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py:135
2019-02-26 18:19:12.427 4556 DEBUG neutron.agent.linux.dhcp [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Building host file: /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:695
2019-02-26 18:19:12.433 4556 DEBUG neutron.agent.linux.dhcp [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Done building host file /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:734
2019-02-26 18:19:12.437 4556 DEBUG neutron.agent.linux.utils [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', 'addr', 'show', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:13.508 4556 DEBUG neutron.agent.linux.utils [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-HUP', '6158'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:14.644 4556 DEBUG neutron.agent.linux.dhcp [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Reloading allocations for network: 0048fce6-c715-4106-a810-473620326cb0 reload_allocations /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:524
2019-02-26 18:19:14.645 4556 DEBUG neutron.agent.linux.utils [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-4', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:15.755 4556 DEBUG neutron.agent.linux.utils [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-6', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:16.800 4556 DEBUG oslo_concurrency.lockutils [req-e8590422-b2c1-4965-b3b5-95855d5811cd 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Releasing semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228
2019-02-26 18:19:16.802 4556 DEBUG oslo_concurrency.lockutils [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Acquired semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
2019-02-26 18:19:16.802 4556 INFO neutron.agent.dhcp.agent [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=kvm9-sjc1.vexxhost.us, binding:profile=, binding:vif_details=datapath_type=system, ovs_hybrid_plug=True, port_filter=True, binding:vif_type=ovs, binding:vnic_type=normal, created_at=2019-02-21T12:10:00Z, description=, device_id=7887360f-13e1-4b0a-81ac-62d1dba174df, device_owner=compute:nova, dns_assignment=[{u'hostname': u'ubuntu-xenial-vexxhost-sjc1-0002830896', u'ip_address': u'38.108.68.111', u'fqdn': u'ubuntu-xenial-vexxhost-sjc1-0002830896.vexxhost.local.'}], dns_name=ubuntu-xenial-vexxhost-sjc1-0002830896, extra_dhcp_opts=[], fixed_ips=[{u'subnet_id': u'05a55a42-ff5e-4b53-a6a7-e9f4d1cc5a56', u'ip_address': u'38.108.68.111'}], id=204ccc5c-21d1-4457-9fbc-0e47e1ae0dfc, mac_address=fa:16:3e:73:ea:4f, name=, network_id=0048fce6-c715-4106-a810-473620326cb0, port_security_enabled=True, project_id=86bbbcfa8ad043109d2d7af530225c72, revision_number=3, security_groups=[u'dc28a434-9cc2-4d7e-8589-977513143754'], status=DOWN, tags=[], tenant_id=86bbbcfa8ad043109d2d7af530225c72, updated_at=2019-02-21T12:10:02Z
2019-02-26 18:19:16.806 4556 DEBUG neutron.agent.dhcp.agent [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Calling driver for network: 0048fce6-c715-4106-a810-473620326cb0 action: reload_allocations call_driver /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py:135
2019-02-26 18:19:16.810 4556 DEBUG neutron.agent.linux.dhcp [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Building host file: /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:695
2019-02-26 18:19:16.815 4556 DEBUG neutron.agent.linux.dhcp [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Done building host file /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:734
2019-02-26 18:19:16.819 4556 DEBUG neutron.agent.linux.utils [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', 'addr', 'show', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:17.872 4556 DEBUG neutron.agent.linux.utils [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-HUP', '6158'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:18.978 4556 DEBUG neutron.agent.linux.dhcp [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Reloading allocations for network: 0048fce6-c715-4106-a810-473620326cb0 reload_allocations /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:524
2019-02-26 18:19:18.980 4556 DEBUG neutron.agent.linux.utils [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-4', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:20.042 4556 DEBUG neutron.agent.linux.utils [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-6', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:21.119 4556 DEBUG oslo_concurrency.lockutils [req-cc957b6b-5588-4573-8a65-f83f007b20b1 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Releasing semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:228
2019-02-26 18:19:21.121 4556 DEBUG oslo_concurrency.lockutils [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Acquired semaphore "dhcp-agent-network-lock-0048fce6-c715-4106-a810-473620326cb0" lock /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:212
2019-02-26 18:19:21.121 4556 INFO neutron.agent.dhcp.agent [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=kvm2-sjc1.vexxhost.us, binding:profile=, binding:vif_details=, binding:vif_type=unbound, binding:vnic_type=normal, created_at=2019-02-21T12:10:00Z, description=, device_id=18d6a758-6c9f-4d2b-a9db-10b8cc94462d, device_owner=compute:nova, dns_assignment=[{u'hostname': u'ubuntu-xenial-vexxhost-sjc1-0002830748', u'ip_address': u'38.108.68.131', u'fqdn': u'ubuntu-xenial-vexxhost-sjc1-0002830748.vexxhost.local.'}], dns_name=ubuntu-xenial-vexxhost-sjc1-0002830748, extra_dhcp_opts=[], fixed_ips=[{u'subnet_id': u'05a55a42-ff5e-4b53-a6a7-e9f4d1cc5a56', u'ip_address': u'38.108.68.131'}], id=bf1bf9a2-eaf5-476c-8d8f-c08f1ec152f0, mac_address=fa:16:3e:9f:ce:b2, name=, network_id=0048fce6-c715-4106-a810-473620326cb0, port_security_enabled=True, project_id=86bbbcfa8ad043109d2d7af530225c72, revision_number=2, security_groups=[u'dc28a434-9cc2-4d7e-8589-977513143754'], status=DOWN, tags=[], tenant_id=86bbbcfa8ad043109d2d7af530225c72, updated_at=2019-02-21T12:10:02Z
2019-02-26 18:19:21.125 4556 DEBUG neutron.agent.dhcp.agent [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Calling driver for network: 0048fce6-c715-4106-a810-473620326cb0 action: reload_allocations call_driver /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/dhcp/agent.py:135
2019-02-26 18:19:21.129 4556 DEBUG neutron.agent.linux.dhcp [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Building host file: /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:695
2019-02-26 18:19:21.134 4556 DEBUG neutron.agent.linux.dhcp [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Done building host file /var/lib/neutron/dhcp/0048fce6-c715-4106-a810-473620326cb0/host _output_hosts_file /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:734
2019-02-26 18:19:21.138 4556 DEBUG neutron.agent.linux.utils [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', 'addr', 'show', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:22.207 4556 DEBUG neutron.agent.linux.utils [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-HUP', '6158'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92
2019-02-26 18:19:23.351 4556 DEBUG neutron.agent.linux.dhcp [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Reloading allocations for network: 0048fce6-c715-4106-a810-473620326cb0 reload_allocations /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/dhcp.py:524
2019-02-26 18:19:23.352 4556 DEBUG neutron.agent.linux.utils [req-b7419f24-b171-4978-805d-d2b5b7096470 6a75e5d16bda4ff587df2b857467328a 0409ebdbae6045ebb924a64589653e64 - - -] Running command: ['sudo', '/openstack/venvs/neutron-18.0.0/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-0048fce6-c715-4106-a810-473620326cb0', 'ip', '-4', 'route', 'list', 'dev', 'tap89d88fe7-85'] create_process /openstack/venvs/neutron-18.0.0/lib/python2.7/site-packages/neutron/agent/linux/utils.py:92