Skip to content

Instantly share code, notes, and snippets.

@RedKrieg

RedKrieg/ip a

Created December 6, 2018 17:30
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save RedKrieg/d12e3c1d2e0775eaa1f59e89dd999580 to your computer and use it in GitHub Desktop.
Save RedKrieg/d12e3c1d2e0775eaa1f59e89dd999580 to your computer and use it in GitHub Desktop.
Download ZIP
No guest dhcp/metadata with ovs, qvo160ce43a-1c sees provider net arp traffic
Raw
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: enp4s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000
link/ether 0c:c4:7a:28:83:b0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fe28:83b0/64 scope link
valid_lft forever preferred_lft forever
3: enp4s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 0c:c4:7a:28:83:b1 brd ff:ff:ff:ff:ff:ff
4: enp4s0f1.5@enp4s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-mgmt state UP group default qlen 1000
link/ether 0c:c4:7a:28:83:b1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fe28:83b1/64 scope link
valid_lft forever preferred_lft forever
5: br-mgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:28:83:b1 brd ff:ff:ff:ff:ff:ff
inet 168.235.100.3/25 brd 168.235.100.127 scope global br-mgmt
valid_lft forever preferred_lft forever
inet 10.5.0.3/16 scope global br-mgmt
valid_lft forever preferred_lft forever
inet6 fe80::ec4:7aff:fe28:83b1/64 scope link
valid_lft forever preferred_lft forever
6: enp4s0f1.6@enp4s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-storage state UP group default qlen 1000
link/ether 0c:c4:7a:28:83:b1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fe28:83b1/64 scope link
valid_lft forever preferred_lft forever
7: br-storage: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:28:83:b1 brd ff:ff:ff:ff:ff:ff
inet 10.6.0.3/16 brd 10.6.255.255 scope global br-storage
valid_lft forever preferred_lft forever
inet6 fe80::ec4:7aff:fe28:83b1/64 scope link
valid_lft forever preferred_lft forever
8: enp4s0f1.7@enp4s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
link/ether 0c:c4:7a:28:83:b1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fe28:83b1/64 scope link
valid_lft forever preferred_lft forever
9: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether c6:94:b9:3c:c1:44 brd ff:ff:ff:ff:ff:ff
10: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 36:d3:76:62:e1:45 brd ff:ff:ff:ff:ff:ff
11: br-vlan: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
link/ether 0c:c4:7a:28:83:b0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fe28:83b0/64 scope link
valid_lft forever preferred_lft forever
12: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 82:8b:47:05:3f:4c brd ff:ff:ff:ff:ff:ff
13: vxlan_sys_4789: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65000 qdisc noqueue master ovs-system state UNKNOWN group default qlen 1000
link/ether 92:9e:cf:8a:0a:cb brd ff:ff:ff:ff:ff:ff
inet6 fe80::909e:cfff:fe8a:acb/64 scope link
valid_lft forever preferred_lft forever
14: br-provider: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 92:50:c6:bd:4d:46 brd ff:ff:ff:ff:ff:ff
15: eth12@br-vlan-veth: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
link/ether 1a:39:fb:10:79:e8 brd ff:ff:ff:ff:ff:ff
inet6 fe80::1839:fbff:fe10:79e8/64 scope link
valid_lft forever preferred_lft forever
16: br-vlan-veth@eth12: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
link/ether 8e:4b:07:6c:31:d4 brd ff:ff:ff:ff:ff:ff
inet6 fe80::8c4b:7ff:fe6c:31d4/64 scope link
valid_lft forever preferred_lft forever
17: br-vxlan: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
link/ether 0c:c4:7a:28:83:b1 brd ff:ff:ff:ff:ff:ff
inet 10.7.0.3/16 brd 10.7.255.255 scope global br-vxlan
valid_lft forever preferred_lft forever
inet6 fe80::ec4:7aff:fe28:83b1/64 scope link
valid_lft forever preferred_lft forever
22: qbr160ce43a-1c: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 22:c5:54:8c:08:0e brd ff:ff:ff:ff:ff:ff
23: qvo160ce43a-1c@qvb160ce43a-1c: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
link/ether 1a:70:93:50:9e:cb brd ff:ff:ff:ff:ff:ff
inet6 fe80::1870:93ff:fe50:9ecb/64 scope link
valid_lft forever preferred_lft forever
24: qvb160ce43a-1c@qvo160ce43a-1c: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc noqueue master qbr160ce43a-1c state UP group default qlen 1000
link/ether 22:c5:54:8c:08:0e brd ff:ff:ff:ff:ff:ff
inet6 fe80::20c5:54ff:fe8c:80e/64 scope link
valid_lft forever preferred_lft forever
25: tap160ce43a-1c: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master qbr160ce43a-1c state UNKNOWN group default qlen 1000
link/ether fe:16:3e:bb:bc:17 brd ff:ff:ff:ff:ff:ff
inet6 fe80::fc16:3eff:febb:bc17/64 scope link
valid_lft forever preferred_lft forever
Raw
ovs-vsctl show
root@comp1:~# ovs-vsctl show
4e3c19cf-2c12-46b5-958d-dfef105d42f8
Manager "ptcp:6640:127.0.0.1"
is_connected: true
Bridge br-tun
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port "vxlan-0a070002"
Interface "vxlan-0a070002"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="10.7.0.3", out_key=flow, remote_ip="10.7.0.2"}
Port br-tun
Interface br-tun
type: internal
Bridge br-int
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
Port int-br-provider
Interface int-br-provider
type: patch
options: {peer=phy-br-provider}
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port "qvo160ce43a-1c"
tag: 2
Interface "qvo160ce43a-1c"
Port br-int
Interface br-int
type: internal
Bridge br-vxlan
Port "enp4s0f1.7"
tag: 7
Interface "enp4s0f1.7"
Port br-vxlan
Interface br-vxlan
type: internal
Bridge br-provider
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
Port br-provider
Interface br-provider
type: internal
Port phy-br-provider
Interface phy-br-provider
type: patch
options: {peer=int-br-provider}
Port "eth12"
Interface "eth12"
Bridge br-vlan
Port br-vlan
Interface br-vlan
type: internal
Port br-vlan-veth
Interface br-vlan-veth
Port "enp4s0f0"
Interface "enp4s0f0"
ovs_version: "2.10.0"
@RedKrieg
Copy link
Author

RedKrieg commented Dec 6, 2018

neutron log from attempt with DVR

2018-12-06 10:32:02.970 3824 WARNING neutron.plugins.ml2.drivers.mech_agent [req-f80cca16-447e-439a-bd26-0e339a51f9c2 c6cb329ee25440cfa4d6d101308f859b 385f9fac2ba94113b471b3179f2d4bf7 - default default] Refusing to bind port 731ec6e9-760c-4c35-a862-2e73018d8ec3 to dead agent: {'binary': u'neutron-openvswitch-agent', 'description': None, 'availability_zone': None, 'heartbeat_timestamp': datetime.datetime(2018, 12, 6, 3, 26, 46), 'admin_state_up': True, 'alive': False, 'topic': u'N/A', 'host': u'nyc-comp1', 'agent_type': u'Open vSwitch agent', 'resource_versions': {u'Subnet': u'1.0', u'Log': u'1.0', u'PortForwarding': u'1.0', u'SubPort': u'1.0', u'SecurityGroup': u'1.0', u'SecurityGroupRule': u'1.0', u'Trunk': u'1.1', u'QosPolicy': u'1.7', u'Port': u'1.4', u'Network': u'1.0'}, 'created_at': datetime.datetime(2018, 11, 30, 23, 10, 28), 'started_at': datetime.datetime(2018, 12, 6, 2, 54, 46), 'id': '67c336dc-2f3e-4fc4-89f7-6bf226afab7d', 'configurations': {u'ovs_hybrid_plug': True, u'in_distributed_mode': False, u'datapath_type': u'system', u'arp_responder_enabled': False, u'tunneling_ip': None, u'vhostuser_socket_dir': u'/var/run/openvswitch', u'devices': 0, u'ovs_capabilities': {u'datapath_types': [u'netdev', u'system'], u'iface_types': [u'erspan', u'geneve', u'gre', u'internal', u'ip6erspan', u'ip6gre', u'lisp', u'patch', u'stt', u'system', u'tap', u'vxlan']}, u'extensions': [], u'l2_population': False, u'tunnel_types': [], u'log_agent_heartbeats': False, u'enable_distributed_routing': False, u'bridge_mappings': {u'flat': u'br-provider'}}}
2018-12-06 10:32:02.970 3824 ERROR neutron.plugins.ml2.managers [req-f80cca16-447e-439a-bd26-0e339a51f9c2 c6cb329ee25440cfa4d6d101308f859b 385f9fac2ba94113b471b3179f2d4bf7 - default default] Failed to bind port 731ec6e9-760c-4c35-a862-2e73018d8ec3 on host nyc-comp1 for vnic_type normal using segments [{'network_id': '8beb3374-0036-44b7-87b7-a343746b1d60', 'segmentation_id': None, 'physical_network': u'flat', 'id': 'e3d3fc52-6839-4e5b-9e40-1fe78ed73111', 'network_type': u'flat'}]
2018-12-06 10:32:02.972 3824 INFO neutron.plugins.ml2.plugin [req-f80cca16-447e-439a-bd26-0e339a51f9c2 c6cb329ee25440cfa4d6d101308f859b 385f9fac2ba94113b471b3179f2d4bf7 - default default] Attempt 2 to bind port 731ec6e9-760c-4c35-a862-2e73018d8ec3
2018-12-06 10:32:02.997 3824 WARNING neutron.plugins.ml2.drivers.mech_agent [req-f80cca16-447e-439a-bd26-0e339a51f9c2 c6cb329ee25440cfa4d6d101308f859b 385f9fac2ba94113b471b3179f2d4bf7 - default default] Refusing to bind port 731ec6e9-760c-4c35-a862-2e73018d8ec3 to dead agent: {'binary': u'neutron-openvswitch-agent', 'description': None, 'availability_zone': None, 'heartbeat_timestamp': datetime.datetime(2018, 12, 6, 3, 26, 46), 'admin_state_up': True, 'alive': False, 'topic': u'N/A', 'host': u'nyc-comp1', 'agent_type': u'Open vSwitch agent', 'resource_versions': {u'Subnet': u'1.0', u'Log': u'1.0', u'PortForwarding': u'1.0', u'SubPort': u'1.0', u'SecurityGroup': u'1.0', u'SecurityGroupRule': u'1.0', u'Trunk': u'1.1', u'QosPolicy': u'1.7', u'Port': u'1.4', u'Network': u'1.0'}, 'created_at': datetime.datetime(2018, 11, 30, 23, 10, 28), 'started_at': datetime.datetime(2018, 12, 6, 2, 54, 46), 'id': '67c336dc-2f3e-4fc4-89f7-6bf226afab7d', 'configurations': {u'ovs_hybrid_plug': True, u'in_distributed_mode': False, u'datapath_type': u'system', u'arp_responder_enabled': False, u'tunneling_ip': None, u'vhostuser_socket_dir': u'/var/run/openvswitch', u'devices': 0, u'ovs_capabilities': {u'datapath_types': [u'netdev', u'system'], u'iface_types': [u'erspan', u'geneve', u'gre', u'internal', u'ip6erspan', u'ip6gre', u'lisp', u'patch', u'stt', u'system', u'tap', u'vxlan']}, u'extensions': [], u'l2_population': False, u'tunnel_types': [], u'log_agent_heartbeats': False, u'enable_distributed_routing': False, u'bridge_mappings': {u'flat': u'br-provider'}}}
2018-12-06 10:32:02.998 3824 ERROR neutron.plugins.ml2.managers [req-f80cca16-447e-439a-bd26-0e339a51f9c2 c6cb329ee25440cfa4d6d101308f859b 385f9fac2ba94113b471b3179f2d4bf7 - default default] Failed to bind port 731ec6e9-760c-4c35-a862-2e73018d8ec3 on host nyc-comp1 for vnic_type normal using segments [{'network_id': '8beb3374-0036-44b7-87b7-a343746b1d60', 'segmentation_id': None, 'physical_network': u'flat', 'id': 'e3d3fc52-6839-4e5b-9e40-1fe78ed73111', 'network_type': u'flat'}]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment