Skip to content

Instantly share code, notes, and snippets.

@Mudpuppy12

Mudpuppy12/gist:5d652e22dc06337797e235259ffa2992

Last active March 14, 2017 18:04
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Mudpuppy12/5d652e22dc06337797e235259ffa2992 to your computer and use it in GitHub Desktop.
Save Mudpuppy12/5d652e22dc06337797e235259ffa2992 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
root@729100-infra01-utility-container-5b22864e:~# i2 node-show 729507
+------------------------+--------------------------------------------------------------------------+
| Property | Value |
+------------------------+--------------------------------------------------------------------------+
| chassis_uuid | |
| clean_step | {} |
| console_enabled | False |
| created_at | 2017-03-07T20:26:23+00:00 |
| driver | agent_ipmitool |
| driver_info | {u'ipmi_password': u'******', u'ipmi_address': u'10.15.243.238', |
| | u'ipmi_username': u'root', u'deploy_kernel': |
| | u'a9570c86-aa9d-4415-9902-10cc0964a205', u'deploy_ramdisk': |
| | u'f20ded73-4964-4b32-bda7-e314e1e013a1'} |
| driver_internal_info | {u'clean_steps': [{u'interface': u'raid', u'step': |
| | u'delete_configuration'}, {u'interface': u'raid', u'step': |
| | u'create_configuration'}], u'agent_erase_devices_iterations': 1} |
| extra | {} |
| inspection_finished_at | None |
| inspection_started_at | None |
| instance_info | {u'root_gb': 744, u'deploy_ramdisk': u'944f7c33-3a0c-435d- |
| | 90d9-42ab89a326e6', u'deploy_kernel': u'f79c2a10-e51c-4e8d-99ad- |
| | 9b4a0849882c', u'deploy_key': u'78EHVEAMZXO226PT0JV60CG00UJTZEVE'} |
| instance_uuid | None |
| last_error | None |
| maintenance | False |
| maintenance_reason | None |
| name | 729507 |
| power_state | power on |
| properties | {u'cpu_arch': u'x86_64', u'cpus': 48, u'capabilities': u'memory_mb:25480 |
| | 2,local_gb:744,cpu_arch:x86_64,cpus:48,boot_option:local,disk_label:gpt, |
| | system_type:comp', u'memory_mb': 254802, u'local_gb': 744, u'size': |
| | 3600} |
| provision_state | clean failed |
| provision_updated_at | 2017-03-07T20:57:48+00:00 |
| raid_config | {} |
| reservation | None |
| target_power_state | None |
| target_provision_state | manageable |
| target_raid_config | {u'logical_disks': [{u'size_gb': u'MAX', u'physical_disks': [u'1I:1:1', |
| | u'1I:1:2'], u'raid_level': u'1', u'is_root_volume': True, u'controller': |
| | u'Smart Array P840 in Slot 3', u'volume_name': u'root_volume'}, |
| | {u'size_gb': u'MAX', u'controller': u'Smart Array P840 in Slot 3', |
| | u'raid_level': u'1', u'physical_disks': [u'1I:1:3', u'1I:1:4'], |
| | u'volume_name': u'app_volume'}, {u'size_gb': u'MAX', u'controller': |
| | u'Smart Array P840 in Slot 3', u'raid_level': u'1+0', u'physical_disks': |
| | [u'1I:1:5', u'1I:1:6', u'1I:1:7', u'1I:1:8', u'2I:2:1', u'2I:2:2', |
| | u'2I:2:3', u'2I:2:4'], u'volume_name': u'data_volume'}]} |
| updated_at | 2017-03-10T23:46:59+00:00 |
| uuid | bdade5f7-f3bb-4bbc-9d19-df2d3116eb2b |
+------------------------+--------------------------------------------------------------------------+
root@729100-infra01-utility-container-5b22864e:~# i2 node-port-list bdade5f7-f3bb-4bbc-9d19-df2d3116eb2b
+--------------------------------------+-------------------+
| UUID | Address |
+--------------------------------------+-------------------+
| cccb4960-6cf5-4482-bf34-e10e8ed784d6 | 68:05:ca:32:4a:20 |
+--------------------------------------+-------------------+
root@729100-infra01-utility-container-5b22864e:~# i2 port-show cccb4960-6cf5-4482-bf34-e10e8ed784d6
+------------+-----------------------------------------------------------+
| Property | Value |
+------------+-----------------------------------------------------------+
| address | 68:05:ca:32:4a:20 |
| created_at | 2017-03-07T20:26:24+00:00 |
| extra | {u'vif_port_id': u'f6ee8a6f-eb4e-4547-b97e-37d53c8351b8'} |
| node_uuid | bdade5f7-f3bb-4bbc-9d19-df2d3116eb2b |
| updated_at | 2017-03-07T20:26:31+00:00 |
| uuid | cccb4960-6cf5-4482-bf34-e10e8ed784d6 |
+------------+-----------------------------------------------------------+
root@729100-infra01-utility-container-5b22864e:~# neutron port-show f6ee8a6f-eb4e-4547-b97e-37d53c8351b8
+-----------------------+--------------------------------------------------------------------------------------------------------------+
| Field | Value |
+-----------------------+--------------------------------------------------------------------------------------------------------------+
| admin_state_up | True |
| allowed_address_pairs | |
| binding:host_id | |
| binding:profile | {} |
| binding:vif_details | {} |
| binding:vif_type | unbound |
| binding:vnic_type | normal |
| created_at | 2017-03-07T20:26:30 |
| description | |
| device_id | |
| device_owner | |
| extra_dhcp_opts | {"opt_value": "pxelinux.0", "ip_version": 4, "opt_name": "bootfile-name"} |
| | {"opt_value": "172.30.255.6", "ip_version": 4, "opt_name": "server-ip-address"} |
| | {"opt_value": "172.30.255.6", "ip_version": 4, "opt_name": "tftp-server"} |
| fixed_ips | {"subnet_id": "6c9e6843-b885-4aa4-a8e4-fc458a839a8d", "ip_address": "172.30.245.207"} |
| | {"subnet_id": "d56034e7-3c18-4fd6-a8b7-95e46179e525", "ip_address": "2001:4800:1ae1:19:6a05:caff:fe32:4a20"} |
| id | f6ee8a6f-eb4e-4547-b97e-37d53c8351b8 |
| mac_address | 68:05:ca:32:4a:20 |
| name | |
| network_id | 6a227cf6-45de-4ca4-8b1c-e67c6cf2e815 |
| security_groups | 88d6d64c-714e-48e1-b437-3ad2d9941df1 |
| status | DOWN |
| tenant_id | 7a1ca9f7cc4e4b13ac0ed2957f1e8c32 |
| updated_at | 2017-03-07T20:26:30 |
+-----------------------+--------------------------------------------------------------------------------------------------------------+
root@729100-infra01-utility-container-5b22864e:~# neutron net-list
+--------------------------------------+---------------------+-------------------------------------------------------------+
| id | name | subnets |
+--------------------------------------+---------------------+-------------------------------------------------------------+
| 6a227cf6-45de-4ca4-8b1c-e67c6cf2e815 | BAREMETAL_NET | d56034e7-3c18-4fd6-a8b7-95e46179e525 2001:4800:1ae1:19::/64 |
| | | 6c9e6843-b885-4aa4-a8e4-fc458a839a8d 172.30.240.0/20 |
| 467e97b3-a48c-4aba-b92b-8e8a5de589ca | private-net-ironic1 | 2f059935-ea69-4d80-a08f-9ac1e7853050 192.168.0.0/24 |
+--------------------------------------+---------------------+-------------------------------------------------------------+
root@729100-infra01-utility-container-5b22864e:~# neutron subnet-list
+--------------------------------------+------------------------+------------------------+----------------------------------------------------------------------+
| id | name | cidr | allocation_pools |
+--------------------------------------+------------------------+------------------------+----------------------------------------------------------------------+
| d56034e7-3c18-4fd6-a8b7-95e46179e525 | BAREMETAL_EXT_SUBNET | 2001:4800:1ae1:19::/64 | {"start": "2001:4800:1ae1:19::2", "end": |
| | | | "2001:4800:1ae1:19:ffff:ffff:ffff:ffff"} |
| 6c9e6843-b885-4aa4-a8e4-fc458a839a8d | BAREMETAL_PXE_SUBNET | 172.30.240.0/20 | {"start": "172.30.243.0", "end": "172.30.248.255"} |
| 2f059935-ea69-4d80-a08f-9ac1e7853050 | private-subnet-ironic1 | 192.168.0.0/24 | {"start": "192.168.0.2", "end": "192.168.0.254"} |
+--------------------------------------+------------------------+------------------------+----------------------------------------------------------------------+
+-------------------+----------------------------------------------------+
| Field | Value |
+-------------------+----------------------------------------------------+
| allocation_pools | {"start": "172.30.243.0", "end": "172.30.248.255"} |
| cidr | 172.30.240.0/20 |
| created_at | 2016-11-12T03:18:53 |
| description | |
| dns_nameservers | 8.8.8.8 |
| | 74.82.42.42 |
| enable_dhcp | True |
| gateway_ip | 172.30.240.1 |
| host_routes | |
| id | 6c9e6843-b885-4aa4-a8e4-fc458a839a8d |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | BAREMETAL_PXE_SUBNET |
| network_id | 6a227cf6-45de-4ca4-8b1c-e67c6cf2e815 |
| subnetpool_id | |
| tenant_id | 7a1ca9f7cc4e4b13ac0ed2957f1e8c32 |
| updated_at | 2016-11-21T22:04:49 |
+-------------------+----------------------------------------------------+
root@729100-infra01-utility-container-5b22864e:~# neutron router-show e0a77afe-8bb5-41bb-a2f6-133ba2a9f955
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------+
| Field | Value |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------+
| admin_state_up | True |
| availability_zone_hints | |
| availability_zones | nova |
| description | |
| distributed | False |
| external_gateway_info | {"network_id": "6a227cf6-45de-4ca4-8b1c-e67c6cf2e815", "enable_snat": true, "external_fixed_ips": [{"subnet_id": |
| | "6c9e6843-b885-4aa4-a8e4-fc458a839a8d", "ip_address": "172.30.244.59"}, {"subnet_id": "d56034e7-3c18-4fd6-a8b7-95e46179e525", |
| | "ip_address": "2001:4800:1ae1:19:f816:3eff:fe8a:4dda"}]} |
| ha | False |
| id | e0a77afe-8bb5-41bb-a2f6-133ba2a9f955 |
| name | router-ironic1 |
| routes | |
| status | ACTIVE |
| tenant_id | 1eb3c8f6bb2a4e4f818c11eba2dd9108 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------+
@Mudpuppy12
Copy link
Author

Network Diagram as I know of the environment
https://www.lucidchart.com/documents/view/dbcc3d69-ddd1-494e-ae25-805c00507efd

@Mudpuppy12
Copy link
Author

From 729507 -

729507 - Can get an dhcp from 172.30.243.0 and ACK it. IP of 172.30.245.207.

Host can ping 172.30.240.1, 172.30.244.59.
It can not ping the DHCP server 172.30.243.0 nor the TFTP server 172.30.255.6

@Mudpuppy12
Copy link
Author

infra03 can ping TFTP all servers 172.30.255.6,4,1. Can ping 172.30.243.0.

Can't ping 172.30.245.207.

@Mudpuppy12
Copy link
Author

Mudpuppy12 commented Mar 13, 2017 •
edited

PXE node tcpddump: Node get DHCP/ TFTP server id. gets a ARP timeout PXE-E11 error.

13:01:00.897429 68:05:ca:38:64:ac > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 401: (tos 0x0, ttl 64, id 51072, offset 0, flags [none], proto UDP (17), length 387)
0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from 68:05:ca:38:64:ac, length 359, xid 0xf353a284, Flags [Broadcast] (0x8000)
Client-Ethernet-Address 68:05:ca:38:64:ac
Vendor-rfc1048 Extensions
Magic Cookie 0x63825363
DHCP-Message Option 53, length 1: Request
Server-ID Option 54, length 4: 172.30.243.0
Requested-IP Option 50, length 4: 172.30.246.180
MSZ Option 57, length 2: 65280
Parameter-Request Option 55, length 35:
Subnet-Mask, Time-Zone, Default-Gateway, Time-Server
IEN-Name-Server, Domain-Name-Server, Hostname, BS
Domain-Name, RP, EP, RSZ
TTL, BR, YD, YS
NTP, Vendor-Option, Requested-IP, Lease-Time
Server-ID, RN, RB, Vendor-Class
TFTP, BF, GUID, Option 128
Option 129, Option 130, Option 131, Option 132
Option 133, Option 134, Option 135
GUID Option 97, length 17: 0.55.49.57.48.54.49.85.83.69.53.51.53.87.52.74.56
NDI Option 94, length 3: 1.3.16
ARCH Option 93, length 2: 7
Vendor-Class Option 60, length 32: "PXEClient:Arch:00007:UNDI:003016"
END Option 255, length 0
13:01:00.898413 fa:16:3e:37:00:ad > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 407: (tos 0xc0, ttl 64, id 39452, offset 0, flags [none], proto UDP (17), length 393)
172.30.243.0.67 > 255.255.255.255.68: [udp sum ok] BOOTP/DHCP, Reply, length 365, xid 0xf353a284, Flags [Broadcast] (0x8000)
Your-IP 172.30.246.180
Server-IP 172.30.255.6
Client-Ethernet-Address 68:05:ca:38:64:ac
Vendor-rfc1048 Extensions
Magic Cookie 0x63825363
DHCP-Message Option 53, length 1: ACK
Server-ID Option 54, length 4: 172.30.243.0
Lease-Time Option 51, length 4: 86400
RN Option 58, length 4: 43200
RB Option 59, length 4: 75600
Subnet-Mask Option 1, length 4: 255.255.240.0
BR Option 28, length 4: 172.30.255.255
Domain-Name Option 15, length 14: "openstacklocal"
Hostname Option 12, length 19: "host-172-30-246-180"
TFTP Option 66, length 13: "172.30.255.6^@"
BF Option 67, length 11: "pxelinux.0^@"
Default-Gateway Option 3, length 4: 172.30.240.1
Domain-Name-Server Option 6, length 8: 8.8.8.8,74.82.42.42
MTU Option 26, length 2: 1500
END Option 255, length 0
13:01:00.924108 68:05:ca:38:64:ac > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Ethernet (len 6), IPv4 (len 4), Request who-has 172.30.255.6 tell 172.30.246.180, length 46
13:01:00.924402 00:16:3e:40:c0:a9 > 68:05:ca:38:64:ac, ethertype ARP (0x0806), length 42: Ethernet (len 6), IPv4 (len 4), Reply 172.30.255.6 is-at 00:16:3e:40:c0:a9, length 28
13:01:01.298337 68:05:ca:38:64:ac > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Ethernet (len 6), IPv4 (len 4), Request who-has 172.30.255.6 tell 172.30.246.180, length 46
13:01:01.298363 00:16:3e:40:c0:a9 > 68:05:ca:38:64:ac, ethertype ARP (0x0806), length 42: Ethernet (len 6), IPv4 (len 4), Reply 172.30.255.6 is-at 00:16:3e:40:c0:a9, length 28

PXE node can't reach 172.30.255.6 or reply is not reaching the node

@Mudpuppy12
Copy link
Author

REGION 1

Networks BAREMETAL_NET Subnets BAREMETAL_SUBNET
Name
BAREMETAL_SUBNET
ID
95b4da1e-96f6-474f-a733-64f9f524ba00
Network Name
BAREMETAL_NET
Network ID
8df4f770-747e-4887-b2c3-abd7265bd5fd
Subnetpool
None
IP version
IPv4
CIDR
172.30.240.0/20
IP allocation pool
Start 172.30.249.0 - End 172.30.254.255
Gateway IP
172.30.240.1
DHCP Enable
Yes
Additional routes
None
DNS name server
8.8.8.8 74.82.42.42

@Mudpuppy12
Copy link
Author

REGION 2

Networks BAREMETAL_NET Subnets BAREMETAL_PXE_SUBNET
Name
BAREMETAL_PXE_SUBNET
ID
6c9e6843-b885-4aa4-a8e4-fc458a839a8d
Network Name
BAREMETAL_NET
Network ID
6a227cf6-45de-4ca4-8b1c-e67c6cf2e815
Subnetpool
None
IP version
IPv4
CIDR
172.30.240.0/20
IP allocation pool
Start 172.30.243.0 - End 172.30.248.255
Gateway IP
172.30.240.1
DHCP Enable
Yes
Additional routes
None
DNS name server
8.8.8.8 74.82.42.42

@Mudpuppy12
Copy link
Author

If I delete the arp entry on the tftp host 172.30.255.6, I can ping the 172.30.245.207 dhcp address only for 9 packets...
After 9 packets the 172.30.245.207 gets an incomplete arp entry.

@Mudpuppy12
Copy link
Author

If I delete the arp on 255.6, I can ping for 9 more packets until this behavior is again shown.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment