-
-
Save pvmpublic/2f9a7180a5aef59de09aac9877302720 to your computer and use it in GitHub Desktop.
StarlingX controller-1 disabled on adding ovs-dpdk
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [sysadmin@controller-0 ~(keystone_admin)]$ system host-list | |
| +----+--------------+-------------+----------------+-------------+--------------+ | |
| | id | hostname | personality | administrative | operational | availability | | |
| +----+--------------+-------------+----------------+-------------+--------------+ | |
| | 1 | controller-0 | controller | unlocked | enabled | degraded | | |
| | 5 | controller-1 | controller | unlocked | disabled | failed | | |
| +----+--------------+-------------+----------------+-------------+--------------+ | |
| [sysadmin@controller-0 log(keystone_admin)]$ fm alarm-list | |
| +----------+-------------------------------------------------------------------------------------+------------------------+----------+----------------+ | |
| | Alarm ID | Reason Text | Entity ID | Severity | Time Stamp | | |
| +----------+-------------------------------------------------------------------------------------+------------------------+----------+----------------+ | |
| | 400.001 | Service group cloud-services warning; dbmon(disabled, failed) | service_domain= | minor | 2020-08-14T14: | | |
| | | | controller. | | 53:44.199866 | | |
| | | | service_group=cloud- | | | | |
| | | | services.host= | | | | |
| | | | controller-0 | | | | |
| | | | | | | | |
| | 400.001 | Service group cloud-services warning; dbmon(enabled-standby, ) | service_domain= | minor | 2020-08-14T14: | | |
| | | | controller. | | 52:52.944929 | | |
| | | | service_group=cloud- | | | | |
| | | | services.host= | | | | |
| | | | controller-1 | | | | |
| | | | | | | | |
| | 200.011 | controller-1 experienced a configuration failure. | host=controller-1 | critical | 2020-08-14T14: | | |
| | | | | | 43:57.370079 | | |
| | | | | | | | |
| | 200.011 | controller-0 experienced a configuration failure. | host=controller-0 | critical | 2020-08-14T12: | | |
| | | | | | 36:33.206777 | | |
| | | | | | | | |
| | 250.001 | controller-0 Configuration is out-of-date. | host=controller-0 | major | 2020-08-14T12: | | |
| | | | | | 35:10.205924 | | |
| [sysadmin@controller-0 ~(keystone_admin)]$ sm-dump | |
| -Service_Groups------------------------------------------------------------------------ | |
| unable to open database file | |
| [sysadmin@controller-0 ~(keystone_admin)]$ kubectl get pods -A | grep Crash | |
| kube-system kube-sriov-device-plugin-amd64-hk5st 0/1 CrashLoopBackOff 3810 13d | |
| openstack openvswitch-db-k5j4l 0/1 CrashLoopBackOff 45 4d | |
| 2020-08-14T15:41:03.826 controller-0 kubelet[69408]: info E0814 15:41:03.826403 69408 pod_workers.go:191] Error syncing pod caecfe20-5c7c-43ce-a19d-2e183fa1ed44 ("openvswi | |
| tch-db-k5j4l_openstack(caecfe20-5c7c-43ce-a19d-2e183fa1ed44)"), skipping: failed to "StartContainer" for "openvswitch-db" with CrashLoopBackOff: "back-off 5m0s restarting fa | |
| iled container=openvswitch-db pod=openvswitch-db-k5j4l_openstack(caecfe20-5c7c-43ce-a19d-2e183fa1ed44)" | |
| 2020-08-14T15:41:07.826 controller-0 kubelet[69408]: info E0814 15:41:07.826345 69408 pod_workers.go:191] Error syncing pod 97cecf17-56be-43ee-84f0-a1e1cc1c98c7 ("kube-sri | |
| ov-device-plugin-amd64-hk5st_kube-system(97cecf17-56be-43ee-84f0-a1e1cc1c98c7)"), skipping: failed to "StartContainer" for "kube-sriovdp" with CrashLoopBackOff: "back-off 5m | |
| 0s restarting failed container=kube-sriovdp pod=kube-sriov-device-plugin-amd64-hk5st_kube-system(97cecf17-56be-43ee-84f0-a1e1cc1c98c7)" | |
| 2020-08-14T15:41:09.000 controller-0 collectd[69634]: err ovs interface plugin find no ovs bridges ; retry next audit | |
| On controller-1, I get these, but there is no eth1 there: | |
| sysinv 2020-08-13 16:50:27.404 10047 WARNING sysinv.openstack.common.loopingcall [-] task run outlasted interval by 154.478058 sec | |
| sysinv 2020-08-13 16:55:27.888 10047 INFO sysinv.agent.lldp.drivers.ovs.driver [-] Adding missing LLDP flow from lldpeecd30c6-d0 to eth1 | |
| sysinv 2020-08-13 16:55:27.904 10047 ERROR sysinv.agent.lldp.drivers.ovs.driver [-] Failed to run command ovs-ofctl add-flow br-phy1 in_port=lldpeecd30c6-d0,dl_dst=01:80:c2:00:00:0e,dl_type=0x88cc,actions=output:eth1: error: ovs-ofctl: eth1: output to unknown port | |
| sysinv 2020-08-13 16:55:27.919 10047 ERROR sysinv.agent.lldp.drivers.ovs.driver [-] Failed to run command ovs-ofctl dump-flows br-phy1 in_port=eth1,dl_dst=01:80:c2:00:00:0e,dl_type=0x88cc: error: ovs-ofctl: eth1: invalid or unknown port for in_port | |
| sysinv 2020-08-13 16:55:27.920 10047 INFO sysinv.agent.lldp.drivers.ovs.driver [-] Adding missing LLDP flow from eth1 to lldpeecd30c6-d0 | |
| sysinv 2020-08-13 16:55:27.934 10047 ERROR sysinv.agent.lldp.drivers.ovs.driver [-] Failed to run command ovs-ofctl add-flow br-phy1 in_port=eth1,dl_dst=01:80:c2:00:00:0e,dl_type=0x88cc,actions=output:lldpeecd30c6-d0: error: ovs-ofctl: eth1: invalid or unknown port for in_port | |
| [sysadmin@controller-0 ~(keystone_admin)]$ system host-port-list controller-1 | |
| +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+--------------------------------------------------------+ | |
| | uuid | name | type | pci address | device | processor | accelerated | device type | | |
| +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+--------------------------------------------------------+ | |
| | 1d60ef54-541b-4879-b0db-dbd79806bc49 | eno49 | ethernet | 0000:06:00.0 | 0 | 0 | False | BCM57840 NetXtreme II 10/20-Gigabit Ethernet [16a2] | | |
| | 5024a843-bc1f-478a-9ffe-a41396df1206 | eno50 | ethernet | 0000:06:00.1 | 0 | 0 | False | BCM57840 NetXtreme II 10/20-Gigabit Ethernet [16a2] | | |
| | 248861bc-ebed-4628-b711-836b9f197940 | eno51 | ethernet | 0000:06:00.2 | 0 | 0 | False | BCM57840 NetXtreme II 10/20-Gigabit Ethernet [16a2] | | |
| | b04b0fe1-d099-455d-8689-07fae856740f | eno52 | ethernet | 0000:06:00.3 | 0 | 0 | False | BCM57840 NetXtreme II 10/20-Gigabit Ethernet [16a2] | | |
| | aa92e9cc-2d2e-4e67-b207-3e40efa471f2 | eno53 | ethernet | 0000:06:00.4 | 0 | 0 | False | BCM57840 NetXtreme II 10/20-Gigabit Ethernet [16a2] | | |
| | 2dd5f90b-e84e-45bb-8d60-d06feac899d7 | eno54 | ethernet | 0000:06:00.5 | 0 | 0 | False | BCM57840 NetXtreme II 10/20-Gigabit Ethernet [16a2] | | |
| | cb786204-af88-4e91-8095-4000d1b3d36f | ens2f0 | ethernet | 0000:87:00.0 | 0 | 1 | True | 82599 10 Gigabit Dual Port Backplane Connection [10f8] | | |
| | eecd30c6-d0e1-4970-8c1a-b2aa2e3a439d | ens2f1 | ethernet | 0000:87:00.1 | 0 | 1 | True | 82599 10 Gigabit Dual Port Backplane Connection [10f8] | | |
| +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+--------------------------------------------------------+ | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment