Created
September 14, 2022 17:38
-
-
Save tubededentifrice/c510a6aae46b4a70da87fe2f815677f0 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| node1 | |
| Sep 14 17:36:01 node1.mydomain.com systemd[1]: Starting Corosync Cluster Engine... | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [MAIN ] Corosync Cluster Engine 3.1.5 starting up | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [MAIN ] Corosync built-in features: dbus monitoring watchdog systemd xmlconf vqsim nozzle snmp pie relro bindnow | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [TOTEM ] Initializing transport (Kronosnet). | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [TOTEM ] totemknet initialized | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] common: crypto_nss.so has been loaded from /usr/lib/x86_64-linux-gnu/kronosnet/crypto_nss.so | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync configuration map access [0] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QB ] server name: cmap | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync configuration service [1] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QB ] server name: cfg | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QB ] server name: cpg | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync profile loading service [4] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync resource monitoring service [6] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [WD ] Watchdog not enabled by configuration | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [WD ] resource load_15min missing a recovery key. | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [WD ] resource memory_used missing a recovery key. | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [WD ] no resources configured. | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync watchdog service [7] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QUORUM] Using quorum provider corosync_votequorum | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QB ] server name: votequorum | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3] | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QB ] server name: quorum | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [TOTEM ] Configuring link 0 | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [TOTEM ] Configured link number 0: local addr: 188.165.202.107, port=5405 | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 (passive) best link: 0 (pri: 0) | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 has no active links | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 has no active links | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 has no active links | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 3 (passive) best link: 0 (pri: 0) | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 3 has no active links | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 3 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 3 has no active links | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 3 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [KNET ] host: host: 3 has no active links | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QUORUM] Sync members[1]: 1 | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QUORUM] Sync joined[1]: 1 | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [TOTEM ] A new membership (1.1c6) was formed. Members joined: 1 | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [QUORUM] Members[1]: 1 | |
| Sep 14 17:36:01 node1.mydomain.com corosync[558167]: [MAIN ] Completed service synchronization, ready to provide service. | |
| Sep 14 17:36:01 node1.mydomain.com systemd[1]: Started Corosync Cluster Engine. | |
| Sep 14 17:36:02 node1.mydomain.com pvedaemon[1593]: <root@pam> successful auth for user 'root@pam' | |
| Sep 14 17:36:03 node1.mydomain.com corosync[558167]: [KNET ] rx: host: 2 link: 0 is up | |
| Sep 14 17:36:03 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:03 node1.mydomain.com corosync[558167]: [KNET ] pmtud: PMTUD link change for host: 2 link: 0 from 469 to 1397 | |
| Sep 14 17:36:03 node1.mydomain.com corosync[558167]: [KNET ] pmtud: Global data MTU changed to: 1397 | |
| Sep 14 17:36:04 node1.mydomain.com corosync[558167]: [QUORUM] Sync members[2]: 1 2 | |
| Sep 14 17:36:04 node1.mydomain.com corosync[558167]: [QUORUM] Sync joined[1]: 2 | |
| Sep 14 17:36:04 node1.mydomain.com corosync[558167]: [TOTEM ] A new membership (1.1ca) was formed. Members joined: 2 | |
| Sep 14 17:36:04 node1.mydomain.com corosync[558167]: [QUORUM] This node is within the primary component and will provide service. | |
| Sep 14 17:36:04 node1.mydomain.com corosync[558167]: [QUORUM] Members[2]: 1 2 | |
| Sep 14 17:36:04 node1.mydomain.com corosync[558167]: [MAIN ] Completed service synchronization, ready to provide service. | |
| Sep 14 17:36:06 node1.mydomain.com corosync[558167]: [CFG ] Node 2 was shut down by sysadmin | |
| Sep 14 17:36:06 node1.mydomain.com corosync[558167]: [QUORUM] Sync members[1]: 1 | |
| Sep 14 17:36:06 node1.mydomain.com corosync[558167]: [QUORUM] Sync left[1]: 2 | |
| Sep 14 17:36:06 node1.mydomain.com corosync[558167]: [TOTEM ] A new membership (1.1ce) was formed. Members left: 2 | |
| Sep 14 17:36:06 node1.mydomain.com corosync[558167]: [QUORUM] This node is within the non-primary component and will NOT provide any services. | |
| Sep 14 17:36:06 node1.mydomain.com corosync[558167]: [QUORUM] Members[1]: 1 | |
| Sep 14 17:36:06 node1.mydomain.com corosync[558167]: [MAIN ] Completed service synchronization, ready to provide service. | |
| Sep 14 17:36:06 node1.mydomain.com pmxcfs[539995]: [status] notice: update cluster info (cluster name opendle, version = 14) | |
| Sep 14 17:36:06 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: members: 1/539995 | |
| Sep 14 17:36:06 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: all data is up to date | |
| Sep 14 17:36:06 node1.mydomain.com pmxcfs[539995]: [status] notice: members: 1/539995 | |
| Sep 14 17:36:06 node1.mydomain.com pmxcfs[539995]: [status] notice: all data is up to date | |
| Sep 14 17:36:07 node1.mydomain.com corosync[558167]: [KNET ] link: host: 2 link: 0 is down | |
| Sep 14 17:36:07 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:07 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 has no active links | |
| Sep 14 17:36:09 node1.mydomain.com corosync[558167]: [KNET ] rx: host: 2 link: 0 is up | |
| Sep 14 17:36:09 node1.mydomain.com corosync[558167]: [KNET ] host: host: 2 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:10 node1.mydomain.com corosync[558167]: [QUORUM] Sync members[2]: 1 2 | |
| Sep 14 17:36:10 node1.mydomain.com corosync[558167]: [QUORUM] Sync joined[1]: 2 | |
| Sep 14 17:36:10 node1.mydomain.com corosync[558167]: [TOTEM ] A new membership (1.1d3) was formed. Members joined: 2 | |
| Sep 14 17:36:10 node1.mydomain.com corosync[558167]: [QUORUM] This node is within the primary component and will provide service. | |
| Sep 14 17:36:10 node1.mydomain.com corosync[558167]: [QUORUM] Members[2]: 1 2 | |
| Sep 14 17:36:10 node1.mydomain.com corosync[558167]: [MAIN ] Completed service synchronization, ready to provide service. | |
| Sep 14 17:36:10 node1.mydomain.com pmxcfs[539995]: [status] notice: node has quorum | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: members: 1/539995, 2/422073 | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: starting data syncronisation | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [status] notice: members: 1/539995, 2/422073 | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [status] notice: starting data syncronisation | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: received sync request (epoch 1/539995/0000001B) | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [status] notice: received sync request (epoch 1/539995/0000001A) | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: received all states | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: leader is 2/422073 | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: synced members: 2/422073 | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: waiting for updates from leader | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [status] notice: received all states | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [status] notice: all data is up to date | |
| Sep 14 17:36:13 node1.mydomain.com corosync[558167]: [TOTEM ] Retransmit List: 11 12 | |
| Sep 14 17:36:13 node1.mydomain.com corosync[558167]: [TOTEM ] Retransmit List: 12 | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: update complete - trying to commit (got 3 inode updates) | |
| Sep 14 17:36:13 node1.mydomain.com pmxcfs[539995]: [dcdb] notice: all data is up to date | |
| node 2 | |
| Sep 14 17:36:07 node2.mydomain.com systemd[1]: Starting Corosync Cluster Engine... | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [MAIN ] Corosync Cluster Engine 3.1.5 starting up | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [MAIN ] Corosync built-in features: dbus monitoring watchdog systemd xmlconf vqsim nozzle snmp pie relro bindnow | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [TOTEM ] Initializing transport (Kronosnet). | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [TOTEM ] totemknet initialized | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] common: crypto_nss.so has been loaded from /usr/lib/x86_64-linux-gnu/kronosnet/crypto_nss.so | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync configuration map access [0] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QB ] server name: cmap | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync configuration service [1] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QB ] server name: cfg | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QB ] server name: cpg | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync profile loading service [4] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync resource monitoring service [6] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [WD ] Watchdog not enabled by configuration | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [WD ] resource load_15min missing a recovery key. | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [WD ] resource memory_used missing a recovery key. | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [WD ] no resources configured. | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync watchdog service [7] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QUORUM] Using quorum provider corosync_votequorum | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QB ] server name: votequorum | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3] | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QB ] server name: quorum | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [TOTEM ] Configuring link 0 | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [TOTEM ] Configured link number 0: local addr: 51.68.152.222, port=5405 | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 0) | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 1 has no active links | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 1 has no active links | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 1 has no active links | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 2 (passive) best link: 0 (pri: 0) | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 2 has no active links | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 3 (passive) best link: 0 (pri: 0) | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 3 has no active links | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 3 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 3 has no active links | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 3 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [KNET ] host: host: 3 has no active links | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QUORUM] Sync members[1]: 2 | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QUORUM] Sync joined[1]: 2 | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [TOTEM ] A new membership (2.1cf) was formed. Members joined: 2 | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [QUORUM] Members[1]: 2 | |
| Sep 14 17:36:07 node2.mydomain.com corosync[436735]: [MAIN ] Completed service synchronization, ready to provide service. | |
| Sep 14 17:36:07 node2.mydomain.com systemd[1]: Started Corosync Cluster Engine. | |
| Sep 14 17:36:09 node2.mydomain.com corosync[436735]: [KNET ] rx: host: 1 link: 0 is up | |
| Sep 14 17:36:09 node2.mydomain.com corosync[436735]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1) | |
| Sep 14 17:36:09 node2.mydomain.com corosync[436735]: [KNET ] pmtud: PMTUD link change for host: 1 link: 0 from 469 to 1397 | |
| Sep 14 17:36:09 node2.mydomain.com corosync[436735]: [KNET ] pmtud: Global data MTU changed to: 1397 | |
| Sep 14 17:36:10 node2.mydomain.com corosync[436735]: [QUORUM] Sync members[2]: 1 2 | |
| Sep 14 17:36:10 node2.mydomain.com corosync[436735]: [QUORUM] Sync joined[1]: 1 | |
| Sep 14 17:36:10 node2.mydomain.com corosync[436735]: [TOTEM ] A new membership (1.1d3) was formed. Members joined: 1 | |
| Sep 14 17:36:10 node2.mydomain.com corosync[436735]: [QUORUM] This node is within the primary component and will provide service. | |
| Sep 14 17:36:10 node2.mydomain.com corosync[436735]: [QUORUM] Members[2]: 1 2 | |
| Sep 14 17:36:10 node2.mydomain.com corosync[436735]: [MAIN ] Completed service synchronization, ready to provide service. | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [status] notice: update cluster info (cluster name opendle, version = 14) | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [status] notice: node has quorum | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: members: 1/539995, 2/422073 | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: starting data syncronisation | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [status] notice: members: 1/539995, 2/422073 | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [status] notice: starting data syncronisation | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: received sync request (epoch 1/539995/0000001B) | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [status] notice: received sync request (epoch 1/539995/0000001A) | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: received all states | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: leader is 2/422073 | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: synced members: 2/422073 | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: start sending inode updates | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: sent all (3) updates | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [dcdb] notice: all data is up to date | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [status] notice: received all states | |
| Sep 14 17:36:13 node2.mydomain.com pmxcfs[422073]: [status] notice: all data is up to date |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
node3 is complaining a bit since corosync is stopped:
Sep 14 17:39:20 node3.mydomain.com pmxcfs[1325]: [quorum] crit: quorum_initialize failed: 2
Sep 14 17:39:20 node3.mydomain.com pmxcfs[1325]: [confdb] crit: cmap_initialize failed: 2
Sep 14 17:39:20 node3.mydomain.com pmxcfs[1325]: [dcdb] crit: cpg_initialize failed: 2
Sep 14 17:39:20 node3.mydomain.com pmxcfs[1325]: [status] crit: cpg_initialize failed: 2
Sep 14 17:39:26 node3.mydomain.com pmxcfs[1325]: [quorum] crit: quorum_initialize failed: 2
Sep 14 17:39:26 node3.mydomain.com pmxcfs[1325]: [confdb] crit: cmap_initialize failed: 2
Sep 14 17:39:26 node3.mydomain.com pmxcfs[1325]: [dcdb] crit: cpg_initialize failed: 2
Sep 14 17:39:26 node3.mydomain.com pmxcfs[1325]: [status] crit: cpg_initialize failed: 2
Sep 14 17:39:32 node3.mydomain.com pmxcfs[1325]: [quorum] crit: quorum_initialize failed: 2
Sep 14 17:39:32 node3.mydomain.com pmxcfs[1325]: [confdb] crit: cmap_initialize failed: 2
Sep 14 17:39:32 node3.mydomain.com pmxcfs[1325]: [dcdb] crit: cpg_initialize failed: 2
Sep 14 17:39:32 node3.mydomain.com pmxcfs[1325]: [status] crit: cpg_initialize failed: 2