Skip to content

Instantly share code, notes, and snippets.

@Phelms215

Phelms215/gist:cb008e1fa1f22df1a4e6

Created September 10, 2014 14:20
Show Gist options
  • Save Phelms215/cb008e1fa1f22df1a4e6 to your computer and use it in GitHub Desktop.
Save Phelms215/cb008e1fa1f22df1a4e6 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
140910 1:07:23 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 1:07:24 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 1:07:25 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 1:07:25 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df402a6b0
140910 1:28:09 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 1:28:10 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 1:28:10 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 1:28:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up established 0x7f1df4066510 which is duplicate of 0x7f1df405dcb0
140910 1:36:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 1:36:58 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 1:36:58 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 1:36:59 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df402a6b0 after established 0x7f1df405dcb0
140910 1:37:45 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 1:37:46 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 1:37:51 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 2:17:06 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 2:17:07 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 2:17:07 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 2:25:00 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 2:25:01 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 2:25:01 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 2:25:01 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df402a6b0
140910 2:47:15 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 2:47:16 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 4:20:24 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 4:20:26 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 4:20:26 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 4:20:26 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df402a6b0 after established 0x7f1df4070c90
140910 5:36:10 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 5:36:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 5:36:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 5:36:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df4066510
140910 7:45:50 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 7:45:51 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 7:51:11 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 7:51:12 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 7:51:13 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df4066510 after established 0x7f1df4016430
140910 7:51:13 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 9:23:17 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 9:23:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 9:23:19 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 9:23:19 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df405dcb0 after established 0x7f1df4066510
140910 9:56:53 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 9:56:54 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 9:56:55 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 9:56:55 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df4066510 after established 0x7f1df4016430
140910 10:56:19 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 10:56:20 [Note] WSREP: declaring 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 stable
140910 10:56:20 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable
140910 10:56:20 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567), attempt 0
140910 10:56:23 [Note] WSREP: Node 9390eb39-384f-11e4-9192-96ce0bc70f13 state prim
140910 10:56:23 [Note] WSREP: view(view_id(PRIM,9390eb39-384f-11e4-9192-96ce0bc70f13,23) memb {
9390eb39-384f-11e4-9192-96ce0bc70f13,
9c0ceeb6-3850-11e4-a074-1eeadc3e47f7,
9e7ed888-384f-11e4-908e-d3554e3efe34,
} joined {
} left {
} partitioned {
92d11e3e-3863-11e4-8e85-aa80c5e58da9,
})
140910 10:56:23 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 10:56:23 [Note] WSREP: forgetting 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567)
140910 10:56:23 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 10:56:23 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23
140910 10:56:23 [Note] WSREP: STATE EXCHANGE: sent state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23
140910 10:56:23 [Note] WSREP: STATE EXCHANGE: got state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 from 0 (GeoDBiretest)
140910 10:56:23 [Note] WSREP: STATE EXCHANGE: got state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 from 2 (GeoDBnvatest)
140910 10:56:23 [Note] WSREP: STATE EXCHANGE: got state msg: 1a8e3cab-38d9-11e4-b875-fa7e2e12ea23 from 1 (GeoDB401test)
140910 10:56:23 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 22,
members = 3/3 (joined/total),
act_id = 73945752,
last_appl. = 73945505,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 10:56:23 [Note] WSREP: Flow-control interval: [28, 28]
140910 10:56:23 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:73945752, view# 23: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 10:56:23 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 10:56:23 [Note] WSREP: Assign initial position for certification: 73945752, protocol version: 2
140910 10:56:28 [Note] WSREP: cleaning up 92d11e3e-3863-11e4-8e85-aa80c5e58da9 (tcp://10.200.200.20:4567)
140910 10:56:56 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 10:56:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 10:58:17 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 10:58:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567), attempt 0
140910 10:58:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 10:58:18 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df40677f0 after established 0x7f1df4066510
140910 10:58:44 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 10:58:45 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:00:56 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 11:00:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0
140910 11:00:57 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:01:38 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 11:01:39 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0
140910 11:01:39 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:02:35 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 11:02:36 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567), attempt 0
140910 11:02:36 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:02:36 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f1df4072030 after established 0x7f1df400d970
140910 11:05:05 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 11:05:06 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0
140910 11:05:06 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:45:33 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 11:45:34 [Note] WSREP: (9390eb39-384f-11e4-9192-96ce0bc70f13, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:45:35 [Note] WSREP: declaring 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 stable
140910 11:45:35 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable
140910 11:45:35 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable
140910 11:45:38 [Note] WSREP: Node 9390eb39-384f-11e4-9192-96ce0bc70f13 state prim
140910 11:45:38 [Note] WSREP: view(view_id(PRIM,9390eb39-384f-11e4-9192-96ce0bc70f13,24) memb {
9390eb39-384f-11e4-9192-96ce0bc70f13,
9c0ceeb6-3850-11e4-a074-1eeadc3e47f7,
9e7ed888-384f-11e4-908e-d3554e3efe34,
f9281937-38df-11e4-9142-3ffb096d5201,
} joined {
} left {
} partitioned {
})
140910 11:45:38 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 11:45:38 [Note] WSREP: STATE_EXCHANGE: sent state UUID: fc3fd64c-38df-11e4-acb2-93774acd7087
140910 11:45:39 [Note] WSREP: STATE EXCHANGE: sent state msg: fc3fd64c-38df-11e4-acb2-93774acd7087
140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 0 (GeoDBiretest)
140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 2 (GeoDBnvatest)
140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 1 (GeoDB401test)
140910 11:45:39 [Note] WSREP: STATE EXCHANGE: got state msg: fc3fd64c-38df-11e4-acb2-93774acd7087 from 3 (GeoDB02uw2a)
140910 11:45:39 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 23,
members = 3/4 (joined/total),
act_id = 74002760,
last_appl. = 74002239,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 11:45:39 [Note] WSREP: Flow-control interval: [32, 32]
140910 11:45:39 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74002760, view# 24: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 11:45:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:45:39 [Note] WSREP: Assign initial position for certification: 74002760, protocol version: 2
140910 11:45:39 [Warning] WSREP: last seen seqno below limit for trx source: 9e7ed888-384f-11e4-908e-d3554e3efe34 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 69 trx_id: 114094810 seqnos (l: 97228, g: 74002763, s: 74002756, d: -1, ts: 1410349534050429328)
140910 11:45:39 [Warning] WSREP: last seen seqno below limit for trx source: 9e7ed888-384f-11e4-908e-d3554e3efe34 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 70 trx_id: 114094812 seqnos (l: 97229, g: 74002764, s: 74002758, d: -1, ts: 1410349534096290062)
140910 11:45:39 [Warning] WSREP: last seen seqno below limit for trx source: 9e7ed888-384f-11e4-908e-d3554e3efe34 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 68 trx_id: 114094813 seqnos (l: 97230, g: 74002765, s: 74002759, d: -1, ts: 1410349534122748587)
140910 11:45:42 [Note] WSREP: Node 3 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 11:45:42 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74002811)
140910 11:45:42 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:73945752-74002760|tcp://10.200.200.20:4568
140910 11:45:42 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:45:42 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth '(null)' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:73945752' --bypass'
140910 11:45:42 [Note] WSREP: sst_donor_thread signaled with 0
140910 11:45:42 [Note] WSREP: async IST sender starting to serve tcp://10.200.200.20:4568 sending 73945753-74002760
WSREP_SST: [INFO] Streaming with xbstream (20140910 11:45:42.504)
WSREP_SST: [INFO] Using socat as streamer (20140910 11:45:42.511)
WSREP_SST: [INFO] Bypassing the SST for IST (20140910 11:45:42.522)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 11:45:42.537)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 11:45:42.721)
140910 11:46:01 [Note] WSREP: async IST sender served
140910 11:46:02 [Note] WSREP: 3 (GeoDB02uw2a): State transfer from 0 (GeoDBiretest) complete.
140910 11:46:02 [Note] WSREP: 0 (GeoDBiretest): State transfer to 3 (GeoDB02uw2a) complete.
140910 11:46:02 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74003193)
140910 11:46:02 [Note] WSREP: Member 3 (GeoDB02uw2a) synced with group.
140910 11:46:02 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 11:46:02 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74003198)
140910 11:46:02 [Note] WSREP: Synchronized with group, ready for connections
140910 11:46:02 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:48:26 [Note] /usr/sbin/mysqld: Normal shutdown
140910 11:48:26 [Note] WSREP: Stop replication
140910 11:48:26 [Note] WSREP: Closing send monitor...
140910 11:48:26 [Note] WSREP: Closed send monitor.
140910 11:48:26 [Note] WSREP: gcomm: terminating thread
140910 11:48:26 [Note] WSREP: gcomm: joining thread
140910 11:48:26 [Note] WSREP: gcomm: closing backend
140910 11:48:26 [Warning] WSREP: evs::proto(9390eb39-384f-11e4-9192-96ce0bc70f13, LEAVING, view_id(REG,9390eb39-384f-11e4-9192-96ce0bc70f13,24))lu (2056) <= safe_seq(2057), can't recover message
140910 11:48:26 [Warning] WSREP: evs::proto(9390eb39-384f-11e4-9192-96ce0bc70f13, LEAVING, view_id(REG,9390eb39-384f-11e4-9192-96ce0bc70f13,24))lu (2057) <= safe_seq(2057), can't recover message
140910 11:48:27 [Note] WSREP: view(view_id(NON_PRIM,9390eb39-384f-11e4-9192-96ce0bc70f13,24) memb {
9390eb39-384f-11e4-9192-96ce0bc70f13,
} joined {
} left {
} partitioned {
9c0ceeb6-3850-11e4-a074-1eeadc3e47f7,
9e7ed888-384f-11e4-908e-d3554e3efe34,
f9281937-38df-11e4-9142-3ffb096d5201,
})
140910 11:48:27 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
140910 11:48:27 [Note] WSREP: view((empty))
140910 11:48:27 [Note] WSREP: gcomm: closed
140910 11:48:27 [Note] WSREP: Flow-control interval: [16, 16]
140910 11:48:27 [Note] WSREP: Received NON-PRIMARY.
140910 11:48:27 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 74005608)
140910 11:48:27 [Note] WSREP: Received self-leave message.
140910 11:48:27 [Note] WSREP: Flow-control interval: [0, 0]
140910 11:48:27 [Note] WSREP: Received SELF-LEAVE. Closing connection.
140910 11:48:27 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 74005608)
140910 11:48:27 [Note] WSREP: RECV thread exiting 0: Success
140910 11:48:27 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 2
140910 11:48:27 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:48:27 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 2
140910 11:48:27 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:48:27 [Note] WSREP: applier thread exiting (code:0)
140910 11:48:27 [Note] WSREP: recv_thread() joined.
140910 11:48:27 [Note] WSREP: Closing replication queue.
140910 11:48:27 [Note] WSREP: Closing slave action queue.
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:27 [Note] WSREP: applier thread exiting (code:5)
140910 11:48:29 [Note] WSREP: rollbacker thread exiting
140910 11:48:29 [Note] WSREP: dtor state: CLOSED
140910 11:48:29 [Note] WSREP: mon: entered 99551 oooe fraction 0 oool fraction 0
140910 11:48:29 [Note] WSREP: mon: entered 99551 oooe fraction 0.0046107 oool fraction 3.01353e-05
140910 11:48:29 [Note] WSREP: mon: entered 100097 oooe fraction 0 oool fraction 0
140910 11:48:29 [Note] WSREP: cert index usage at exit 613
140910 11:48:29 [Note] WSREP: cert trx map usage at exit 305
140910 11:48:29 [Note] WSREP: deps set usage at exit 0
140910 11:48:29 [Note] WSREP: avg deps dist 238.761
140910 11:48:29 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0
140910 11:48:29 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: 74005608)
140910 11:48:29 [Note] WSREP: Flushing memory map to disk...
140910 11:48:30 InnoDB: Starting shutdown...
140910 11:48:30 InnoDB: Waiting for 101 pages to be flushed
140910 11:48:31 InnoDB: Shutdown completed; log sequence number 190746823857
140910 11:48:31 [Note] /usr/sbin/mysqld: Shutdown complete
140910 11:48:31 mysqld_safe mysqld from pid file /mnt/data/geo/mysql.pid ended
140910 11:48:33 mysqld_safe Starting mysqld daemon with databases from /mnt/data/geo
140910 11:48:33 mysqld_safe Skipping wsrep-recover for 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 pair
140910 11:48:33 mysqld_safe Assigning 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608 to wsrep_start_position
140910 11:48:33 [Note] WSREP: wsrep_start_position var submitted: '793fe80a-b316-11e2-0800-0198ce0bf65f:74005608'
140910 11:48:33 [Note] WSREP: Read nil XID from storage engines, skipping position init
140910 11:48:33 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/libgalera_smm.so'
140910 11:48:33 [Note] WSREP: wsrep_load(): Galera 2.7(r157) by Codership Oy <info@codership.com> loaded succesfully.
140910 11:48:33 [Note] WSREP: Found saved state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608
140910 11:48:33 [Note] WSREP: Reusing existing '/mnt/data/geo//galera.cache'.
140910 11:48:33 [Note] WSREP: Passing config to GCS: base_host = 10.200.202.20; base_port = 4567; cert.log_conflicts = no; evs.inactive_check_period = PT10S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M; evs.keepalive_period = PT3S; evs.suspect_timeout = PT30S; gcache.dir = /mnt/data/geo/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /mnt/data/geo//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3
140910 11:48:33 [Note] WSREP: Assign initial position for certification: 74005608, protocol version: -1
140910 11:48:33 [Note] WSREP: wsrep_sst_grab()
140910 11:48:33 [Note] WSREP: Start replication
140910 11:48:33 [Note] WSREP: Setting initial position to 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608
140910 11:48:33 [Note] WSREP: protonet asio version 0
140910 11:48:33 [Note] WSREP: backend: asio
140910 11:48:33 [Note] WSREP: GMCast version 0
140910 11:48:33 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
140910 11:48:33 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
140910 11:48:33 [Note] WSREP: EVS version 0
140910 11:48:33 [Note] WSREP: PC version 0
140910 11:48:33 [Note] WSREP: gcomm: connecting to group 'Geotest', peer '10.200.200.20:,10.200.201.20:,10.200.203.20:'
140910 11:48:35 [Note] WSREP: declaring 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 stable
140910 11:48:35 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable
140910 11:48:35 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable
140910 11:48:38 [Note] WSREP: Node 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 state prim
140910 11:48:39 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26) memb {
6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,
9c0ceeb6-3850-11e4-a074-1eeadc3e47f7,
9e7ed888-384f-11e4-908e-d3554e3efe34,
f9281937-38df-11e4-9142-3ffb096d5201,
} joined {
} left {
} partitioned {
})
140910 11:48:39 [Note] WSREP: gcomm: connected
140910 11:48:39 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
140910 11:48:39 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
140910 11:48:39 [Note] WSREP: Opened channel 'Geotest'
140910 11:48:39 [Note] WSREP: Waiting for SST to complete.
140910 11:48:39 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 11:48:39 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7
140910 11:48:39 [Note] WSREP: STATE EXCHANGE: sent state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7
140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 0 (GeoDBiretest)
140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 2 (GeoDBnvatest)
140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 1 (GeoDB401test)
140910 11:48:40 [Note] WSREP: STATE EXCHANGE: got state msg: 68056d01-38e0-11e4-b3de-92ad0d5ca5f7 from 3 (GeoDB02uw2a)
140910 11:48:40 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 25,
members = 3/4 (joined/total),
act_id = 74005686,
last_appl. = -1,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 11:48:40 [Note] WSREP: Flow-control interval: [32, 32]
140910 11:48:40 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 74005686)
140910 11:48:40 [Note] WSREP: State transfer required:
Group state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005686
Local state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608
140910 11:48:40 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005686, view# 26: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 11:48:40 [Warning] WSREP: Gap in state sequence. Need state transfer.
140910 11:48:42 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'joiner' --address '10.200.202.20' --auth 'sst:gtsst' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --parent '6080''
WSREP_SST: [INFO] Streaming with xbstream (20140910 11:48:42.407)
WSREP_SST: [INFO] Using socat as streamer (20140910 11:48:42.415)
WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[@]} ) (20140910 11:48:42.466)
140910 11:48:42 [Note] WSREP: Prepared SST request: xtrabackup|10.200.202.20:4444/xtrabackup_sst
140910 11:48:42 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:48:42 [Note] WSREP: Assign initial position for certification: 74005686, protocol version: 2
140910 11:48:42 [Note] WSREP: Prepared IST receiver, listening at: tcp://10.200.202.20:4568
140910 11:48:42 [Note] WSREP: Node 0 (GeoDBiretest) requested state transfer from '*any*'. Selected 1 (GeoDB401test)(SYNCED) as donor.
140910 11:48:42 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 74005723)
140910 11:48:42 [Note] WSREP: Requesting state transfer: success, donor: 1
WSREP_SST: [INFO] xtrabackup_ist received from donor: Running IST (20140910 11:48:43.326)
WSREP_SST: [INFO] Total time on joiner: 0 seconds (20140910 11:48:43.337)
WSREP_SST: [INFO] Removing the sst_in_progress file (20140910 11:48:43.345)
140910 11:48:43 [Note] WSREP: SST complete, seqno: 74005608
140910 11:48:43 [Note] Plugin 'FEDERATED' is disabled.
140910 11:48:43 InnoDB: The InnoDB memory heap is disabled
140910 11:48:43 InnoDB: Mutexes and rw_locks use GCC atomic builtins
140910 11:48:43 InnoDB: Compressed tables use zlib 1.2.3
140910 11:48:43 InnoDB: Using Linux native AIO
140910 11:48:43 InnoDB: Initializing buffer pool, size = 2.0G
140910 11:48:43 InnoDB: Completed initialization of buffer pool
140910 11:48:43 InnoDB: highest supported file format is Barracuda.
140910 11:48:44 InnoDB: Waiting for the background threads to start
140910 11:48:45 Percona XtraDB (http://www.percona.com) 5.5.33-rel31.0 started; log sequence number 190746823857
140910 11:48:45 [Note] WSREP: Signalling provider to continue.
140910 11:48:45 [Note] WSREP: SST received: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005608
140910 11:48:45 [Note] WSREP: Receiving IST: 78 writesets, seqnos 74005608-74005686
140910 11:48:45 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.5.33' socket: '/var/lib/mysql/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), wsrep_23.7.6.r3915
140910 11:48:45 [Note] WSREP: IST received: 793fe80a-b316-11e2-0800-0198ce0bf65f:74005686
140910 11:48:46 [Note] WSREP: 0 (GeoDBiretest): State transfer from 1 (GeoDB401test) complete.
140910 11:48:46 [Note] WSREP: Shifting JOINER -> JOINED (TO: 74005775)
140910 11:48:46 [Note] WSREP: 1 (GeoDB401test): State transfer to 0 (GeoDBiretest) complete.
140910 11:48:46 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 11:48:46 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74005779)
140910 11:48:46 [Note] WSREP: Synchronized with group, ready for connections
140910 11:48:46 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:48:46 [Note] WSREP: Member 1 (GeoDB401test) synced with group.
140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message
140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message
140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message
140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message
140910 11:49:58 [Warning] WSREP: evs::proto(6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, GATHER, view_id(REG,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,26))lu (964) <= safe_seq(964), can't recover message
140910 11:49:59 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 11:50:00 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable
140910 11:50:00 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable
140910 11:50:00 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567), attempt 0
140910 11:50:03 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim
140910 11:50:03 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,27) memb {
6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,
9e7ed888-384f-11e4-908e-d3554e3efe34,
f9281937-38df-11e4-9142-3ffb096d5201,
} joined {
} left {
} partitioned {
9c0ceeb6-3850-11e4-a074-1eeadc3e47f7,
})
140910 11:50:03 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 11:50:03 [Note] WSREP: forgetting 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567)
140910 11:50:03 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:50:03 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 99f73984-38e0-11e4-8c49-ee25c4a4697c
140910 11:50:03 [Note] WSREP: STATE EXCHANGE: sent state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c
140910 11:50:04 [Note] WSREP: STATE EXCHANGE: got state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c from 2 (GeoDB02uw2a)
140910 11:50:04 [Note] WSREP: STATE EXCHANGE: got state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c from 0 (GeoDBiretest)
140910 11:50:04 [Note] WSREP: STATE EXCHANGE: got state msg: 99f73984-38e0-11e4-8c49-ee25c4a4697c from 1 (GeoDBnvatest)
140910 11:50:04 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 26,
members = 3/3 (joined/total),
act_id = 74006722,
last_appl. = 74006356,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 11:50:04 [Note] WSREP: Flow-control interval: [28, 28]
140910 11:50:04 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74006722, view# 27: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 11:50:04 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:50:04 [Note] WSREP: Assign initial position for certification: 74006722, protocol version: 2
140910 11:50:08 [Note] WSREP: cleaning up 9c0ceeb6-3850-11e4-a074-1eeadc3e47f7 (tcp://10.200.203.20:4567)
140910 11:50:08 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 11:50:09 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:50:09 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x15f1250 after established 0x7f83b80151d0
140910 11:50:10 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 11:50:10 [Note] WSREP: declaring 9e7ed888-384f-11e4-908e-d3554e3efe34 stable
140910 11:50:10 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable
140910 11:50:13 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim
140910 11:50:13 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,28) memb {
6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
9e7ed888-384f-11e4-908e-d3554e3efe34,
f9281937-38df-11e4-9142-3ffb096d5201,
} joined {
} left {
} partitioned {
})
140910 11:50:13 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 11:50:13 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb
140910 11:50:14 [Note] WSREP: STATE EXCHANGE: sent state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb
140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 0 (GeoDBiretest)
140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 2 (GeoDBnvatest)
140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 3 (GeoDB02uw2a)
140910 11:50:14 [Note] WSREP: STATE EXCHANGE: got state msg: a02fc0e0-38e0-11e4-bdf4-22484d1db4cb from 1 (GeoDB401test)
140910 11:50:14 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 27,
members = 3/4 (joined/total),
act_id = 74006786,
last_appl. = 74006356,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 11:50:14 [Note] WSREP: Flow-control interval: [32, 32]
140910 11:50:14 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74006786, view# 28: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 11:50:14 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:50:14 [Note] WSREP: Assign initial position for certification: 74006786, protocol version: 2
140910 11:50:17 [Note] WSREP: Node 1 (GeoDB401test) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 11:50:17 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74006809)
140910 11:50:17 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:74006721-74006786|tcp://10.200.203.20:4568
140910 11:50:17 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:50:17 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.203.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74006721' --bypass'
140910 11:50:17 [Note] WSREP: sst_donor_thread signaled with 0
140910 11:50:17 [Note] WSREP: async IST sender starting to serve tcp://10.200.203.20:4568 sending 74006722-74006786
WSREP_SST: [INFO] Streaming with xbstream (20140910 11:50:17.549)
WSREP_SST: [INFO] Using socat as streamer (20140910 11:50:17.557)
WSREP_SST: [INFO] Bypassing the SST for IST (20140910 11:50:17.569)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.203.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 11:50:17.583)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 11:50:17.697)
140910 11:50:20 [Note] WSREP: async IST sender served
140910 11:50:21 [Note] WSREP: 0 (GeoDBiretest): State transfer to 1 (GeoDB401test) complete.
140910 11:50:21 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74006853)
140910 11:50:21 [Note] WSREP: 1 (GeoDB401test): State transfer from 0 (GeoDBiretest) complete.
140910 11:50:21 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 11:50:21 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74006856)
140910 11:50:21 [Note] WSREP: Synchronized with group, ready for connections
140910 11:50:21 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:50:21 [Note] WSREP: Member 1 (GeoDB401test) synced with group.
140910 11:51:20 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 11:51:20 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 11:51:20 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable
140910 11:51:20 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim
140910 11:51:20 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,29) memb {
6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
f9281937-38df-11e4-9142-3ffb096d5201,
} joined {
} left {
} partitioned {
9e7ed888-384f-11e4-908e-d3554e3efe34,
})
140910 11:51:20 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 11:51:20 [Note] WSREP: forgetting 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567)
140910 11:51:20 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:51:20 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c829ae22-38e0-11e4-8c8c-2b466287f6ba
140910 11:51:21 [Note] WSREP: STATE EXCHANGE: sent state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba
140910 11:51:21 [Note] WSREP: STATE EXCHANGE: got state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba from 0 (GeoDBiretest)
140910 11:51:21 [Note] WSREP: STATE EXCHANGE: got state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba from 1 (GeoDB401test)
140910 11:51:21 [Note] WSREP: STATE EXCHANGE: got state msg: c829ae22-38e0-11e4-8c8c-2b466287f6ba from 2 (GeoDB02uw2a)
140910 11:51:21 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 28,
members = 3/3 (joined/total),
act_id = 74007681,
last_appl. = 74007229,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 11:51:21 [Note] WSREP: Flow-control interval: [28, 28]
140910 11:51:21 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74007681, view# 29: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 11:51:21 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:51:21 [Note] WSREP: Assign initial position for certification: 74007681, protocol version: 2
140910 11:51:26 [Note] WSREP: cleaning up 9e7ed888-384f-11e4-908e-d3554e3efe34 (tcp://10.200.201.20:4567)
140910 11:51:27 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 11:51:27 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 11:51:28 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 11:51:28 [Note] WSREP: declaring cbcb6d36-38e0-11e4-80bb-521e0b098894 stable
140910 11:51:28 [Note] WSREP: declaring f9281937-38df-11e4-9142-3ffb096d5201 stable
140910 11:51:31 [Note] WSREP: Node 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e state prim
140910 11:51:31 [Note] WSREP: view(view_id(PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,30) memb {
6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
cbcb6d36-38e0-11e4-80bb-521e0b098894,
f9281937-38df-11e4-9142-3ffb096d5201,
} joined {
} left {
} partitioned {
})
140910 11:51:31 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 11:51:31 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ceb614d5-38e0-11e4-9379-473a09928b3d
140910 11:51:32 [Note] WSREP: STATE EXCHANGE: sent state msg: ceb614d5-38e0-11e4-9379-473a09928b3d
140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 1 (GeoDB401test)
140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 0 (GeoDBiretest)
140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 2 (GeoDBnvatest)
140910 11:51:32 [Note] WSREP: STATE EXCHANGE: got state msg: ceb614d5-38e0-11e4-9379-473a09928b3d from 3 (GeoDB02uw2a)
140910 11:51:32 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 29,
members = 3/4 (joined/total),
act_id = 74007737,
last_appl. = 74007229,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 11:51:32 [Note] WSREP: Flow-control interval: [32, 32]
140910 11:51:32 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74007737, view# 30: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 11:51:32 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:51:32 [Note] WSREP: Assign initial position for certification: 74007737, protocol version: 2
140910 11:51:33 [Warning] WSREP: last seen seqno below limit for trx source: 6424b081-38e0-11e4-9b9d-2e9ac85d2c9e version: 2 local: 1 state: CERTIFYING flags: 1 conn_id: 18 trx_id: 114100040 seqnos (l: 2072, g: 74007739, s: 74007736, d: -1, ts: 1410349887418273383)
140910 11:51:35 [Note] WSREP: Node 2 (GeoDBnvatest) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 11:51:35 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74007753)
140910 11:51:35 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:74007681-74007737|tcp://10.200.201.20:4568
140910 11:51:35 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 11:51:35 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.201.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74007681' --bypass'
140910 11:51:35 [Note] WSREP: sst_donor_thread signaled with 0
140910 11:51:35 [Note] WSREP: async IST sender starting to serve tcp://10.200.201.20:4568 sending 74007682-74007737
WSREP_SST: [INFO] Streaming with xbstream (20140910 11:51:35.705)
WSREP_SST: [INFO] Using socat as streamer (20140910 11:51:35.712)
WSREP_SST: [INFO] Bypassing the SST for IST (20140910 11:51:35.723)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.201.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 11:51:35.737)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 11:51:35.843)
140910 11:51:38 [Note] WSREP: async IST sender served
140910 11:51:38 [Note] WSREP: 0 (GeoDBiretest): State transfer to 2 (GeoDBnvatest) complete.
140910 11:51:38 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74007787)
140910 11:51:38 [Note] WSREP: 2 (GeoDBnvatest): State transfer from 0 (GeoDBiretest) complete.
140910 11:51:38 [Note] WSREP: Member 2 (GeoDBnvatest) synced with group.
140910 11:51:39 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 11:51:39 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74007789)
140910 11:51:39 [Note] WSREP: Synchronized with group, ready for connections
140910 11:51:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 12:28:06 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 12:28:07 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0
140910 12:28:08 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:28:08 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f83b801ad80 after established 0x7f83b80151d0
140910 12:28:12 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 12:28:13 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0
140910 12:28:14 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:32:46 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 12:32:47 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0
140910 12:32:47 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:32:47 [Note] WSREP: (6424b081-38e0-11e4-9b9d-2e9ac85d2c9e, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f83b801ad80 after established 0x7f83b802aea0
140910 12:43:44 [Note] /usr/sbin/mysqld: Normal shutdown
140910 12:43:44 [Note] WSREP: Stop replication
140910 12:43:44 [Note] WSREP: Closing send monitor...
140910 12:43:44 [Note] WSREP: Closed send monitor.
140910 12:43:44 [Note] WSREP: gcomm: terminating thread
140910 12:43:44 [Note] WSREP: gcomm: joining thread
140910 12:43:44 [Note] WSREP: gcomm: closing backend
140910 12:43:44 [Note] WSREP: view(view_id(NON_PRIM,6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,30) memb {
6424b081-38e0-11e4-9b9d-2e9ac85d2c9e,
} joined {
} left {
} partitioned {
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
cbcb6d36-38e0-11e4-80bb-521e0b098894,
f9281937-38df-11e4-9142-3ffb096d5201,
})
140910 12:43:44 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
140910 12:43:44 [Note] WSREP: view((empty))
140910 12:43:44 [Note] WSREP: gcomm: closed
140910 12:43:44 [Note] WSREP: Flow-control interval: [16, 16]
140910 12:43:44 [Note] WSREP: Received NON-PRIMARY.
140910 12:43:44 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 74027413)
140910 12:43:44 [Note] WSREP: Received self-leave message.
140910 12:43:44 [Note] WSREP: Flow-control interval: [0, 0]
140910 12:43:44 [Note] WSREP: Received SELF-LEAVE. Closing connection.
140910 12:43:44 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 74027413)
140910 12:43:44 [Note] WSREP: RECV thread exiting 0: Success
140910 12:43:44 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 2
140910 12:43:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 12:43:44 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 2
140910 12:43:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 12:43:44 [Note] WSREP: applier thread exiting (code:0)
140910 12:43:44 [Note] WSREP: recv_thread() joined.
140910 12:43:44 [Note] WSREP: Closing replication queue.
140910 12:43:44 [Note] WSREP: Closing slave action queue.
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:44 [Note] WSREP: applier thread exiting (code:5)
140910 12:43:46 [Note] WSREP: rollbacker thread exiting
140910 12:43:46 [Note] WSREP: dtor state: CLOSED
140910 12:43:46 [Note] WSREP: mon: entered 21794 oooe fraction 0 oool fraction 0
140910 12:43:46 [Note] WSREP: mon: entered 21794 oooe fraction 0.00862623 oool fraction 0.000412958
140910 12:43:46 [Note] WSREP: mon: entered 21903 oooe fraction 0 oool fraction 4.56558e-05
140910 12:43:46 [Note] WSREP: cert index usage at exit 361
140910 12:43:46 [Note] WSREP: cert trx map usage at exit 179
140910 12:43:46 [Note] WSREP: deps set usage at exit 0
140910 12:43:46 [Note] WSREP: avg deps dist 459.196
140910 12:43:46 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0
140910 12:43:46 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: 74027413)
140910 12:43:46 [Note] WSREP: Flushing memory map to disk...
140910 12:43:46 InnoDB: Starting shutdown...
140910 12:43:48 InnoDB: Shutdown completed; log sequence number 190758981410
140910 12:43:48 [Note] /usr/sbin/mysqld: Shutdown complete
140910 12:43:48 mysqld_safe mysqld from pid file /mnt/data/geo/mysql.pid ended
140910 12:46:40 mysqld_safe Starting mysqld daemon with databases from /mnt/data/geo
140910 12:46:40 mysqld_safe Skipping wsrep-recover for 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413 pair
140910 12:46:40 mysqld_safe Assigning 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413 to wsrep_start_position
140910 12:46:41 [Note] WSREP: wsrep_start_position var submitted: '793fe80a-b316-11e2-0800-0198ce0bf65f:74027413'
140910 12:46:41 [Note] WSREP: Read nil XID from storage engines, skipping position init
140910 12:46:41 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/libgalera_smm.so'
140910 12:46:41 [Note] WSREP: wsrep_load(): Galera 2.7(r157) by Codership Oy <info@codership.com> loaded succesfully.
140910 12:46:41 [Note] WSREP: Found saved state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413
140910 12:46:41 [Note] WSREP: Reusing existing '/mnt/data/geo//galera.cache'.
140910 12:46:41 [Note] WSREP: Passing config to GCS: base_host = 10.200.202.20; base_port = 4567; cert.log_conflicts = no; evs.inactive_check_period = PT10S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M; evs.keepalive_period = PT3S; evs.suspect_timeout = PT30S; gcache.dir = /mnt/data/geo/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /mnt/data/geo//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3
140910 12:46:41 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: -1
140910 12:46:41 [Note] WSREP: wsrep_sst_grab()
140910 12:46:41 [Note] WSREP: Start replication
140910 12:46:41 [Note] WSREP: Setting initial position to 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413
140910 12:46:41 [Note] WSREP: protonet asio version 0
140910 12:46:41 [Note] WSREP: backend: asio
140910 12:46:41 [Note] WSREP: GMCast version 0
140910 12:46:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
140910 12:46:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
140910 12:46:41 [Note] WSREP: EVS version 0
140910 12:46:41 [Note] WSREP: PC version 0
140910 12:46:41 [Note] WSREP: gcomm: connecting to group 'Geotest', peer '10.200.200.20:,10.200.201.20:,10.200.203.20:'
140910 12:46:42 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 12:46:42 [Note] WSREP: Node 9d33a649-38e0-11e4-bd9e-8efef3ec8052 state prim
140910 12:46:42 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,35) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
} joined {
} left {
} partitioned {
})
140910 12:46:42 [Note] WSREP: discarding pending addr without UUID: tcp://10.200.200.20:4567
140910 12:46:42 [Note] WSREP: discarding pending addr proto entry 0x2eebc60
140910 12:46:42 [Note] WSREP: discarding pending addr without UUID: tcp://10.200.201.20:4567
140910 12:46:42 [Note] WSREP: discarding pending addr proto entry 0x2ef4430
140910 12:46:42 [Note] WSREP: gcomm: connected
140910 12:46:42 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
140910 12:46:42 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
140910 12:46:42 [Note] WSREP: Opened channel 'Geotest'
140910 12:46:42 [Note] WSREP: Waiting for SST to complete.
140910 12:46:42 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
140910 12:46:42 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4
140910 12:46:43 [Note] WSREP: STATE EXCHANGE: sent state msg: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4
140910 12:46:43 [Note] WSREP: STATE EXCHANGE: got state msg: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4 from 0 (GeoDBiretest)
140910 12:46:43 [Note] WSREP: STATE EXCHANGE: got state msg: 8430ba2a-38e8-11e4-8d86-47266d9c2ec4 from 1 (GeoDB401test)
140910 12:46:43 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 33,
members = 2/2 (joined/total),
act_id = 74027413,
last_appl. = -1,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 12:46:43 [Note] WSREP: Flow-control interval: [23, 23]
140910 12:46:43 [Note] WSREP: Restored state OPEN -> JOINED (74027413)
140910 12:46:43 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# 34: Primary, number of nodes: 2, my index: 0, protocol version 2
140910 12:46:43 [Note] WSREP: SST complete, seqno: 74027413
140910 12:46:43 [Note] Plugin 'FEDERATED' is disabled.
140910 12:46:43 InnoDB: The InnoDB memory heap is disabled
140910 12:46:43 InnoDB: Mutexes and rw_locks use GCC atomic builtins
140910 12:46:43 InnoDB: Compressed tables use zlib 1.2.3
140910 12:46:43 InnoDB: Using Linux native AIO
140910 12:46:43 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 12:46:43 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74027413)
140910 12:46:43 InnoDB: Initializing buffer pool, size = 2.0G
140910 12:46:43 InnoDB: Completed initialization of buffer pool
140910 12:46:43 InnoDB: highest supported file format is Barracuda.
140910 12:46:44 InnoDB: Waiting for the background threads to start
140910 12:46:45 Percona XtraDB (http://www.percona.com) 5.5.33-rel31.0 started; log sequence number 190758981410
140910 12:46:45 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 12:46:45 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: 2
140910 12:46:45 [Note] WSREP: Synchronized with group, ready for connections
140910 12:46:45 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 12:46:45 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.5.33' socket: '/var/lib/mysql/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), wsrep_23.7.6.r3915
140910 12:47:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 12:47:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:47:35 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 12:47:35 [Note] WSREP: declaring a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 stable
140910 12:47:35 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 12:47:35 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,36) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
a25d0273-38e8-11e4-81e1-8a0d9e4a57f0,
} joined {
} left {
} partitioned {
})
140910 12:47:35 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 12:47:35 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df
140910 12:47:35 [Note] WSREP: STATE EXCHANGE: sent state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df
140910 12:47:35 [Note] WSREP: STATE EXCHANGE: got state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df from 0 (GeoDBiretest)
140910 12:47:35 [Note] WSREP: STATE EXCHANGE: got state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df from 1 (GeoDB401test)
140910 12:47:35 [Note] WSREP: STATE EXCHANGE: got state msg: a37ffb9a-38e8-11e4-b80a-02e2cf4dc8df from 2 (GeoDB02uw2a)
140910 12:47:35 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 34,
members = 3/3 (joined/total),
act_id = 74027413,
last_appl. = 0,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 12:47:35 [Note] WSREP: Flow-control interval: [28, 28]
140910 12:47:35 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# 35: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 12:47:35 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 12:47:35 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: 2
140910 12:47:36 [Note] WSREP: Member 2 (GeoDB02uw2a) synced with group.
140910 12:47:49 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 12:47:49 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:47:50 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 12:47:50 [Note] WSREP: declaring a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 stable
140910 12:47:50 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 12:47:54 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 12:47:54 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,37) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
a25d0273-38e8-11e4-81e1-8a0d9e4a57f0,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
})
140910 12:47:54 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 12:47:54 [Note] WSREP: STATE_EXCHANGE: sent state UUID: aede7ce0-38e8-11e4-af0b-537c82f791e6
140910 12:47:54 [Note] WSREP: STATE EXCHANGE: sent state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6
140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 0 (GeoDBiretest)
140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 3 (GeoDBnvatest)
140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 1 (GeoDB401test)
140910 12:47:54 [Note] WSREP: STATE EXCHANGE: got state msg: aede7ce0-38e8-11e4-af0b-537c82f791e6 from 2 (GeoDB02uw2a)
140910 12:47:54 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 35,
members = 4/4 (joined/total),
act_id = 74027413,
last_appl. = 0,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 12:47:54 [Note] WSREP: Flow-control interval: [32, 32]
140910 12:47:54 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027413, view# 36: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 12:47:54 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 12:47:54 [Note] WSREP: Assign initial position for certification: 74027413, protocol version: 2
140910 12:47:55 [Note] WSREP: Member 3 (GeoDBnvatest) synced with group.
140910 12:48:15 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 12:48:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0
140910 12:48:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:48:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up established 0x7f386c018030 which is duplicate of 0x7f386c019690
140910 12:51:03 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 12:51:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0
140910 12:51:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c018030 after established 0x7f386c017dc0
140910 12:51:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:55:15 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 12:55:16 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 12:58:18 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 12:58:19 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:02:39 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 13:02:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0
140910 13:02:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:03:36 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:03:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0
140910 13:03:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:03:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c017dc0 after established 0x7f386c018f00
140910 13:04:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:04:52 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0
140910 13:04:53 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up established 0x7f386c00d810 which is duplicate of 0x7f386c017dc0
140910 13:04:53 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:06:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:06:41 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:06:41 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:06:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567), attempt 0
140910 13:06:44 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:06:44 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,38) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
a25d0273-38e8-11e4-81e1-8a0d9e4a57f0,
})
140910 13:06:44 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 13:06:44 [Note] WSREP: forgetting a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567)
140910 13:06:44 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:06:44 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 5027c709-38eb-11e4-bc89-37890d6dbfd6
140910 13:06:44 [Note] WSREP: STATE EXCHANGE: sent state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6
140910 13:06:44 [Note] WSREP: STATE EXCHANGE: got state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6 from 0 (GeoDBiretest)
140910 13:06:44 [Note] WSREP: STATE EXCHANGE: got state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6 from 2 (GeoDBnvatest)
140910 13:06:44 [Note] WSREP: STATE EXCHANGE: got state msg: 5027c709-38eb-11e4-bc89-37890d6dbfd6 from 1 (GeoDB401test)
140910 13:06:44 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 36,
members = 3/3 (joined/total),
act_id = 74027509,
last_appl. = 0,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:06:44 [Note] WSREP: Flow-control interval: [28, 28]
140910 13:06:44 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027509, view# 37: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 13:06:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:06:44 [Note] WSREP: Assign initial position for certification: 74027509, protocol version: 2
140910 13:06:44 [Warning] WSREP: last seen seqno below limit for trx source: 834abb67-38e8-11e4-bdef-220640ebea42 version: 2 local: 1 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114120286 seqnos (l: 103, g: 74027511, s: 74027507, d: -1, ts: 1410354399730535783)
140910 13:06:44 [Warning] WSREP: last seen seqno below limit for trx source: 9d33a649-38e0-11e4-bd9e-8efef3ec8052 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114119981 seqnos (l: 104, g: 74027512, s: 74027508, d: -1, ts: 1410354399820445884)
140910 13:06:49 [Note] WSREP: cleaning up a25d0273-38e8-11e4-81e1-8a0d9e4a57f0 (tcp://10.200.200.20:4567)
140910 13:17:06 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:17:06 [Warning] WSREP: evs::proto(834abb67-38e8-11e4-bdef-220640ebea42, GATHER, view_id(REG,834abb67-38e8-11e4-bdef-220640ebea42,38))lu (9340) <= safe_seq(9340), can't recover message
140910 13:17:06 [Warning] WSREP: evs::proto(834abb67-38e8-11e4-bdef-220640ebea42, GATHER, view_id(REG,834abb67-38e8-11e4-bdef-220640ebea42,38))lu (9340) <= safe_seq(9340), can't recover message
140910 13:17:07 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:17:09 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:17:09 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:17:09 [Note] WSREP: declaring c2cc1f41-38ec-11e4-960d-b7d1c9103859 stable
140910 13:17:12 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:17:12 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,40) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
c2cc1f41-38ec-11e4-960d-b7d1c9103859,
} joined {
} left {
} partitioned {
})
140910 13:17:12 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 13:17:12 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781
140910 13:17:12 [Note] WSREP: STATE EXCHANGE: sent state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781
140910 13:17:12 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 0 (GeoDBiretest)
140910 13:17:12 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 2 (GeoDBnvatest)
140910 13:17:12 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 1 (GeoDB401test)
140910 13:17:13 [Note] WSREP: STATE EXCHANGE: got state msg: c6ba6a8f-38ec-11e4-864a-db8e5ca7b781 from 3 (GeoDB02uw2a)
140910 13:17:13 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 37,
members = 3/4 (joined/total),
act_id = 74040947,
last_appl. = 74040662,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:17:13 [Note] WSREP: Flow-control interval: [32, 32]
140910 13:17:13 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74040947, view# 38: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 13:17:13 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:17:13 [Note] WSREP: Assign initial position for certification: 74040947, protocol version: 2
140910 13:17:13 [Warning] WSREP: last seen seqno below limit for trx source: aba46be6-38e8-11e4-b016-539366c26ab6 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 21 trx_id: 114133978 seqnos (l: 13607, g: 74040949, s: 74040945, d: -1, ts: 1410355026799834843)
140910 13:17:13 [Warning] WSREP: last seen seqno below limit for trx source: 9d33a649-38e0-11e4-bd9e-8efef3ec8052 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114133418 seqnos (l: 13608, g: 74040950, s: 74040946, d: -1, ts: 1410355026863148754)
140910 13:17:16 [Note] WSREP: Node 3 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 13:17:16 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74040989)
140910 13:17:16 [Note] WSREP: IST request: 793fe80a-b316-11e2-0800-0198ce0bf65f:74027509-74040947|tcp://10.200.200.20:4568
140910 13:17:16 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:17:16 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74027509' --bypass'
140910 13:17:16 [Note] WSREP: sst_donor_thread signaled with 0
140910 13:17:16 [Note] WSREP: async IST sender starting to serve tcp://10.200.200.20:4568 sending 74027510-74040947
WSREP_SST: [INFO] Streaming with xbstream (20140910 13:17:16.961)
WSREP_SST: [INFO] Using socat as streamer (20140910 13:17:16.968)
WSREP_SST: [INFO] Bypassing the SST for IST (20140910 13:17:16.980)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:17:16.995)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20140910 13:17:17.237)
140910 13:17:19 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:17:20 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:17:20 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:17:20 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to c2cc1f41-38ec-11e4-960d-b7d1c9103859 (tcp://10.200.200.20:4567), attempt 0
140910 13:17:23 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:17:23 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,41) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
c2cc1f41-38ec-11e4-960d-b7d1c9103859,
})
140910 13:17:23 [Note] WSREP: forgetting c2cc1f41-38ec-11e4-960d-b7d1c9103859 (tcp://10.200.200.20:4567)
140910 13:17:23 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:17:23 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 13:17:23 [Note] WSREP: STATE_EXCHANGE: sent state UUID: cd694fa5-38ec-11e4-8d18-3e68771198b6
140910 13:17:23 [Note] WSREP: STATE EXCHANGE: sent state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6
140910 13:17:23 [Note] WSREP: STATE EXCHANGE: got state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6 from 0 (GeoDBiretest)
140910 13:17:24 [Note] WSREP: STATE EXCHANGE: got state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6 from 1 (GeoDB401test)
140910 13:17:24 [Note] WSREP: STATE EXCHANGE: got state msg: cd694fa5-38ec-11e4-8d18-3e68771198b6 from 2 (GeoDBnvatest)
140910 13:17:24 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 38,
members = 3/3 (joined/total),
act_id = 74041021,
last_appl. = 74040662,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:17:24 [Note] WSREP: Flow-control interval: [28, 28]
140910 13:17:24 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74041021, view# 39: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 13:17:24 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:17:24 [Note] WSREP: Assign initial position for certification: 74041021, protocol version: 2
140910 13:17:24 [Warning] WSREP: last seen seqno below limit for trx source: 9d33a649-38e0-11e4-bd9e-8efef3ec8052 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 19 trx_id: 114133491 seqnos (l: 13683, g: 74041023, s: 74041020, d: -1, ts: 1410355039437739534)
140910 13:17:24 [Warning] WSREP: last seen seqno below limit for trx source: aba46be6-38e8-11e4-b016-539366c26ab6 version: 2 local: 0 state: CERTIFYING flags: 1 conn_id: 21 trx_id: 114134051 seqnos (l: 13684, g: 74041024, s: 74041019, d: -1, ts: 1410355039416924803)
140910 13:17:25 [ERROR] WSREP: async IST sender failed to serve tcp://10.200.200.20:4568: ist send failed: 1', asio error 'Connection reset by peer': 104 (Connection reset by peer)
at galera/src/ist.cpp:send():744
140910 13:17:25 [Note] WSREP: async IST sender served
140910 13:17:26 [Warning] WSREP: Could not find peer: c2cc1f41-38ec-11e4-960d-b7d1c9103859
140910 13:17:26 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -104 (Connection reset by peer)
140910 13:17:26 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74041053)
140910 13:17:26 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 13:17:26 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74041056)
140910 13:17:26 [Note] WSREP: Synchronized with group, ready for connections
140910 13:17:26 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:17:28 [Note] WSREP: cleaning up c2cc1f41-38ec-11e4-960d-b7d1c9103859 (tcp://10.200.200.20:4567)
140910 13:36:55 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:36:56 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:36:57 [Note] WSREP: declaring 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 stable
140910 13:36:57 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:36:57 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:37:00 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:37:00 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,42) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
87d66aa6-38ef-11e4-8b46-5225c1d84fe6,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
})
140910 13:37:00 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 13:37:00 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8b0fec85-38ef-11e4-bb28-8f03159d93a3
140910 13:37:01 [Note] WSREP: STATE EXCHANGE: sent state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3
140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 0 (GeoDBiretest)
140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 3 (GeoDBnvatest)
140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 1 (GeoDB02uw2a)
140910 13:37:01 [Note] WSREP: STATE EXCHANGE: got state msg: 8b0fec85-38ef-11e4-bb28-8f03159d93a3 from 2 (GeoDB401test)
140910 13:37:01 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 39,
members = 3/4 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:37:01 [Note] WSREP: Flow-control interval: [32, 32]
140910 13:37:01 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 40: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 13:37:01 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:37:01 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:37:04 [Note] WSREP: Node 1 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 13:37:04 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706)
140910 13:37:04 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:37:04 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706''
140910 13:37:04 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20140910 13:37:04.564)
WSREP_SST: [INFO] Using socat as streamer (20140910 13:37:04.572)
WSREP_SST: [INFO] Streaming GTID file before SST (20140910 13:37:04.589)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:37:04.597)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20140910 13:37:04.776)
140910 13:37:07 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:37:08 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:37:08 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:37:08 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 (tcp://10.200.200.20:4567), attempt 0
140910 13:37:11 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:37:11 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,43) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
87d66aa6-38ef-11e4-8b46-5225c1d84fe6,
})
140910 13:37:11 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 13:37:11 [Note] WSREP: forgetting 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 (tcp://10.200.200.20:4567)
140910 13:37:11 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:37:11 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 91362ee1-38ef-11e4-950e-df145f580030
140910 13:37:11 [Note] WSREP: STATE EXCHANGE: sent state msg: 91362ee1-38ef-11e4-950e-df145f580030
140910 13:37:11 [Note] WSREP: STATE EXCHANGE: got state msg: 91362ee1-38ef-11e4-950e-df145f580030 from 0 (GeoDBiretest)
140910 13:37:11 [Note] WSREP: STATE EXCHANGE: got state msg: 91362ee1-38ef-11e4-950e-df145f580030 from 2 (GeoDBnvatest)
140910 13:37:11 [Note] WSREP: STATE EXCHANGE: got state msg: 91362ee1-38ef-11e4-950e-df145f580030 from 1 (GeoDB401test)
140910 13:37:11 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 40,
members = 3/3 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:37:11 [Note] WSREP: Flow-control interval: [28, 28]
140910 13:37:11 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 41: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 13:37:11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:37:11 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
WSREP_SST: [INFO] Streaming the backup to joiner at 10.200.200.20 4444 (20140910 13:37:14.791)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf $INNOEXTRA --galera-info --stream=$sfmt ${TMPDIR} 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:37:14.799)
2014/09/10 13:37:14 socat[2560] E connect(3, AF=2 10.200.200.20:4444, 16): Connection refused
WSREP_SST: [ERROR] innobackupex finished with error: 1. Check /mnt/data/geo//innobackup.backup.log (20140910 13:37:15.611)
WSREP_SST: [ERROR] Cleanup after exit with status:22 (20140910 13:37:15.619)
140910 13:37:15 [ERROR] WSREP: Failed to read from: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'
140910 13:37:15 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 22 (Invalid argument)
140910 13:37:15 [Warning] WSREP: Could not find peer: 87d66aa6-38ef-11e4-8b46-5225c1d84fe6
140910 13:37:15 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -1 (Operation not permitted)
140910 13:37:15 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706)
140910 13:37:15 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 13:37:15 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706)
140910 13:37:15 [Note] WSREP: Synchronized with group, ready for connections
140910 13:37:15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:37:16 [Note] WSREP: cleaning up 87d66aa6-38ef-11e4-8b46-5225c1d84fe6 (tcp://10.200.200.20:4567)
140910 13:43:02 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 13:43:03 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:46:50 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 13:46:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0
140910 13:46:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:46:51 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c00da00 after established 0x7f386c03d790
140910 13:48:23 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 13:48:24 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0
140910 13:48:24 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:50:35 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.203.20:4567
140910 13:50:36 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 9d33a649-38e0-11e4-bd9e-8efef3ec8052 (tcp://10.200.203.20:4567), attempt 0
140910 13:50:36 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:51:25 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:51:25 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:51:27 [Note] WSREP: declaring 8e4530d2-38f1-11e4-9172-56c5f6c4224d stable
140910 13:51:27 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:51:27 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:51:30 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:51:30 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,44) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
8e4530d2-38f1-11e4-9172-56c5f6c4224d,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
})
140910 13:51:30 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 13:51:30 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 9168d101-38f1-11e4-89fe-72f979fa36c0
140910 13:51:30 [Note] WSREP: STATE EXCHANGE: sent state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0
140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 0 (GeoDBiretest)
140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 3 (GeoDBnvatest)
140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 2 (GeoDB401test)
140910 13:51:31 [Note] WSREP: STATE EXCHANGE: got state msg: 9168d101-38f1-11e4-89fe-72f979fa36c0 from 1 (GeoDB02uw2a)
140910 13:51:31 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 41,
members = 3/4 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:51:31 [Note] WSREP: Flow-control interval: [32, 32]
140910 13:51:31 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 42: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 13:51:31 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:51:31 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:51:34 [Note] WSREP: Node 1 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 13:51:34 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706)
140910 13:51:34 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:51:34 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706''
140910 13:51:34 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20140910 13:51:34.755)
WSREP_SST: [INFO] Using socat as streamer (20140910 13:51:34.762)
WSREP_SST: [INFO] Streaming GTID file before SST (20140910 13:51:34.779)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:51:34.787)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20140910 13:51:34.977)
140910 13:51:37 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:51:38 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:51:38 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:51:38 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 8e4530d2-38f1-11e4-9172-56c5f6c4224d (tcp://10.200.200.20:4567), attempt 0
140910 13:51:41 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:51:41 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,45) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
8e4530d2-38f1-11e4-9172-56c5f6c4224d,
})
140910 13:51:41 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 13:51:41 [Note] WSREP: forgetting 8e4530d2-38f1-11e4-9172-56c5f6c4224d (tcp://10.200.200.20:4567)
140910 13:51:41 [Note] WSREP: deleting entry tcp://10.200.200.20:4567
140910 13:51:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:51:41 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 97e41709-38f1-11e4-99b2-d330aeadf310
140910 13:51:41 [Note] WSREP: STATE EXCHANGE: sent state msg: 97e41709-38f1-11e4-99b2-d330aeadf310
140910 13:51:41 [Note] WSREP: STATE EXCHANGE: got state msg: 97e41709-38f1-11e4-99b2-d330aeadf310 from 0 (GeoDBiretest)
140910 13:51:41 [Note] WSREP: STATE EXCHANGE: got state msg: 97e41709-38f1-11e4-99b2-d330aeadf310 from 2 (GeoDBnvatest)
140910 13:51:41 [Note] WSREP: STATE EXCHANGE: got state msg: 97e41709-38f1-11e4-99b2-d330aeadf310 from 1 (GeoDB401test)
140910 13:51:41 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 42,
members = 3/3 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:51:41 [Note] WSREP: Flow-control interval: [28, 28]
140910 13:51:41 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 43: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 13:51:41 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:51:41 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
WSREP_SST: [INFO] Streaming the backup to joiner at 10.200.200.20 4444 (20140910 13:51:44.987)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf $INNOEXTRA --galera-info --stream=$sfmt ${TMPDIR} 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:51:44.994)
2014/09/10 13:51:45 socat[2752] E connect(3, AF=2 10.200.200.20:4444, 16): Connection refused
WSREP_SST: [ERROR] innobackupex finished with error: 1. Check /mnt/data/geo//innobackup.backup.log (20140910 13:51:45.306)
WSREP_SST: [ERROR] Cleanup after exit with status:22 (20140910 13:51:45.313)
140910 13:51:45 [ERROR] WSREP: Failed to read from: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'
140910 13:51:45 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 22 (Invalid argument)
140910 13:51:45 [Warning] WSREP: Could not find peer: 8e4530d2-38f1-11e4-9172-56c5f6c4224d
140910 13:51:45 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -1 (Operation not permitted)
140910 13:51:45 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706)
140910 13:51:45 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 13:51:45 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706)
140910 13:51:45 [Note] WSREP: Synchronized with group, ready for connections
140910 13:51:45 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:51:46 [Note] WSREP: cleaning up 8e4530d2-38f1-11e4-9172-56c5f6c4224d (tcp://10.200.200.20:4567)
140910 13:51:48 [Warning] WSREP: last inactive check more than PT30S ago (PT30.1903S), skipping check
140910 13:52:05 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:52:05 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:52:06 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:52:06 [Note] WSREP: declaring a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 stable
140910 13:52:06 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:52:10 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:52:10 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,46) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
a5f24094-38f1-11e4-ba16-3fc6f3a1ef05,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
})
140910 13:52:10 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 13:52:10 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a9290063-38f1-11e4-b494-9e419ce2c110
140910 13:52:10 [Note] WSREP: STATE EXCHANGE: sent state msg: a9290063-38f1-11e4-b494-9e419ce2c110
140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 0 (GeoDBiretest)
140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 3 (GeoDBnvatest)
140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 1 (GeoDB401test)
140910 13:52:10 [Note] WSREP: STATE EXCHANGE: got state msg: a9290063-38f1-11e4-b494-9e419ce2c110 from 2 (GeoDB02uw2a)
140910 13:52:10 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 43,
members = 3/4 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:52:10 [Note] WSREP: Flow-control interval: [32, 32]
140910 13:52:10 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 44: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 13:52:10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:52:10 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:52:13 [Note] WSREP: Node 2 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 13:52:13 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706)
140910 13:52:13 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:52:13 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706''
140910 13:52:13 [Note] WSREP: sst_donor_thread signaled with 0
140910 13:52:13 [Note] WSREP: Flushing tables for SST...
140910 13:52:13 [Note] WSREP: Provider paused at 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706
140910 13:52:13 [Note] WSREP: Tables flushed.
@ERROR: Unknown module 'rsync_sst-with_filter'
rsync error: error starting client-server protocol (code 5) at main.c(1503) [sender=3.0.6]
WSREP_SST: [ERROR] rsync returned code 5: (20140910 13:52:13.934)
140910 13:52:13 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'
140910 13:52:13 [Note] WSREP: Provider resumed.
140910 13:52:13 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 255 (Unknown error 255)
140910 13:52:14 [Warning] WSREP: 0 (GeoDBiretest): State transfer to 2 (GeoDB02uw2a) failed: -1 (Operation not permitted)
140910 13:52:14 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706)
140910 13:52:14 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:52:15 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 13:52:15 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706)
140910 13:52:15 [Note] WSREP: Synchronized with group, ready for connections
140910 13:52:15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:52:15 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:52:15 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:52:15 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 (tcp://10.200.200.20:4567), attempt 0
140910 13:52:18 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:52:18 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,47) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
a5f24094-38f1-11e4-ba16-3fc6f3a1ef05,
})
140910 13:52:18 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 13:52:18 [Note] WSREP: forgetting a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 (tcp://10.200.200.20:4567)
140910 13:52:18 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:52:18 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ae0aa1f4-38f1-11e4-9727-5ead045d1a79
140910 13:52:18 [Note] WSREP: STATE EXCHANGE: sent state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79
140910 13:52:18 [Note] WSREP: STATE EXCHANGE: got state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 from 0 (GeoDBiretest)
140910 13:52:18 [Note] WSREP: STATE EXCHANGE: got state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 from 1 (GeoDB401test)
140910 13:52:18 [Note] WSREP: STATE EXCHANGE: got state msg: ae0aa1f4-38f1-11e4-9727-5ead045d1a79 from 2 (GeoDBnvatest)
140910 13:52:18 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 44,
members = 3/3 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:52:18 [Note] WSREP: Flow-control interval: [28, 28]
140910 13:52:18 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 45: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 13:52:18 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:52:18 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:52:23 [Note] WSREP: cleaning up a5f24094-38f1-11e4-ba16-3fc6f3a1ef05 (tcp://10.200.200.20:4567)
140910 13:54:39 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:54:40 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:54:42 [Note] WSREP: declaring 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 stable
140910 13:54:42 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:54:42 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:54:49 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:54:49 [Note] WSREP: view(view_id(PRIM,01e7802b-38f2-11e4-b0df-ae8c2ab491b6,48) memb {
01e7802b-38f2-11e4-b0df-ae8c2ab491b6,
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
})
140910 13:54:49 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 4
140910 13:54:49 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
140910 13:54:49 [Note] WSREP: STATE EXCHANGE: sent state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9
140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 0 (GeoDB02uw2a)
140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 1 (GeoDBiretest)
140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 2 (GeoDB401test)
140910 13:54:49 [Note] WSREP: STATE EXCHANGE: got state msg: 07deb841-38f2-11e4-8079-36b0ad6369b9 from 3 (GeoDBnvatest)
140910 13:54:49 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 45,
members = 3/4 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:54:49 [Note] WSREP: Flow-control interval: [32, 32]
140910 13:54:49 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 46: Primary, number of nodes: 4, my index: 1, protocol version 2
140910 13:54:49 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:54:49 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:54:52 [Note] WSREP: Node 0 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 1 (GeoDBiretest)(SYNCED) as donor.
140910 13:54:52 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706)
140910 13:54:52 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:54:52 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706''
140910 13:54:52 [Note] WSREP: sst_donor_thread signaled with 0
140910 13:54:52 [Note] WSREP: Flushing tables for SST...
140910 13:54:52 [Note] WSREP: Provider paused at 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706
140910 13:54:52 [Note] WSREP: Tables flushed.
@ERROR: Unknown module 'rsync_sst-with_filter'
rsync error: error starting client-server protocol (code 5) at main.c(1503) [sender=3.0.6]
WSREP_SST: [ERROR] rsync returned code 5: (20140910 13:54:53.280)
140910 13:54:53 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'
140910 13:54:53 [Note] WSREP: Provider resumed.
140910 13:54:53 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 255 (Unknown error 255)
140910 13:54:53 [Warning] WSREP: 1 (GeoDBiretest): State transfer to 0 (GeoDB02uw2a) failed: -1 (Operation not permitted)
140910 13:54:53 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706)
140910 13:54:54 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:54:54 [Note] WSREP: Member 1 (GeoDBiretest) synced with group.
140910 13:54:54 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706)
140910 13:54:54 [Note] WSREP: Synchronized with group, ready for connections
140910 13:54:54 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:54:54 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:54:54 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:54:55 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 (tcp://10.200.200.20:4567), attempt 0
140910 13:54:57 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:54:58 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,49) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
01e7802b-38f2-11e4-b0df-ae8c2ab491b6,
})
140910 13:54:58 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 13:54:58 [Note] WSREP: forgetting 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 (tcp://10.200.200.20:4567)
140910 13:54:58 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:54:58 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 0d1ca046-38f2-11e4-a0cc-52315e886555
140910 13:54:58 [Note] WSREP: STATE EXCHANGE: sent state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555
140910 13:54:58 [Note] WSREP: STATE EXCHANGE: got state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555 from 0 (GeoDBiretest)
140910 13:54:58 [Note] WSREP: STATE EXCHANGE: got state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555 from 1 (GeoDB401test)
140910 13:54:58 [Note] WSREP: STATE EXCHANGE: got state msg: 0d1ca046-38f2-11e4-a0cc-52315e886555 from 2 (GeoDBnvatest)
140910 13:54:58 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 46,
members = 3/3 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:54:58 [Note] WSREP: Flow-control interval: [28, 28]
140910 13:54:58 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 47: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 13:54:58 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:54:58 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:55:03 [Note] WSREP: cleaning up 01e7802b-38f2-11e4-b0df-ae8c2ab491b6 (tcp://10.200.200.20:4567)
140910 13:59:41 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:59:42 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:59:42 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c040be0 after established 0x7f386c00da00
140910 13:59:44 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:59:44 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:59:44 [Note] WSREP: declaring b6134ee2-38f2-11e4-982a-0ab05726be5e stable
140910 13:59:47 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:59:47 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,51) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
b6134ee2-38f2-11e4-982a-0ab05726be5e,
} joined {
} left {
} partitioned {
})
140910 13:59:47 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 4
140910 13:59:47 [Note] WSREP: STATE_EXCHANGE: sent state UUID: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f
140910 13:59:47 [Note] WSREP: STATE EXCHANGE: sent state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 0 (GeoDBiretest)
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 2 (GeoDBnvatest)
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 1 (GeoDB401test)
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 3 (GeoDB02uw2a)
140910 13:59:48 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 47,
members = 3/4 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:59:48 [Note] WSREP: Flow-control interval: [32, 32]
140910 13:59:48 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 48: Primary, number of nodes: 4, my index: 0, protocol version 2
140910 13:59:48 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:59:48 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:59:51 [Note] WSREP: Node 3 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 13:59:51 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706)
140910 13:59:51 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:59:51 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706''
140910 13:59:51 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20140910 13:59:51.406)
WSREP_SST: [INFO] Using socat as streamer (20140910 13:59:51.413)
WSREP_SST: [INFO] Streaming GTID file before SST (20140910 13:59:51.431)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 13:59:51.438)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20140910 13:59:51.617)
140910 13:59:54 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 13:59:54 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 13:59:54 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 13:59:55 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to b6134ee2-38f2-11e4-982a-0ab05726be5e (tcp://10.200.200.20:4567), attempt 0
140910 13:59:58 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 13:59:58 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,52) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
b6134ee2-38f2-11e4-982a-0ab05726be5e,
})
140910 13:59:58 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 13:59:58 [Note] WSREP: forgetting b6134ee2-38f2-11e4-982a-0ab05726be5e (tcp://10.200.200.20:4567)
140910 13:59:58 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:59:58 [Note] WSREP: STATE_EXCHANGE: sent state UUID: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e
140910 13:59:58 [Note] WSREP: STATE EXCHANGE: sent state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e
140910 13:59:58 [Note] WSREP: STATE EXCHANGE: got state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e from 0 (GeoDBiretest)
140910 13:59:58 [Note] WSREP: STATE EXCHANGE: got state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e from 2 (GeoDBnvatest)
140910 13:59:58 [Note] WSREP: STATE EXCHANGE: got state msg: bff4a1e9-38f2-11e4-a830-77f94d9e5e5e from 1 (GeoDB401test)
140910 13:59:58 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 48,
members = 3/3 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:59:58 [Note] WSREP: Flow-control interval: [28, 28]
140910 13:59:58 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 49: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 13:59:58 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:59:58 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
WSREP_SST: [INFO] Streaming the backup to joiner at 10.200.200.20 4444 (20140910 14:00:01.628)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf $INNOEXTRA --galera-info --stream=$sfmt ${TMPDIR} 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:10.200.200.20:4444; RC=( ${PIPESTATUS[@]} ) (20140910 14:00:01.636)
2014/09/10 14:00:01 socat[2988] E connect(3, AF=2 10.200.200.20:4444, 16): Connection refused
WSREP_SST: [ERROR] innobackupex finished with error: 1. Check /mnt/data/geo//innobackup.backup.log (20140910 14:00:02.028)
WSREP_SST: [ERROR] Cleanup after exit with status:22 (20140910 14:00:02.037)
140910 14:00:02 [ERROR] WSREP: Failed to read from: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'
140910 14:00:02 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'donor' --address '10.200.200.20:4444/xtrabackup_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 22 (Invalid argument)
140910 14:00:02 [Warning] WSREP: Could not find peer: b6134ee2-38f2-11e4-982a-0ab05726be5e
140910 14:00:02 [Warning] WSREP: 0 (GeoDBiretest): State transfer to -1 (left the group) failed: -1 (Operation not permitted)
140910 14:00:02 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706)
140910 14:00:02 [Note] WSREP: Member 0 (GeoDBiretest) synced with group.
140910 14:00:02 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706)
140910 14:00:02 [Note] WSREP: Synchronized with group, ready for connections
140910 14:00:02 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 14:00:03 [Note] WSREP: cleaning up b6134ee2-38f2-11e4-982a-0ab05726be5e (tcp://10.200.200.20:4567)
140910 14:00:04 [Warning] WSREP: last inactive check more than PT30S ago (PT30.0491S), skipping check
140910 14:09:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 14:09:34 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 14:09:35 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') cleaning up duplicate 0x7f386c018f00 after established 0x7f386c040be0
140910 14:09:36 [Note] WSREP: declaring 1741d801-38f4-11e4-a63c-5b5cff7102ae stable
140910 14:09:36 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 14:09:36 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 14:09:40 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 14:09:40 [Note] WSREP: view(view_id(PRIM,1741d801-38f4-11e4-a63c-5b5cff7102ae,53) memb {
1741d801-38f4-11e4-a63c-5b5cff7102ae,
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
})
140910 14:09:40 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 4
140910 14:09:40 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
140910 14:09:40 [Note] WSREP: STATE EXCHANGE: sent state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f
140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 0 (GeoDB02uw2a)
140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 3 (GeoDBnvatest)
140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 2 (GeoDB401test)
140910 14:09:40 [Note] WSREP: STATE EXCHANGE: got state msg: 1ad6959a-38f4-11e4-aebe-970dcd66470f from 1 (GeoDBiretest)
140910 14:09:40 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 49,
members = 3/4 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 14:09:40 [Note] WSREP: Flow-control interval: [32, 32]
140910 14:09:40 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 50: Primary, number of nodes: 4, my index: 1, protocol version 2
140910 14:09:40 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 14:09:40 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 14:09:43 [Note] WSREP: Node 0 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 1 (GeoDBiretest)(SYNCED) as donor.
140910 14:09:43 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 74052706)
140910 14:09:43 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 14:09:43 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706''
140910 14:09:43 [Note] WSREP: sst_donor_thread signaled with 0
140910 14:09:43 [Note] WSREP: Flushing tables for SST...
140910 14:09:43 [Note] WSREP: Provider paused at 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706
140910 14:09:43 [Note] WSREP: Tables flushed.
@ERROR: Unknown module 'rsync_sst-with_filter'
rsync error: error starting client-server protocol (code 5) at main.c(1503) [sender=3.0.6]
WSREP_SST: [ERROR] rsync returned code 5: (20140910 14:09:43.807)
140910 14:09:43 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706'
140910 14:09:43 [Note] WSREP: Provider resumed.
140910 14:09:43 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '10.200.200.20:4444/rsync_sst' --auth 'sst:gtsst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --gtid '793fe80a-b316-11e2-0800-0198ce0bf65f:74052706': 255 (Unknown error 255)
140910 14:09:43 [Warning] WSREP: 1 (GeoDBiretest): State transfer to 0 (GeoDB02uw2a) failed: -1 (Operation not permitted)
140910 14:09:43 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 74052706)
140910 14:09:44 [Note] WSREP: Member 1 (GeoDBiretest) synced with group.
140910 14:09:44 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 74052706)
140910 14:09:44 [Note] WSREP: Synchronized with group, ready for connections
140910 14:09:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 14:09:44 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.200.20:4567
140910 14:09:45 [Note] WSREP: declaring 9d33a649-38e0-11e4-bd9e-8efef3ec8052 stable
140910 14:09:45 [Note] WSREP: declaring aba46be6-38e8-11e4-b016-539366c26ab6 stable
140910 14:09:45 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to 1741d801-38f4-11e4-a63c-5b5cff7102ae (tcp://10.200.200.20:4567), attempt 0
140910 14:09:48 [Note] WSREP: Node 834abb67-38e8-11e4-bdef-220640ebea42 state prim
140910 14:09:48 [Note] WSREP: view(view_id(PRIM,834abb67-38e8-11e4-bdef-220640ebea42,54) memb {
834abb67-38e8-11e4-bdef-220640ebea42,
9d33a649-38e0-11e4-bd9e-8efef3ec8052,
aba46be6-38e8-11e4-b016-539366c26ab6,
} joined {
} left {
} partitioned {
1741d801-38f4-11e4-a63c-5b5cff7102ae,
})
140910 14:09:48 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
140910 14:09:48 [Note] WSREP: forgetting 1741d801-38f4-11e4-a63c-5b5cff7102ae (tcp://10.200.200.20:4567)
140910 14:09:48 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 14:09:48 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 1fc9922c-38f4-11e4-9456-5bce73897a71
140910 14:09:48 [Note] WSREP: STATE EXCHANGE: sent state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71
140910 14:09:48 [Note] WSREP: STATE EXCHANGE: got state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71 from 0 (GeoDBiretest)
140910 14:09:48 [Note] WSREP: STATE EXCHANGE: got state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71 from 2 (GeoDBnvatest)
140910 14:09:48 [Note] WSREP: STATE EXCHANGE: got state msg: 1fc9922c-38f4-11e4-9456-5bce73897a71 from 1 (GeoDB401test)
140910 14:09:48 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 50,
members = 3/3 (joined/total),
act_id = 74052706,
last_appl. = 74052481,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 14:09:48 [Note] WSREP: Flow-control interval: [28, 28]
140910 14:09:48 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 51: Primary, number of nodes: 3, my index: 0, protocol version 2
140910 14:09:48 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 14:09:48 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 14:09:53 [Note] WSREP: cleaning up 1741d801-38f4-11e4-a63c-5b5cff7102ae (tcp://10.200.200.20:4567)
140910 14:09:55 [Warning] WSREP: last inactive check more than PT30S ago (PT30.3394S), skipping check
140910 14:12:03 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 14:12:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0
140910 14:12:04 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 14:13:27 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 14:13:28 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0
140910 14:13:28 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 14:14:21 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.200.201.20:4567
140910 14:14:22 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') reconnecting to aba46be6-38e8-11e4-b016-539366c26ab6 (tcp://10.200.201.20:4567), attempt 0
140910 14:14:22 [Note] WSREP: (834abb67-38e8-11e4-bdef-220640ebea42, 'tcp://0.0.0.0:4567') turning message relay requesting off
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment