gistfile1.txt

140910 13:59:37 mysqld_safe Starting mysqld daemon with databases from /mnt/data/geo
140910 13:59:37 mysqld_safe WSREP: Running position recovery with --log_error='/mnt/data/geo/wsrep_recovery.UUnScz' --pid-file='/mnt/data/geo/ip-10-200-200-20-recover.pid'
140910 13:59:41 mysqld_safe WSREP: Recovered position 793fe80a-b316-11e2-0800-0198ce0bf65f:74027509
140910 13:59:41 [Note] WSREP: wsrep_start_position var submitted: '793fe80a-b316-11e2-0800-0198ce0bf65f:74027509'
140910 13:59:41 [Note] WSREP: Read nil XID from storage engines, skipping position init
140910 13:59:41 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/libgalera_smm.so'
140910 13:59:41 [Note] WSREP: wsrep_load(): Galera 2.11(r318911d) by Codership Oy <info@codership.com> loaded successfully.
140910 13:59:41 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1
140910 13:59:41 [Note] WSREP: Reusing existing '/mnt/data/geo//galera.cache'.
140910 13:59:41 [Note] WSREP: Passing config to GCS: base_host = 10.200.200.20; base_port = 4567; cert.log_conflicts = no; debug = no; evs.inactive_check_period = PT10S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M; evs.join_retrans_period = PT1S; evs.keepalive_period = PT3S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT30S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /mnt/data/geo/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /mnt/data/geo//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.version = 0; pc.wait_prim = true; pc.wait_prim_tim
140910 13:59:41 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
140910 13:59:41 [Note] WSREP: wsrep_sst_grab()
140910 13:59:41 [Note] WSREP: Start replication
140910 13:59:41 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
140910 13:59:41 [Note] WSREP: protonet asio version 0
140910 13:59:41 [Note] WSREP: backend: asio
140910 13:59:41 [Note] WSREP: GMCast version 0
140910 13:59:41 [Note] WSREP: (b6134ee2, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
140910 13:59:41 [Note] WSREP: (b6134ee2, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
140910 13:59:41 [Note] WSREP: EVS version 0
140910 13:59:41 [Note] WSREP: PC version 0
140910 13:59:41 [Note] WSREP: gcomm: connecting to group 'Geotest', peer '10.200.201.20:,10.200.202.20:,10.200.203.20:'
140910 13:59:41 [Note] WSREP: (b6134ee2, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
140910 13:59:44 [Note] WSREP: declaring 834abb67 at tcp://10.200.202.20:4567 stable
140910 13:59:44 [Note] WSREP: declaring 9d33a649 at tcp://10.200.203.20:4567 stable
140910 13:59:44 [Note] WSREP: declaring aba46be6 at tcp://10.200.201.20:4567 stable
140910 13:59:45 [Note] WSREP: (b6134ee2, 'tcp://0.0.0.0:4567') turning message relay requesting off
140910 13:59:47 [Note] WSREP: Node 834abb67 state prim
140910 13:59:48 [Note] WSREP: gcomm: connected
140910 13:59:48 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
140910 13:59:48 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
140910 13:59:48 [Note] WSREP: Opened channel 'Geotest'
140910 13:59:48 [Note] WSREP: Waiting for SST to complete.
140910 13:59:48 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 3, memb_num = 4
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: sent state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 0 (GeoDBiretest)
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 2 (GeoDBnvatest)
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 1 (GeoDB401test)
140910 13:59:48 [Note] WSREP: STATE EXCHANGE: got state msg: b9b49f81-38f2-11e4-80e8-e6bc300b3e6f from 3 (GeoDB02uw2a)
140910 13:59:48 [Note] WSREP: Quorum results:
        version    = 2,
        component  = PRIMARY,
        conf_id    = 47,
        members    = 3/4 (joined/total),
        act_id     = 74052706,
        last_appl. = -1,
        protocols  = 0/4/2 (gcs/repl/appl),
        group UUID = 793fe80a-b316-11e2-0800-0198ce0bf65f
140910 13:59:48 [Note] WSREP: Flow-control interval: [32, 32]
140910 13:59:48 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 74052706)
140910 13:59:48 [Note] WSREP: State transfer required:
        Group state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706
        Local state: 00000000-0000-0000-0000-000000000000:-1
140910 13:59:48 [Note] WSREP: New cluster view: global state: 793fe80a-b316-11e2-0800-0198ce0bf65f:74052706, view# 48: Primary, number of nodes: 4, my index: 3, protocol version 2
140910 13:59:48 [Note] WSREP: closing client connections for protocol change 3 -> 2
140910 13:59:50 [Warning] WSREP: Gap in state sequence. Need state transfer.
140910 13:59:50 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'joiner' --address '10.200.200.20' --auth 'sst:gtsst' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --parent '9974''
WSREP_SST: [INFO] Streaming with tar (20140910 13:59:50.611)
WSREP_SST: [INFO] Using socat as streamer (20140910 13:59:50.618)
WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | tar xfi - --recursive-unlink -h; RC=( ${PIPESTATUS[@]} ) (20140910 13:59:50.659)
140910 13:59:50 [Note] WSREP: Prepared SST request: xtrabackup|10.200.200.20:4444/xtrabackup_sst
140910 13:59:50 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140910 13:59:50 [Note] WSREP: Assign initial position for certification: 74052706, protocol version: 2
140910 13:59:50 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (793fe80a-b316-11e2-0800-0198ce0bf65f): 1 (Operation not permitted)
         at galera/src/replicator_str.cpp:prepare_for_IST():447. IST will be unavailable.
140910 13:59:51 [Note] WSREP: Node 3 (GeoDB02uw2a) requested state transfer from '*any*'. Selected 0 (GeoDBiretest)(SYNCED) as donor.
140910 13:59:51 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 74052706)
140910 13:59:51 [Note] WSREP: Requesting state transfer: success, donor: 0
tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
WSREP_SST: [ERROR] Error while getting data from donor node:  exit codes: 0 2 (20140910 13:59:51.713)
WSREP_SST: [ERROR] Cleanup after exit with status:32 (20140910 13:59:51.721)
WSREP_SST: [INFO] Removing the sst_in_progress file (20140910 13:59:51.728)
140910 13:59:51 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'joiner' --address '10.200.200.20' --auth 'sst:gtsst' --datadir '/mnt/data/geo/' --defaults-file '/etc/my.cnf' --parent '9974': 32 (Broken pipe)
140910 13:59:51 [ERROR] WSREP: Failed to read uuid:seqno from joiner script.
140910 13:59:51 [ERROR] WSREP: SST failed: 32 (Broken pipe)
140910 13:59:51 [ERROR] Aborting

140910 13:59:53 [Note] WSREP: Closing send monitor...
140910 13:59:53 [Note] WSREP: Closed send monitor.
140910 13:59:53 [Note] WSREP: gcomm: terminating thread
140910 13:59:53 [Note] WSREP: gcomm: joining thread
140910 13:59:53 [Note] WSREP: gcomm: closing backend
140910 13:59:53 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
140910 13:59:53 [Note] WSREP: gcomm: closed
140910 13:59:53 [Note] WSREP: Flow-control interval: [16, 16]
140910 13:59:53 [Note] WSREP: Received NON-PRIMARY.
140910 13:59:53 [Note] WSREP: Shifting JOINER -> OPEN (TO: 74052706)
140910 13:59:53 [Note] WSREP: Received self-leave message.
140910 13:59:53 [Note] WSREP: Flow-control interval: [0, 0]
140910 13:59:53 [Note] WSREP: Received SELF-LEAVE. Closing connection.
140910 13:59:53 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 74052706)
140910 13:59:53 [Note] WSREP: RECV thread exiting 0: Success
140910 13:59:53 [Note] WSREP: recv_thread() joined.
140910 13:59:53 [Note] WSREP: Closing replication queue.
140910 13:59:53 [Note] WSREP: Closing slave action queue.
140910 13:59:53 [Note] WSREP: Service disconnected.
140910 13:59:53 [Note] WSREP: rollbacker thread exiting
140910 13:59:54 [Note] WSREP: Some threads may fail to exit.
140910 13:59:54 [Note] /usr/sbin/mysqld: Shutdown complete