Created
May 26, 2016 16:28
-
-
Save Daviey/07d7a498500a26ea3626512868b52b03 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 160526 15:17:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 15:17:19 [Note] WSREP: wsrep_load(): loading provider library 'none' | |
| 160526 15:17:19 [Note] InnoDB: Using mutexes to ref count buffer pool pages | |
| 160526 15:17:19 [Note] InnoDB: The InnoDB memory heap is disabled | |
| 160526 15:17:19 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 160526 15:17:19 [Note] InnoDB: Memory barrier is not used | |
| 160526 15:17:19 [Note] InnoDB: Compressed tables use zlib 1.2.7 | |
| 160526 15:17:19 [Note] InnoDB: Using Linux native AIO | |
| 160526 15:17:19 [Note] InnoDB: Using CPU crc32 instructions | |
| 160526 15:17:19 [Note] InnoDB: Initializing buffer pool, size = 128.0M | |
| 160526 15:17:19 [Note] InnoDB: Completed initialization of buffer pool | |
| 160526 15:17:19 [Note] InnoDB: The first specified data file ./ibdata1 did not exist: a new database to be created! | |
| 160526 15:17:19 [Note] InnoDB: Setting file ./ibdata1 size to 12 MB | |
| 160526 15:17:19 [Note] InnoDB: Database physically writes the file full: wait... | |
| 160526 15:17:19 [Note] InnoDB: Setting log file ./ib_logfile101 size to 48 MB | |
| 160526 15:17:20 [Note] InnoDB: Setting log file ./ib_logfile1 size to 48 MB | |
| 160526 15:17:20 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 | |
| 160526 15:17:20 [Warning] InnoDB: New log files created, LSN=45781 | |
| 160526 15:17:20 [Note] InnoDB: Doublewrite buffer not found: creating new | |
| 160526 15:17:20 [Note] InnoDB: Doublewrite buffer created | |
| 160526 15:17:20 [Note] InnoDB: 128 rollback segment(s) are active. | |
| 160526 15:17:20 [Warning] InnoDB: Creating foreign key constraint system tables. | |
| 160526 15:17:20 [Note] InnoDB: Foreign key constraint system tables created | |
| 160526 15:17:20 [Note] InnoDB: Creating tablespace and datafile system tables. | |
| 160526 15:17:20 [Note] InnoDB: Tablespace and datafile system tables created. | |
| 160526 15:17:20 [Note] InnoDB: Waiting for purge to start | |
| 160526 15:17:20 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 0 | |
| 160526 15:17:20 [Note] WSREP: Service disconnected. | |
| 160526 15:17:21 [Note] WSREP: Some threads may fail to exit. | |
| 160526 15:17:21 [Note] InnoDB: FTS optimize thread exiting. | |
| 160526 15:17:21 [Note] InnoDB: Starting shutdown... | |
| 160526 15:17:23 [Note] InnoDB: Shutdown completed; log sequence number 1616697 | |
| 160526 15:17:23 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 15:17:23 [Note] WSREP: wsrep_load(): loading provider library 'none' | |
| 160526 15:17:23 [Note] InnoDB: Using mutexes to ref count buffer pool pages | |
| 160526 15:17:23 [Note] InnoDB: The InnoDB memory heap is disabled | |
| 160526 15:17:23 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 160526 15:17:23 [Note] InnoDB: Memory barrier is not used | |
| 160526 15:17:23 [Note] InnoDB: Compressed tables use zlib 1.2.7 | |
| 160526 15:17:23 [Note] InnoDB: Using Linux native AIO | |
| 160526 15:17:23 [Note] InnoDB: Using CPU crc32 instructions | |
| 160526 15:17:23 [Note] InnoDB: Initializing buffer pool, size = 128.0M | |
| 160526 15:17:23 [Note] InnoDB: Completed initialization of buffer pool | |
| 160526 15:17:23 [Note] InnoDB: Highest supported file format is Barracuda. | |
| 160526 15:17:23 [Note] InnoDB: 128 rollback segment(s) are active. | |
| 160526 15:17:23 [Note] InnoDB: Waiting for purge to start | |
| 160526 15:17:23 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 1616697 | |
| 160526 15:17:23 [Note] WSREP: Service disconnected. | |
| 160526 15:17:24 [Note] WSREP: Some threads may fail to exit. | |
| 160526 15:17:24 [Note] InnoDB: FTS optimize thread exiting. | |
| 160526 15:17:24 [Note] InnoDB: Starting shutdown... | |
| 160526 15:17:26 [Note] InnoDB: Shutdown completed; log sequence number 1616707 | |
| 160526 15:17:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 15:17:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.OQB3H6' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| 160526 15:17:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 223 ... | |
| 160526 15:17:29 mysqld_safe WSREP: Recovered position 00000000-0000-0000-0000-000000000000:-1 | |
| 160526 15:17:29 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 257 ... | |
| 160526 15:17:29 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 15:17:29 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 15:17:29 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 15:17:29 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 15:17:29 [Warning] WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat' | |
| 160526 15:17:29 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1 | |
| 160526 15:17:29 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 15:17:29 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:17:29 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 | |
| 160526 15:17:29 [Note] WSREP: wsrep_sst_grab() | |
| 160526 15:17:29 [Note] WSREP: Start replication | |
| 160526 15:17:29 [Note] WSREP: 'wsrep-new-cluster' option used, bootstrapping the cluster | |
| 160526 15:17:29 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 | |
| 160526 15:17:29 [Note] WSREP: protonet asio version 0 | |
| 160526 15:17:29 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 15:17:29 [Note] WSREP: backend: asio | |
| 160526 15:17:29 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 15:17:29 [Note] WSREP: restore pc from disk failed | |
| 160526 15:17:29 [Note] WSREP: GMCast version 0 | |
| 160526 15:17:29 [Note] WSREP: (9445aeec, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 15:17:29 [Note] WSREP: (9445aeec, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 15:17:29 [Note] WSREP: EVS version 0 | |
| 160526 15:17:29 [Note] WSREP: gcomm: bootstrapping new group 'openstack' | |
| 160526 15:17:29 [Note] WSREP: start_prim is enabled, turn off pc_recovery | |
| 160526 15:17:29 [Note] WSREP: Node 9445aeec state prim | |
| 160526 15:17:29 [Note] WSREP: view(view_id(PRIM,9445aeec,1) memb { | |
| 9445aeec,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 15:17:29 [Note] WSREP: save pc into disk | |
| 160526 15:17:29 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.71:4567 | |
| 160526 15:17:29 [Note] WSREP: discarding pending addr proto entry 0x7fa75cc9f2c0 | |
| 160526 15:17:29 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.72:4567 | |
| 160526 15:17:29 [Note] WSREP: discarding pending addr proto entry 0x7fa75cc9f500 | |
| 160526 15:17:29 [Note] WSREP: gcomm: connected | |
| 160526 15:17:29 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 | |
| 160526 15:17:29 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) | |
| 160526 15:17:29 [Note] WSREP: Opened channel 'openstack' | |
| 160526 15:17:29 [Note] WSREP: Waiting for SST to complete. | |
| 160526 15:17:29 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 | |
| 160526 15:17:29 [Note] WSREP: Starting new group from scratch: 9446883f-234c-11e6-8440-966e6fbca58c | |
| 160526 15:17:29 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 94469ae7-234c-11e6-b348-6af1661af7d0 | |
| 160526 15:17:29 [Note] WSREP: STATE EXCHANGE: sent state msg: 94469ae7-234c-11e6-b348-6af1661af7d0 | |
| 160526 15:17:29 [Note] WSREP: STATE EXCHANGE: got state msg: 94469ae7-234c-11e6-b348-6af1661af7d0 from 0 (ampvc-dd0070) | |
| 160526 15:17:29 [Note] WSREP: Quorum results: | |
| version = 3, | |
| component = PRIMARY, | |
| conf_id = 0, | |
| members = 1/1 (joined/total), | |
| act_id = 0, | |
| last_appl. = -1, | |
| protocols = 0/7/3 (gcs/repl/appl), | |
| group UUID = 9446883f-234c-11e6-8440-966e6fbca58c | |
| 160526 15:17:29 [Note] WSREP: Flow-control interval: [16, 16] | |
| 160526 15:17:29 [Note] WSREP: Restored state OPEN -> JOINED (0) | |
| 160526 15:17:29 [Note] WSREP: Member 0.0 (ampvc-dd0070) synced with group. | |
| 160526 15:17:29 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0) | |
| 160526 15:17:29 [Note] WSREP: New cluster view: global state: 9446883f-234c-11e6-8440-966e6fbca58c:0, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3 | |
| 160526 15:17:29 [Note] WSREP: SST complete, seqno: 0 | |
| 160526 15:17:29 [Note] InnoDB: Using mutexes to ref count buffer pool pages | |
| 160526 15:17:29 [Note] InnoDB: The InnoDB memory heap is disabled | |
| 160526 15:17:29 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 160526 15:17:29 [Note] InnoDB: Memory barrier is not used | |
| 160526 15:17:29 [Note] InnoDB: Compressed tables use zlib 1.2.7 | |
| 160526 15:17:29 [Note] InnoDB: Using Linux native AIO | |
| 160526 15:17:29 [Note] InnoDB: Using CPU crc32 instructions | |
| 160526 15:17:29 [Note] InnoDB: Initializing buffer pool, size = 128.0M | |
| 160526 15:17:29 [Note] InnoDB: Completed initialization of buffer pool | |
| 160526 15:17:29 [Note] InnoDB: Highest supported file format is Barracuda. | |
| 160526 15:17:29 [Note] InnoDB: 128 rollback segment(s) are active. | |
| 160526 15:17:29 [Note] InnoDB: Waiting for purge to start | |
| 160526 15:17:29 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 1616885 | |
| 160526 15:17:29 [Note] Plugin 'FEEDBACK' is disabled. | |
| 160526 15:17:29 [Note] Server socket created on IP: '10.25.201.70'. | |
| 160526 15:17:29 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:17:29 [Note] WSREP: REPL Protocols: 7 (3, 2) | |
| 160526 15:17:29 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:17:29 [Note] /usr/sbin/mysqld: ready for connections. | |
| Version: '10.0.24-MariaDB-wsrep' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server, wsrep_25.13.raf7f02e | |
| 160526 15:17:29 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3 | |
| 160526 15:17:29 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:17:29 [Note] WSREP: Synchronized with group, ready for connections | |
| 160526 15:17:29 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:17:29 [Note] /usr/sbin/mysqld: Normal shutdown | |
| 160526 15:17:29 [Note] WSREP: Stop replication | |
| 160526 15:17:29 [Note] WSREP: Closing send monitor... | |
| 160526 15:17:29 [Note] WSREP: Closed send monitor. | |
| 160526 15:17:29 [Note] WSREP: gcomm: terminating thread | |
| 160526 15:17:29 [Note] WSREP: gcomm: joining thread | |
| 160526 15:17:29 [Note] WSREP: gcomm: closing backend | |
| 160526 15:17:29 [Note] WSREP: view((empty)) | |
| 160526 15:17:29 [Note] WSREP: Received self-leave message. | |
| 160526 15:17:29 [Note] WSREP: gcomm: closed | |
| 160526 15:17:29 [Note] WSREP: Flow-control interval: [0, 0] | |
| 160526 15:17:29 [Note] WSREP: Received SELF-LEAVE. Closing connection. | |
| 160526 15:17:29 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 5) | |
| 160526 15:17:29 [Note] WSREP: RECV thread exiting 0: Success | |
| 160526 15:17:29 [Note] WSREP: recv_thread() joined. | |
| 160526 15:17:29 [Note] WSREP: Closing replication queue. | |
| 160526 15:17:29 [Note] WSREP: Closing slave action queue. | |
| 160526 15:17:29 [Note] WSREP: New cluster view: global state: 9446883f-234c-11e6-8440-966e6fbca58c:5, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 3 | |
| 160526 15:17:29 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:17:29 [Note] WSREP: applier thread exiting (code:0) | |
| 160526 15:17:29 [Note] WSREP: applier thread exiting (code:6) | |
| 160526 15:17:29 [Note] WSREP: applier thread exiting (code:6) | |
| 160526 15:17:29 [Note] WSREP: applier thread exiting (code:6) | |
| 160526 15:17:31 [Note] WSREP: rollbacker thread exiting | |
| 160526 15:17:31 [Note] Event Scheduler: Purging the queue. 0 events | |
| 160526 15:17:31 [Note] WSREP: dtor state: CLOSED | |
| 160526 15:17:31 [Note] WSREP: mon: entered 5 oooe fraction 0 oool fraction 0 | |
| 160526 15:17:31 [Note] WSREP: mon: entered 5 oooe fraction 0 oool fraction 0 | |
| 160526 15:17:31 [Note] WSREP: mon: entered 8 oooe fraction 0 oool fraction 0 | |
| 160526 15:17:31 [Note] WSREP: cert index usage at exit 0 | |
| 160526 15:17:31 [Note] WSREP: cert trx map usage at exit 5 | |
| 160526 15:17:31 [Note] WSREP: deps set usage at exit 0 | |
| 160526 15:17:31 [Note] WSREP: avg deps dist 1 | |
| 160526 15:17:31 [Note] WSREP: avg cert interval 0 | |
| 160526 15:17:31 [Note] WSREP: cert index size 2 | |
| 160526 15:17:31 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:17:31 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 | |
| 160526 15:17:31 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 5, in use: 0, in pool: 5 | |
| 160526 15:17:31 [Note] WSREP: MemPool(SlaveTrxHandle): hit ratio: 0, misses: 0, in use: 0, in pool: 0 | |
| 160526 15:17:31 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: 5) | |
| 160526 15:17:31 [Note] WSREP: Flushing memory map to disk... | |
| 160526 15:17:31 [Note] InnoDB: FTS optimize thread exiting. | |
| 160526 15:17:31 [Note] InnoDB: Starting shutdown... | |
| 160526 15:17:33 [Note] InnoDB: Shutdown completed; log sequence number 1617851 | |
| 160526 15:17:33 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 15:17:33 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 15:17:38 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 15:17:38 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.ooI3cg' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 15:17:38 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 151 ... | |
| 160526 15:17:40 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:5 | |
| 160526 15:17:40 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 183 ... | |
| 160526 15:17:40 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 15:17:40 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 15:17:40 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 15:17:40 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 15:17:40 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:5 | |
| 160526 15:17:40 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 15:17:40 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:17:40 [Note] WSREP: Assign initial position for certification: 5, protocol version: -1 | |
| 160526 15:17:40 [Note] WSREP: wsrep_sst_grab() | |
| 160526 15:17:40 [Note] WSREP: Start replication | |
| 160526 15:17:40 [Note] WSREP: 'wsrep-new-cluster' option used, bootstrapping the cluster | |
| 160526 15:17:40 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:5 | |
| 160526 15:17:40 [Note] WSREP: protonet asio version 0 | |
| 160526 15:17:40 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 15:17:40 [Note] WSREP: backend: asio | |
| 160526 15:17:40 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 15:17:40 [Note] WSREP: restore pc from disk failed | |
| 160526 15:17:40 [Note] WSREP: GMCast version 0 | |
| 160526 15:17:40 [Note] WSREP: (9b1a3a8d, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 15:17:40 [Note] WSREP: (9b1a3a8d, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 15:17:40 [Note] WSREP: EVS version 0 | |
| 160526 15:17:40 [Note] WSREP: gcomm: bootstrapping new group 'openstack' | |
| 160526 15:17:40 [Note] WSREP: start_prim is enabled, turn off pc_recovery | |
| 160526 15:17:40 [Note] WSREP: Node 9b1a3a8d state prim | |
| 160526 15:17:40 [Note] WSREP: view(view_id(PRIM,9b1a3a8d,1) memb { | |
| 9b1a3a8d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 15:17:40 [Note] WSREP: save pc into disk | |
| 160526 15:17:40 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.71:4567 | |
| 160526 15:17:40 [Note] WSREP: discarding pending addr proto entry 0x7f506509f2c0 | |
| 160526 15:17:40 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.72:4567 | |
| 160526 15:17:40 [Note] WSREP: discarding pending addr proto entry 0x7f506509f500 | |
| 160526 15:17:40 [Note] WSREP: gcomm: connected | |
| 160526 15:17:40 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 | |
| 160526 15:17:40 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) | |
| 160526 15:17:40 [Note] WSREP: Opened channel 'openstack' | |
| 160526 15:17:40 [Note] WSREP: Waiting for SST to complete. | |
| 160526 15:17:40 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 | |
| 160526 15:17:40 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 9b1af61d-234c-11e6-982f-67f2adcd1f10 | |
| 160526 15:17:40 [Note] WSREP: STATE EXCHANGE: sent state msg: 9b1af61d-234c-11e6-982f-67f2adcd1f10 | |
| 160526 15:17:40 [Note] WSREP: STATE EXCHANGE: got state msg: 9b1af61d-234c-11e6-982f-67f2adcd1f10 from 0 (ampvc-dd0070) | |
| 160526 15:17:40 [Note] WSREP: Quorum results: | |
| version = 3, | |
| component = PRIMARY, | |
| conf_id = 0, | |
| members = 1/1 (joined/total), | |
| act_id = 5, | |
| last_appl. = -1, | |
| protocols = 0/7/3 (gcs/repl/appl), | |
| group UUID = 9446883f-234c-11e6-8440-966e6fbca58c | |
| 160526 15:17:40 [Note] WSREP: Flow-control interval: [16, 16] | |
| 160526 15:17:40 [Note] WSREP: Restored state OPEN -> JOINED (5) | |
| 160526 15:17:40 [Note] WSREP: Member 0.0 (ampvc-dd0070) synced with group. | |
| 160526 15:17:40 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5) | |
| 160526 15:17:40 [Note] WSREP: New cluster view: global state: 9446883f-234c-11e6-8440-966e6fbca58c:5, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3 | |
| 160526 15:17:40 [Note] WSREP: SST complete, seqno: 5 | |
| 160526 15:17:40 [Note] InnoDB: Using mutexes to ref count buffer pool pages | |
| 160526 15:17:40 [Note] InnoDB: The InnoDB memory heap is disabled | |
| 160526 15:17:40 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 160526 15:17:40 [Note] InnoDB: Memory barrier is not used | |
| 160526 15:17:40 [Note] InnoDB: Compressed tables use zlib 1.2.7 | |
| 160526 15:17:40 [Note] InnoDB: Using Linux native AIO | |
| 160526 15:17:40 [Note] InnoDB: Using CPU crc32 instructions | |
| 160526 15:17:40 [Note] InnoDB: Initializing buffer pool, size = 128.0M | |
| 160526 15:17:40 [Note] InnoDB: Completed initialization of buffer pool | |
| 160526 15:17:40 [Note] InnoDB: Highest supported file format is Barracuda. | |
| 160526 15:17:40 [Note] InnoDB: 128 rollback segment(s) are active. | |
| 160526 15:17:40 [Note] InnoDB: Waiting for purge to start | |
| 160526 15:17:40 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 1617861 | |
| 160526 15:17:40 [Note] Plugin 'FEEDBACK' is disabled. | |
| 160526 15:17:41 [Note] Server socket created on IP: '10.25.201.70'. | |
| 160526 15:17:41 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:17:41 [Note] WSREP: REPL Protocols: 7 (3, 2) | |
| 160526 15:17:41 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:17:41 [Note] WSREP: Assign initial position for certification: 5, protocol version: 3 | |
| 160526 15:17:41 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:17:41 [Note] WSREP: Synchronized with group, ready for connections | |
| 160526 15:17:41 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:17:41 [Note] /usr/sbin/mysqld: ready for connections. | |
| Version: '10.0.24-MariaDB-wsrep' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server, wsrep_25.13.raf7f02e | |
| 160526 15:19:30 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 15:19:30 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.JCMSKp' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 15:19:30 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 147 ... | |
| 160526 15:19:32 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 15:19:32 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 180 ... | |
| 160526 15:19:32 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 15:19:32 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 15:19:32 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 15:19:32 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 15:19:32 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 15:19:32 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 15:19:32 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:19:32 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 15:19:32 [Note] WSREP: wsrep_sst_grab() | |
| 160526 15:19:32 [Note] WSREP: Start replication | |
| 160526 15:19:32 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 15:19:32 [Note] WSREP: protonet asio version 0 | |
| 160526 15:19:32 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 15:19:32 [Note] WSREP: backend: asio | |
| 160526 15:19:32 [Note] WSREP: restore pc from disk successfully | |
| 160526 15:19:32 [Note] WSREP: GMCast version 0 | |
| 160526 15:19:32 [Note] WSREP: (9b1a3a8d, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 15:19:32 [Note] WSREP: (9b1a3a8d, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 15:19:32 [Note] WSREP: EVS version 0 | |
| 160526 15:19:32 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 15:19:35 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 15:19:35 [Note] WSREP: view(view_id(NON_PRIM,9b1a3a8d,3) memb { | |
| 9b1a3a8d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 15:19:35 [Note] WSREP: promote to primary component | |
| 160526 15:19:35 [Note] WSREP: view(view_id(PRIM,9b1a3a8d,3) memb { | |
| 9b1a3a8d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 15:19:35 [Note] WSREP: save pc into disk | |
| 160526 15:19:35 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.71:4567 | |
| 160526 15:19:35 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.72:4567 | |
| 160526 15:19:35 [Note] WSREP: clear restored view | |
| 160526 15:19:35 [Note] WSREP: gcomm: connected | |
| 160526 15:19:35 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 | |
| 160526 15:19:35 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) | |
| 160526 15:19:35 [Note] WSREP: Opened channel 'openstack' | |
| 160526 15:19:35 [Note] WSREP: Waiting for SST to complete. | |
| 160526 15:19:35 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 | |
| 160526 15:19:35 [Note] WSREP: Flow-control interval: [16, 16] | |
| 160526 15:19:35 [Note] WSREP: Received NON-PRIMARY. | |
| 160526 15:19:35 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = yes, my_idx = 0, memb_num = 1 | |
| 160526 15:19:35 [Note] WSREP: New cluster view: global state: 9446883f-234c-11e6-8440-966e6fbca58c:6, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version -1 | |
| 160526 15:19:35 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:19:35 [Note] WSREP: STATE_EXCHANGE: sent state UUID: dfb151f2-234c-11e6-8e03-8aa533d117c5 | |
| 160526 15:19:35 [Note] WSREP: STATE EXCHANGE: sent state msg: dfb151f2-234c-11e6-8e03-8aa533d117c5 | |
| 160526 15:19:35 [Note] WSREP: STATE EXCHANGE: got state msg: dfb151f2-234c-11e6-8e03-8aa533d117c5 from 0 (ampvc-dd0070) | |
| 160526 15:19:35 [Warning] WSREP: Quorum: No node with complete state: | |
| Version : 3 | |
| Flags : 0x5 | |
| Protocols : 0 / 7 / 3 | |
| State : NON-PRIMARY | |
| Prim state : NON-PRIMARY | |
| Prim UUID : 00000000-0000-0000-0000-000000000000 | |
| Prim seqno : -1 | |
| First seqno : -1 | |
| Last seqno : 6 | |
| Prim JOINED : 0 | |
| State UUID : dfb151f2-234c-11e6-8e03-8aa533d117c5 | |
| Group UUID : 9446883f-234c-11e6-8440-966e6fbca58c | |
| Name : 'ampvc-dd0070' | |
| Incoming addr: '10.25.201.70:3306' | |
| 160526 15:19:35 [Warning] WSREP: No re-merged primary component found. | |
| 160526 15:19:35 [Note] WSREP: Bootstrapped primary 00000000-0000-0000-0000-000000000000 found: 1. | |
| 160526 15:19:35 [Note] WSREP: Quorum results: | |
| version = 3, | |
| component = PRIMARY, | |
| conf_id = -1, | |
| members = 1/1 (joined/total), | |
| act_id = 6, | |
| last_appl. = -1, | |
| protocols = 0/7/3 (gcs/repl/appl), | |
| group UUID = 9446883f-234c-11e6-8440-966e6fbca58c | |
| 160526 15:19:35 [Note] WSREP: Flow-control interval: [16, 16] | |
| 160526 15:19:35 [Note] WSREP: Restored state OPEN -> JOINED (6) | |
| 160526 15:19:35 [Note] WSREP: Member 0.0 (ampvc-dd0070) synced with group. | |
| 160526 15:19:35 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 6) | |
| 160526 15:19:35 [Note] WSREP: New cluster view: global state: 9446883f-234c-11e6-8440-966e6fbca58c:6, view# 0: Primary, number of nodes: 1, my index: 0, protocol version 3 | |
| 160526 15:19:35 [Note] WSREP: SST complete, seqno: 6 | |
| 160526 15:19:35 [Note] InnoDB: Using mutexes to ref count buffer pool pages | |
| 160526 15:19:35 [Note] InnoDB: The InnoDB memory heap is disabled | |
| 160526 15:19:35 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 160526 15:19:35 [Note] InnoDB: Memory barrier is not used | |
| 160526 15:19:35 [Note] InnoDB: Compressed tables use zlib 1.2.7 | |
| 160526 15:19:35 [Note] InnoDB: Using Linux native AIO | |
| 160526 15:19:35 [Note] InnoDB: Using CPU crc32 instructions | |
| 160526 15:19:35 [Note] InnoDB: Initializing buffer pool, size = 128.0M | |
| 160526 15:19:35 [Note] InnoDB: Completed initialization of buffer pool | |
| 160526 15:19:35 [Note] InnoDB: Highest supported file format is Barracuda. | |
| 160526 15:19:35 [Note] InnoDB: 128 rollback segment(s) are active. | |
| 160526 15:19:35 [Note] InnoDB: Waiting for purge to start | |
| 160526 15:19:36 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 1618205 | |
| 160526 15:19:36 [Note] Plugin 'FEEDBACK' is disabled. | |
| 160526 15:19:36 [Note] Server socket created on IP: '10.25.201.70'. | |
| 160526 15:19:36 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired | |
| 160526 15:19:36 [Warning] Checking table: './mysql/user' | |
| 160526 15:19:36 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly | |
| 160526 15:19:36 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:19:36 [Note] WSREP: REPL Protocols: 7 (3, 2) | |
| 160526 15:19:36 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:19:36 [Note] WSREP: Assign initial position for certification: 6, protocol version: 3 | |
| 160526 15:19:36 [Note] WSREP: Service thread queue flushed. | |
| 160526 15:19:36 [Note] WSREP: Synchronized with group, ready for connections | |
| 160526 15:19:36 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 15:19:36 [Note] /usr/sbin/mysqld: ready for connections. | |
| Version: '10.0.24-MariaDB-wsrep' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server, wsrep_25.13.raf7f02e | |
| 160526 15:19:36 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50344S), skipping check | |
| 160526 16:12:49 [Warning] WSREP: last inactive check more than PT1.5S ago (PT1.93691S), skipping check | |
| 160526 16:13:34 [Note] /usr/sbin/mysqld: Normal shutdown | |
| 160526 16:13:34 [Note] WSREP: Stop replication | |
| 160526 16:13:34 [Note] WSREP: Closing send monitor... | |
| 160526 16:13:34 [Note] WSREP: Closed send monitor. | |
| 160526 16:13:34 [Note] WSREP: gcomm: terminating thread | |
| 160526 16:13:34 [Note] WSREP: gcomm: joining thread | |
| 160526 16:13:34 [Note] WSREP: gcomm: closing backend | |
| 160526 16:13:34 [Note] WSREP: view((empty)) | |
| 160526 16:13:34 [Note] WSREP: gcomm: closed | |
| 160526 16:13:34 [Note] WSREP: Received self-leave message. | |
| 160526 16:13:34 [Note] WSREP: Flow-control interval: [0, 0] | |
| 160526 16:13:34 [Note] WSREP: Received SELF-LEAVE. Closing connection. | |
| 160526 16:13:34 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 6) | |
| 160526 16:13:34 [Note] WSREP: RECV thread exiting 0: Success | |
| 160526 16:13:34 [Note] WSREP: New cluster view: global state: 9446883f-234c-11e6-8440-966e6fbca58c:6, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 3 | |
| 160526 16:13:34 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 16:13:34 [Note] WSREP: applier thread exiting (code:0) | |
| 160526 16:13:34 [Note] WSREP: recv_thread() joined. | |
| 160526 16:13:34 [Note] WSREP: Closing replication queue. | |
| 160526 16:13:34 [Note] WSREP: Closing slave action queue. | |
| 160526 16:13:34 [Note] WSREP: applier thread exiting (code:6) | |
| 160526 16:13:34 [Note] WSREP: applier thread exiting (code:6) | |
| 160526 16:13:34 [Note] WSREP: applier thread exiting (code:6) | |
| 160526 16:13:36 [Note] WSREP: rollbacker thread exiting | |
| 160526 16:13:36 [Note] Event Scheduler: Purging the queue. 0 events | |
| 160526 16:13:36 [Note] WSREP: dtor state: CLOSED | |
| 160526 16:13:36 [Note] WSREP: apply mon: entered 0 | |
| 160526 16:13:36 [Note] WSREP: apply mon: entered 0 | |
| 160526 16:13:36 [Note] WSREP: mon: entered 4 oooe fraction 0 oool fraction 0 | |
| 160526 16:13:36 [Note] WSREP: cert index usage at exit 0 | |
| 160526 16:13:36 [Note] WSREP: cert trx map usage at exit 0 | |
| 160526 16:13:36 [Note] WSREP: deps set usage at exit 0 | |
| 160526 16:13:36 [Note] WSREP: avg deps dist 0 | |
| 160526 16:13:36 [Note] WSREP: avg cert interval 0 | |
| 160526 16:13:36 [Note] WSREP: cert index size 0 | |
| 160526 16:13:36 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:13:36 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 | |
| 160526 16:13:36 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 0, in use: 0, in pool: 0 | |
| 160526 16:13:36 [Note] WSREP: MemPool(SlaveTrxHandle): hit ratio: 0, misses: 0, in use: 0, in pool: 0 | |
| 160526 16:13:36 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: 6) | |
| 160526 16:13:36 [Note] WSREP: Flushing memory map to disk... | |
| 160526 16:13:36 [Note] InnoDB: FTS optimize thread exiting. | |
| 160526 16:13:36 [Note] InnoDB: Starting shutdown... | |
| 160526 16:13:37 [Note] InnoDB: Shutdown completed; log sequence number 1618369 | |
| 160526 16:13:37 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:13:37 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:14:15 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:14:15 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.0KrY7x' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:14:15 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:14:27 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:14:27 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:14:27 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:14:27 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:14:27 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:14:27 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:14:27 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:14:27 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:14:27 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:14:27 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:14:27 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:14:27 [Note] WSREP: Start replication | |
| 160526 16:14:27 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:14:27 [Note] WSREP: protonet asio version 0 | |
| 160526 16:14:27 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:14:27 [Note] WSREP: backend: asio | |
| 160526 16:14:27 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:14:27 [Note] WSREP: restore pc from disk failed | |
| 160526 16:14:27 [Note] WSREP: GMCast version 0 | |
| 160526 16:14:27 [Note] WSREP: (89c381ca, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:14:27 [Note] WSREP: (89c381ca, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:14:27 [Note] WSREP: EVS version 0 | |
| 160526 16:14:27 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:14:31 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:14:31 [Note] WSREP: view(view_id(NON_PRIM,89c381ca,1) memb { | |
| 89c381ca,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:14:31 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.95354S), skipping check | |
| 160526 16:14:48 [Warning] WSREP: last inactive check more than PT1.5S ago (PT1.83053S), skipping check | |
| 160526 16:15:01 [Note] WSREP: view((empty)) | |
| 160526 16:15:01 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:15:01 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:15:01 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:15:01 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:15:01 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:15:01 [ERROR] Aborting | |
| 160526 16:15:01 [Note] WSREP: Service disconnected. | |
| 160526 16:15:02 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:15:02 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:15:02 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:15:02 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:15:02 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.SmjDcj' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:15:02 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:15:05 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:15:05 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:15:05 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:15:05 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:15:05 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:15:05 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:15:05 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:15:05 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:15:05 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:15:05 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:15:05 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:15:05 [Note] WSREP: Start replication | |
| 160526 16:15:05 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:15:05 [Note] WSREP: protonet asio version 0 | |
| 160526 16:15:05 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:15:05 [Note] WSREP: backend: asio | |
| 160526 16:15:05 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:15:05 [Note] WSREP: restore pc from disk failed | |
| 160526 16:15:05 [Note] WSREP: GMCast version 0 | |
| 160526 16:15:05 [Note] WSREP: (a03b1ba8, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:15:05 [Note] WSREP: (a03b1ba8, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:15:05 [Note] WSREP: EVS version 0 | |
| 160526 16:15:05 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:15:08 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:15:08 [Note] WSREP: view(view_id(NON_PRIM,a03b1ba8,1) memb { | |
| a03b1ba8,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:15:08 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50283S), skipping check | |
| 160526 16:15:38 [Note] WSREP: view((empty)) | |
| 160526 16:15:38 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:15:38 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:15:38 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:15:38 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:15:38 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:15:38 [ERROR] Aborting | |
| 160526 16:15:38 [Note] WSREP: Service disconnected. | |
| 160526 16:15:39 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:15:39 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:15:39 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:15:39 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:15:39 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.dZFz8m' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:15:39 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:15:42 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:15:42 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:15:42 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:15:42 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:15:42 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:15:42 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:15:42 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:15:42 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:15:42 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:15:42 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:15:42 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:15:42 [Note] WSREP: Start replication | |
| 160526 16:15:42 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:15:42 [Note] WSREP: protonet asio version 0 | |
| 160526 16:15:42 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:15:42 [Note] WSREP: backend: asio | |
| 160526 16:15:42 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:15:42 [Note] WSREP: restore pc from disk failed | |
| 160526 16:15:42 [Note] WSREP: GMCast version 0 | |
| 160526 16:15:42 [Note] WSREP: (b63e336a, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:15:42 [Note] WSREP: (b63e336a, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:15:42 [Note] WSREP: EVS version 0 | |
| 160526 16:15:42 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:15:45 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:15:45 [Note] WSREP: view(view_id(NON_PRIM,b63e336a,1) memb { | |
| b63e336a,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:15:45 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50319S), skipping check | |
| 160526 16:16:15 [Note] WSREP: view((empty)) | |
| 160526 16:16:15 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:16:15 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:16:15 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:16:15 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:16:15 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:16:15 [ERROR] Aborting | |
| 160526 16:16:15 [Note] WSREP: Service disconnected. | |
| 160526 16:16:16 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:16:16 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:16:16 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:16:16 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:16:16 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.k6M8WU' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:16:16 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:16:19 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:16:19 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:16:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:16:19 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:16:19 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:16:19 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:16:19 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:16:19 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:16:19 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:16:19 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:16:19 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:16:19 [Note] WSREP: Start replication | |
| 160526 16:16:19 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:16:19 [Note] WSREP: protonet asio version 0 | |
| 160526 16:16:19 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:16:19 [Note] WSREP: backend: asio | |
| 160526 16:16:19 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:16:19 [Note] WSREP: restore pc from disk failed | |
| 160526 16:16:19 [Note] WSREP: GMCast version 0 | |
| 160526 16:16:19 [Note] WSREP: (cc3e8a87, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:16:19 [Note] WSREP: (cc3e8a87, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:16:19 [Note] WSREP: EVS version 0 | |
| 160526 16:16:19 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:16:22 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:16:22 [Note] WSREP: view(view_id(NON_PRIM,cc3e8a87,1) memb { | |
| cc3e8a87,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:16:22 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50313S), skipping check | |
| 160526 16:16:52 [Note] WSREP: view((empty)) | |
| 160526 16:16:52 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:16:52 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:16:52 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:16:52 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:16:52 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:16:52 [ERROR] Aborting | |
| 160526 16:16:52 [Note] WSREP: Service disconnected. | |
| 160526 16:16:53 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:16:53 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:16:53 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:16:53 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:16:53 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.8Zawx9' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:16:53 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:16:56 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:16:56 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:16:56 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:16:56 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:16:56 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:16:56 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:16:56 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:16:56 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:16:56 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:16:56 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:16:56 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:16:56 [Note] WSREP: Start replication | |
| 160526 16:16:56 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:16:56 [Note] WSREP: protonet asio version 0 | |
| 160526 16:16:56 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:16:56 [Note] WSREP: backend: asio | |
| 160526 16:16:56 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:16:56 [Note] WSREP: restore pc from disk failed | |
| 160526 16:16:56 [Note] WSREP: GMCast version 0 | |
| 160526 16:16:56 [Note] WSREP: (e23f2680, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:16:56 [Note] WSREP: (e23f2680, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:16:56 [Note] WSREP: EVS version 0 | |
| 160526 16:16:56 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:16:59 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:16:59 [Note] WSREP: view(view_id(NON_PRIM,e23f2680,1) memb { | |
| e23f2680,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:16:59 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50212S), skipping check | |
| 160526 16:17:29 [Note] WSREP: view((empty)) | |
| 160526 16:17:29 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:17:29 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:17:29 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:17:29 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:17:29 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:17:29 [ERROR] Aborting | |
| 160526 16:17:29 [Note] WSREP: Service disconnected. | |
| 160526 16:17:30 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:17:30 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:17:30 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:17:30 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:17:30 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.qKMvQs' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:17:30 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:17:32 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:17:32 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:17:32 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:17:32 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:17:33 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:17:33 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:17:33 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:17:33 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:17:33 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:17:33 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:17:33 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:17:33 [Note] WSREP: Start replication | |
| 160526 16:17:33 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:17:33 [Note] WSREP: protonet asio version 0 | |
| 160526 16:17:33 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:17:33 [Note] WSREP: backend: asio | |
| 160526 16:17:33 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:17:33 [Note] WSREP: restore pc from disk failed | |
| 160526 16:17:33 [Note] WSREP: GMCast version 0 | |
| 160526 16:17:33 [Note] WSREP: (f83a0495, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:17:33 [Note] WSREP: (f83a0495, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:17:33 [Note] WSREP: EVS version 0 | |
| 160526 16:17:33 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:17:36 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:17:36 [Note] WSREP: view(view_id(NON_PRIM,f83a0495,1) memb { | |
| f83a0495,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:17:36 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50238S), skipping check | |
| 160526 16:18:06 [Note] WSREP: view((empty)) | |
| 160526 16:18:06 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:18:06 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:18:06 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:18:06 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:18:06 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:18:06 [ERROR] Aborting | |
| 160526 16:18:06 [Note] WSREP: Service disconnected. | |
| 160526 16:18:07 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:18:07 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:18:07 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:18:07 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:18:07 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.S6IzWQ' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:18:07 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:18:09 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:18:09 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:18:09 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:18:09 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:18:09 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:18:09 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:18:09 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:18:09 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:18:09 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:18:09 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:18:09 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:18:09 [Note] WSREP: Start replication | |
| 160526 16:18:09 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:18:09 [Note] WSREP: protonet asio version 0 | |
| 160526 16:18:09 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:18:09 [Note] WSREP: backend: asio | |
| 160526 16:18:09 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:18:09 [Note] WSREP: restore pc from disk failed | |
| 160526 16:18:09 [Note] WSREP: GMCast version 0 | |
| 160526 16:18:09 [Note] WSREP: (0e3a7a05, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:18:09 [Note] WSREP: (0e3a7a05, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:18:09 [Note] WSREP: EVS version 0 | |
| 160526 16:18:09 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:18:12 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:18:12 [Note] WSREP: view(view_id(NON_PRIM,0e3a7a05,1) memb { | |
| 0e3a7a05,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:18:13 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50298S), skipping check | |
| 160526 16:18:42 [Note] WSREP: view((empty)) | |
| 160526 16:18:42 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:18:42 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:18:42 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:18:42 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:18:42 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:18:42 [ERROR] Aborting | |
| 160526 16:18:42 [Note] WSREP: Service disconnected. | |
| 160526 16:18:43 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:18:43 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:18:43 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:18:44 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:18:44 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.Tqb8xQ' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:18:44 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:18:46 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:18:46 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:18:46 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:18:46 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:18:46 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:18:46 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:18:46 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:18:46 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:18:46 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:18:46 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:18:46 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:18:46 [Note] WSREP: Start replication | |
| 160526 16:18:46 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:18:46 [Note] WSREP: protonet asio version 0 | |
| 160526 16:18:46 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:18:46 [Note] WSREP: backend: asio | |
| 160526 16:18:46 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:18:46 [Note] WSREP: restore pc from disk failed | |
| 160526 16:18:46 [Note] WSREP: GMCast version 0 | |
| 160526 16:18:46 [Note] WSREP: (243bea39, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:18:46 [Note] WSREP: (243bea39, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:18:46 [Note] WSREP: EVS version 0 | |
| 160526 16:18:46 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:18:49 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:18:49 [Note] WSREP: view(view_id(NON_PRIM,243bea39,1) memb { | |
| 243bea39,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:18:50 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50315S), skipping check | |
| 160526 16:19:19 [Note] WSREP: view((empty)) | |
| 160526 16:19:19 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:19:19 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:19:19 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:19:19 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:19:19 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:19:19 [ERROR] Aborting | |
| 160526 16:19:19 [Note] WSREP: Service disconnected. | |
| 160526 16:19:20 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:19:20 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:19:20 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:19:21 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:19:21 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.M51QBd' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:19:21 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:19:23 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:19:23 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:19:23 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:19:23 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:19:23 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:19:23 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:19:23 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:19:23 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:19:23 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:19:23 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:19:23 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:19:23 [Note] WSREP: Start replication | |
| 160526 16:19:23 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:19:23 [Note] WSREP: protonet asio version 0 | |
| 160526 16:19:23 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:19:23 [Note] WSREP: backend: asio | |
| 160526 16:19:23 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:19:23 [Note] WSREP: restore pc from disk failed | |
| 160526 16:19:23 [Note] WSREP: GMCast version 0 | |
| 160526 16:19:23 [Note] WSREP: (3a40b5c2, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:19:23 [Note] WSREP: (3a40b5c2, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:19:23 [Note] WSREP: EVS version 0 | |
| 160526 16:19:23 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:19:26 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:19:26 [Note] WSREP: view(view_id(NON_PRIM,3a40b5c2,1) memb { | |
| 3a40b5c2,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:19:27 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50341S), skipping check | |
| 160526 16:19:56 [Note] WSREP: view((empty)) | |
| 160526 16:19:56 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:19:56 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:19:56 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:19:56 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:19:56 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:19:56 [ERROR] Aborting | |
| 160526 16:19:56 [Note] WSREP: Service disconnected. | |
| 160526 16:19:57 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:19:57 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:19:57 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:19:58 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:19:58 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.eRpE4W' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:19:58 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:20:00 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:20:00 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:20:00 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:20:00 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:20:00 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:20:00 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:20:00 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:20:00 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:20:00 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:20:00 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:20:00 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:20:00 [Note] WSREP: Start replication | |
| 160526 16:20:00 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:20:00 [Note] WSREP: protonet asio version 0 | |
| 160526 16:20:00 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:20:00 [Note] WSREP: backend: asio | |
| 160526 16:20:00 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:20:00 [Note] WSREP: restore pc from disk failed | |
| 160526 16:20:00 [Note] WSREP: GMCast version 0 | |
| 160526 16:20:00 [Note] WSREP: (5047cb1a, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:20:00 [Note] WSREP: (5047cb1a, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:20:00 [Note] WSREP: EVS version 0 | |
| 160526 16:20:00 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:20:03 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:20:03 [Note] WSREP: view(view_id(NON_PRIM,5047cb1a,1) memb { | |
| 5047cb1a,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:20:04 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5032S), skipping check | |
| 160526 16:20:33 [Note] WSREP: view((empty)) | |
| 160526 16:20:33 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:20:33 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:20:33 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:20:33 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:20:33 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:20:33 [ERROR] Aborting | |
| 160526 16:20:33 [Note] WSREP: Service disconnected. | |
| 160526 16:20:34 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:20:34 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:20:34 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:20:35 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:20:35 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.u2fOXF' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:20:35 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:20:37 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:20:37 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:20:37 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:20:37 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:20:37 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:20:37 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:20:37 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:20:37 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:20:37 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:20:37 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:20:37 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:20:37 [Note] WSREP: Start replication | |
| 160526 16:20:37 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:20:37 [Note] WSREP: protonet asio version 0 | |
| 160526 16:20:37 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:20:37 [Note] WSREP: backend: asio | |
| 160526 16:20:37 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:20:37 [Note] WSREP: restore pc from disk failed | |
| 160526 16:20:37 [Note] WSREP: GMCast version 0 | |
| 160526 16:20:37 [Note] WSREP: (664b9130, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:20:37 [Note] WSREP: (664b9130, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:20:37 [Note] WSREP: EVS version 0 | |
| 160526 16:20:37 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:20:41 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:20:41 [Note] WSREP: view(view_id(NON_PRIM,664b9130,1) memb { | |
| 664b9130,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:20:41 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.90147S), skipping check | |
| 160526 16:20:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT12.8294S), skipping check | |
| 160526 16:21:11 [Note] WSREP: view((empty)) | |
| 160526 16:21:11 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:21:11 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:21:11 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:21:11 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:21:11 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:21:11 [ERROR] Aborting | |
| 160526 16:21:11 [Note] WSREP: Service disconnected. | |
| 160526 16:21:12 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:21:12 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:21:12 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:21:12 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:21:12 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.9TbPyT' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:21:12 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:21:15 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:21:15 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:21:15 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:21:15 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:21:15 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:21:15 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:21:15 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:21:15 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:21:15 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:21:15 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:21:15 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:21:15 [Note] WSREP: Start replication | |
| 160526 16:21:15 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:21:15 [Note] WSREP: protonet asio version 0 | |
| 160526 16:21:15 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:21:15 [Note] WSREP: backend: asio | |
| 160526 16:21:15 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:21:15 [Note] WSREP: restore pc from disk failed | |
| 160526 16:21:15 [Note] WSREP: GMCast version 0 | |
| 160526 16:21:15 [Note] WSREP: (7cbad6fd, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:21:15 [Note] WSREP: (7cbad6fd, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:21:15 [Note] WSREP: EVS version 0 | |
| 160526 16:21:15 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:21:18 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:21:18 [Note] WSREP: view(view_id(NON_PRIM,7cbad6fd,1) memb { | |
| 7cbad6fd,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:21:18 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50282S), skipping check | |
| 160526 16:21:48 [Note] WSREP: view((empty)) | |
| 160526 16:21:48 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:21:48 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:21:48 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:21:48 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:21:48 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:21:48 [ERROR] Aborting | |
| 160526 16:21:48 [Note] WSREP: Service disconnected. | |
| 160526 16:21:49 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:21:49 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:21:49 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:21:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:21:49 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.Hakde3' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:21:49 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:21:52 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:21:52 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:21:52 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:21:52 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:21:52 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:21:52 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:21:52 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:21:52 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:21:52 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:21:52 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:21:52 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:21:52 [Note] WSREP: Start replication | |
| 160526 16:21:52 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:21:52 [Note] WSREP: protonet asio version 0 | |
| 160526 16:21:52 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:21:52 [Note] WSREP: backend: asio | |
| 160526 16:21:52 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:21:52 [Note] WSREP: restore pc from disk failed | |
| 160526 16:21:52 [Note] WSREP: GMCast version 0 | |
| 160526 16:21:52 [Note] WSREP: (92b6fc51, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:21:52 [Note] WSREP: (92b6fc51, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:21:52 [Note] WSREP: EVS version 0 | |
| 160526 16:21:52 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:21:55 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:21:55 [Note] WSREP: view(view_id(NON_PRIM,92b6fc51,1) memb { | |
| 92b6fc51,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:21:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50231S), skipping check | |
| 160526 16:22:25 [Note] WSREP: view((empty)) | |
| 160526 16:22:25 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:22:25 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:22:25 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:22:25 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:22:25 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:22:25 [ERROR] Aborting | |
| 160526 16:22:25 [Note] WSREP: Service disconnected. | |
| 160526 16:22:26 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:22:26 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:22:26 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:22:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:22:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.5DgYfw' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:22:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 146 ... | |
| 160526 16:22:29 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:22:29 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 178 ... | |
| 160526 16:22:29 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:22:29 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:22:29 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:22:29 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:22:29 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:22:29 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:22:29 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:22:29 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:22:29 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:22:29 [Note] WSREP: Start replication | |
| 160526 16:22:29 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:22:29 [Note] WSREP: protonet asio version 0 | |
| 160526 16:22:29 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:22:29 [Note] WSREP: backend: asio | |
| 160526 16:22:29 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:22:29 [Note] WSREP: restore pc from disk failed | |
| 160526 16:22:29 [Note] WSREP: GMCast version 0 | |
| 160526 16:22:29 [Note] WSREP: (a8b16653, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:22:29 [Note] WSREP: (a8b16653, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:22:29 [Note] WSREP: EVS version 0 | |
| 160526 16:22:29 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:22:32 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:22:32 [Note] WSREP: view(view_id(NON_PRIM,a8b16653,1) memb { | |
| a8b16653,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:22:32 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50242S), skipping check | |
| 160526 16:23:02 [Note] WSREP: view((empty)) | |
| 160526 16:23:02 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:23:02 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:23:02 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:23:02 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:23:02 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:23:02 [ERROR] Aborting | |
| 160526 16:23:02 [Note] WSREP: Service disconnected. | |
| 160526 16:23:03 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:23:03 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:23:03 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:23:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:23:03 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.0Il0d4' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:23:03 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:23:05 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:23:05 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:23:05 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:23:05 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:23:05 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:23:05 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:23:05 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:23:05 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:23:05 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:23:05 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:23:05 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:23:05 [Note] WSREP: Start replication | |
| 160526 16:23:05 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:23:05 [Note] WSREP: protonet asio version 0 | |
| 160526 16:23:05 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:23:05 [Note] WSREP: backend: asio | |
| 160526 16:23:05 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:23:05 [Note] WSREP: restore pc from disk failed | |
| 160526 16:23:05 [Note] WSREP: GMCast version 0 | |
| 160526 16:23:05 [Note] WSREP: (beb0bd01, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:23:05 [Note] WSREP: (beb0bd01, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:23:05 [Note] WSREP: EVS version 0 | |
| 160526 16:23:05 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:23:08 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:23:08 [Note] WSREP: view(view_id(NON_PRIM,beb0bd01,1) memb { | |
| beb0bd01,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:23:09 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50277S), skipping check | |
| 160526 16:23:38 [Note] WSREP: view((empty)) | |
| 160526 16:23:38 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:23:38 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:23:38 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:23:38 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:23:38 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:23:38 [ERROR] Aborting | |
| 160526 16:23:39 [Note] WSREP: Service disconnected. | |
| 160526 16:23:40 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:23:40 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:23:40 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:23:40 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:23:40 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.vWkwqn' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:23:40 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:23:42 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:23:42 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:23:42 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:23:42 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:23:42 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:23:42 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:23:42 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:23:42 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:23:42 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:23:42 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:23:42 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:23:42 [Note] WSREP: Start replication | |
| 160526 16:23:42 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:23:42 [Note] WSREP: protonet asio version 0 | |
| 160526 16:23:42 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:23:42 [Note] WSREP: backend: asio | |
| 160526 16:23:42 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:23:42 [Note] WSREP: restore pc from disk failed | |
| 160526 16:23:42 [Note] WSREP: GMCast version 0 | |
| 160526 16:23:42 [Note] WSREP: (d4b12ebd, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:23:42 [Note] WSREP: (d4b12ebd, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:23:42 [Note] WSREP: EVS version 0 | |
| 160526 16:23:42 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:23:45 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:23:45 [Note] WSREP: view(view_id(NON_PRIM,d4b12ebd,1) memb { | |
| d4b12ebd,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:23:46 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5019S), skipping check | |
| 160526 16:24:15 [Note] WSREP: view((empty)) | |
| 160526 16:24:15 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:24:15 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:24:15 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:24:15 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:24:15 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:24:15 [ERROR] Aborting | |
| 160526 16:24:15 [Note] WSREP: Service disconnected. | |
| 160526 16:24:16 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:24:16 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:24:16 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:24:17 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:24:17 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.787han' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:24:17 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:24:19 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:24:19 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:24:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:24:19 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:24:19 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:24:19 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:24:19 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:24:19 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:24:19 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:24:19 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:24:19 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:24:19 [Note] WSREP: Start replication | |
| 160526 16:24:19 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:24:19 [Note] WSREP: protonet asio version 0 | |
| 160526 16:24:19 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:24:19 [Note] WSREP: backend: asio | |
| 160526 16:24:19 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:24:19 [Note] WSREP: restore pc from disk failed | |
| 160526 16:24:19 [Note] WSREP: GMCast version 0 | |
| 160526 16:24:19 [Note] WSREP: (eaac99bb, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:24:19 [Note] WSREP: (eaac99bb, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:24:19 [Note] WSREP: EVS version 0 | |
| 160526 16:24:19 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:24:22 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:24:22 [Note] WSREP: view(view_id(NON_PRIM,eaac99bb,1) memb { | |
| eaac99bb,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:24:23 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50233S), skipping check | |
| 160526 16:24:52 [Note] WSREP: view((empty)) | |
| 160526 16:24:52 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:24:52 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:24:52 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:24:52 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:24:52 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:24:52 [ERROR] Aborting | |
| 160526 16:24:52 [Note] WSREP: Service disconnected. | |
| 160526 16:24:53 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:24:53 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:24:53 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:24:54 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:24:54 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.Qp66Gy' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:24:54 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:24:56 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:24:56 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:24:56 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:24:56 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:24:56 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:24:56 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:24:56 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:24:56 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:24:56 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:24:56 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:24:56 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:24:56 [Note] WSREP: Start replication | |
| 160526 16:24:56 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:24:56 [Note] WSREP: protonet asio version 0 | |
| 160526 16:24:56 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:24:56 [Note] WSREP: backend: asio | |
| 160526 16:24:56 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:24:56 [Note] WSREP: restore pc from disk failed | |
| 160526 16:24:56 [Note] WSREP: GMCast version 0 | |
| 160526 16:24:56 [Note] WSREP: (00a73221, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:24:56 [Note] WSREP: (00a73221, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:24:56 [Note] WSREP: EVS version 0 | |
| 160526 16:24:56 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:24:59 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:24:59 [Note] WSREP: view(view_id(NON_PRIM,00a73221,1) memb { | |
| 00a73221,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:25:00 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50193S), skipping check | |
| 160526 16:25:29 [Note] WSREP: view((empty)) | |
| 160526 16:25:29 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:25:29 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:25:29 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:25:29 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:25:29 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:25:29 [ERROR] Aborting | |
| 160526 16:25:29 [Note] WSREP: Service disconnected. | |
| 160526 16:25:30 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:25:30 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:25:30 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:25:31 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:25:31 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.ZzEbob' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:25:31 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:25:33 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:25:33 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:25:33 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:25:33 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:25:33 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:25:33 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:25:33 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:25:33 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:25:33 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:25:33 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:25:33 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:25:33 [Note] WSREP: Start replication | |
| 160526 16:25:33 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:25:33 [Note] WSREP: protonet asio version 0 | |
| 160526 16:25:33 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:25:33 [Note] WSREP: backend: asio | |
| 160526 16:25:33 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:25:33 [Note] WSREP: restore pc from disk failed | |
| 160526 16:25:33 [Note] WSREP: GMCast version 0 | |
| 160526 16:25:33 [Note] WSREP: (16abd6b0, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:25:33 [Note] WSREP: (16abd6b0, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:25:33 [Note] WSREP: EVS version 0 | |
| 160526 16:25:33 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:25:36 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:25:36 [Note] WSREP: view(view_id(NON_PRIM,16abd6b0,1) memb { | |
| 16abd6b0,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:25:37 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50302S), skipping check | |
| 160526 16:26:06 [Note] WSREP: view((empty)) | |
| 160526 16:26:06 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:26:06 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:26:06 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:26:06 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:26:06 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:26:06 [ERROR] Aborting | |
| 160526 16:26:06 [Note] WSREP: Service disconnected. | |
| 160526 16:26:07 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:26:07 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:26:07 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:26:08 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:26:08 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.9itrbj' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:26:08 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:26:10 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:26:10 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:26:10 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:26:10 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:26:10 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:26:10 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:26:10 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:26:10 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:26:10 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:26:10 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:26:10 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:26:10 [Note] WSREP: Start replication | |
| 160526 16:26:10 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:26:10 [Note] WSREP: protonet asio version 0 | |
| 160526 16:26:10 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:26:10 [Note] WSREP: backend: asio | |
| 160526 16:26:10 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:26:10 [Note] WSREP: restore pc from disk failed | |
| 160526 16:26:10 [Note] WSREP: GMCast version 0 | |
| 160526 16:26:10 [Note] WSREP: (2ca79144, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:26:10 [Note] WSREP: (2ca79144, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:26:10 [Note] WSREP: EVS version 0 | |
| 160526 16:26:10 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:26:13 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:26:13 [Note] WSREP: view(view_id(NON_PRIM,2ca79144,1) memb { | |
| 2ca79144,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:26:13 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5023S), skipping check | |
| 160526 16:26:43 [Note] WSREP: view((empty)) | |
| 160526 16:26:43 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:26:43 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:26:43 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:26:43 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:26:43 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:26:43 [ERROR] Aborting | |
| 160526 16:26:43 [Note] WSREP: Service disconnected. | |
| 160526 16:26:44 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:26:44 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:26:44 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:26:44 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:26:44 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.1hmh9m' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:26:44 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:26:47 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:26:47 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:26:47 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:26:47 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:26:47 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:26:47 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:26:47 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:26:47 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:26:47 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:26:47 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:26:47 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:26:47 [Note] WSREP: Start replication | |
| 160526 16:26:47 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:26:47 [Note] WSREP: protonet asio version 0 | |
| 160526 16:26:47 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:26:47 [Note] WSREP: backend: asio | |
| 160526 16:26:47 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:26:47 [Note] WSREP: restore pc from disk failed | |
| 160526 16:26:47 [Note] WSREP: GMCast version 0 | |
| 160526 16:26:47 [Note] WSREP: (42a970a7, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:26:47 [Note] WSREP: (42a970a7, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:26:47 [Note] WSREP: EVS version 0 | |
| 160526 16:26:47 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:26:50 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:26:50 [Note] WSREP: view(view_id(NON_PRIM,42a970a7,1) memb { | |
| 42a970a7,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:26:50 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50251S), skipping check | |
| 160526 16:27:20 [Note] WSREP: view((empty)) | |
| 160526 16:27:20 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:27:20 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:27:20 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:27:20 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:27:20 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:27:20 [ERROR] Aborting | |
| 160526 16:27:20 [Note] WSREP: Service disconnected. | |
| 160526 16:27:21 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:27:21 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:27:21 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:27:21 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:27:21 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.rPwhlv' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:27:21 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 146 ... | |
| 160526 16:27:24 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:27:24 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 178 ... | |
| 160526 16:27:24 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:27:24 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:27:24 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:27:24 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:27:24 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:27:24 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:27:24 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:27:24 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:27:24 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:27:24 [Note] WSREP: Start replication | |
| 160526 16:27:24 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:27:24 [Note] WSREP: protonet asio version 0 | |
| 160526 16:27:24 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:27:24 [Note] WSREP: backend: asio | |
| 160526 16:27:24 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:27:24 [Note] WSREP: restore pc from disk failed | |
| 160526 16:27:24 [Note] WSREP: GMCast version 0 | |
| 160526 16:27:24 [Note] WSREP: (589ffb9c, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:27:24 [Note] WSREP: (589ffb9c, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:27:24 [Note] WSREP: EVS version 0 | |
| 160526 16:27:24 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:27:27 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:27:27 [Note] WSREP: view(view_id(NON_PRIM,589ffb9c,1) memb { | |
| 589ffb9c,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:27:27 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50331S), skipping check | |
| 160526 16:27:57 [Note] WSREP: view((empty)) | |
| 160526 16:27:57 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:27:57 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:27:57 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:27:57 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:27:57 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:27:57 [ERROR] Aborting | |
| 160526 16:27:57 [Note] WSREP: Service disconnected. | |
| 160526 16:27:58 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:27:58 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:27:58 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:27:58 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:27:58 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.xUi159' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:27:58 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:28:01 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:28:01 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:28:01 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:28:01 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:28:01 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:28:01 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:28:01 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:28:01 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:28:01 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:28:01 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:28:01 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:28:01 [Note] WSREP: Start replication | |
| 160526 16:28:01 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:28:01 [Note] WSREP: protonet asio version 0 | |
| 160526 16:28:01 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:28:01 [Note] WSREP: backend: asio | |
| 160526 16:28:01 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:28:01 [Note] WSREP: restore pc from disk failed | |
| 160526 16:28:01 [Note] WSREP: GMCast version 0 | |
| 160526 16:28:01 [Note] WSREP: (6e9be5f2, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:28:01 [Note] WSREP: (6e9be5f2, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:28:01 [Note] WSREP: EVS version 0 | |
| 160526 16:28:01 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:28:04 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:28:04 [Note] WSREP: view(view_id(NON_PRIM,6e9be5f2,1) memb { | |
| 6e9be5f2,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:28:04 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50199S), skipping check | |
| 160526 16:28:34 [Note] WSREP: view((empty)) | |
| 160526 16:28:34 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:28:34 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:28:34 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:28:34 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:28:34 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:28:34 [ERROR] Aborting | |
| 160526 16:28:34 [Note] WSREP: Service disconnected. | |
| 160526 16:28:35 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:28:35 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:28:35 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:28:35 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:28:35 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.8GtqTs' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:28:35 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:28:37 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:28:38 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:28:38 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:28:38 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:28:38 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:28:38 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:28:38 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:28:38 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:28:38 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:28:38 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:28:38 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:28:38 [Note] WSREP: Start replication | |
| 160526 16:28:38 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:28:38 [Note] WSREP: protonet asio version 0 | |
| 160526 16:28:38 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:28:38 [Note] WSREP: backend: asio | |
| 160526 16:28:38 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:28:38 [Note] WSREP: restore pc from disk failed | |
| 160526 16:28:38 [Note] WSREP: GMCast version 0 | |
| 160526 16:28:38 [Note] WSREP: (849c558e, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:28:38 [Note] WSREP: (849c558e, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:28:38 [Note] WSREP: EVS version 0 | |
| 160526 16:28:38 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:28:41 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:28:41 [Note] WSREP: view(view_id(NON_PRIM,849c558e,1) memb { | |
| 849c558e,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:28:41 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50297S), skipping check | |
| 160526 16:29:11 [Note] WSREP: view((empty)) | |
| 160526 16:29:11 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:29:11 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:29:11 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:29:11 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:29:11 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:29:11 [ERROR] Aborting | |
| 160526 16:29:11 [Note] WSREP: Service disconnected. | |
| 160526 16:29:12 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:29:12 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:29:12 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:29:12 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:29:12 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.7X0OOt' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:29:12 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:29:14 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:29:14 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:29:14 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:29:14 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:29:14 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:29:14 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:29:14 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:29:14 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:29:14 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:29:14 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:29:14 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:29:14 [Note] WSREP: Start replication | |
| 160526 16:29:14 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:29:14 [Note] WSREP: protonet asio version 0 | |
| 160526 16:29:14 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:29:14 [Note] WSREP: backend: asio | |
| 160526 16:29:14 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:29:14 [Note] WSREP: restore pc from disk failed | |
| 160526 16:29:14 [Note] WSREP: GMCast version 0 | |
| 160526 16:29:14 [Note] WSREP: (9a933e3a, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:29:14 [Note] WSREP: (9a933e3a, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:29:14 [Note] WSREP: EVS version 0 | |
| 160526 16:29:14 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:29:17 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:29:17 [Note] WSREP: view(view_id(NON_PRIM,9a933e3a,1) memb { | |
| 9a933e3a,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:29:18 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50245S), skipping check | |
| 160526 16:29:47 [Note] WSREP: view((empty)) | |
| 160526 16:29:47 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:29:47 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:29:47 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:29:47 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:29:47 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:29:47 [ERROR] Aborting | |
| 160526 16:29:47 [Note] WSREP: Service disconnected. | |
| 160526 16:29:48 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:29:48 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:29:48 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:29:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:29:49 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.KISu31' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:29:49 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:29:51 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:29:51 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:29:51 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:29:51 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:29:51 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:29:51 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:29:51 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:29:51 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:29:51 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:29:51 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:29:51 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:29:51 [Note] WSREP: Start replication | |
| 160526 16:29:51 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:29:51 [Note] WSREP: protonet asio version 0 | |
| 160526 16:29:51 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:29:51 [Note] WSREP: backend: asio | |
| 160526 16:29:51 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:29:51 [Note] WSREP: restore pc from disk failed | |
| 160526 16:29:51 [Note] WSREP: GMCast version 0 | |
| 160526 16:29:51 [Note] WSREP: (b08e3827, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:29:51 [Note] WSREP: (b08e3827, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:29:51 [Note] WSREP: EVS version 0 | |
| 160526 16:29:51 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:29:54 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:29:54 [Note] WSREP: view(view_id(NON_PRIM,b08e3827,1) memb { | |
| b08e3827,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:29:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50181S), skipping check | |
| 160526 16:30:24 [Note] WSREP: view((empty)) | |
| 160526 16:30:24 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:30:24 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:30:24 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:30:24 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:30:24 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:30:24 [ERROR] Aborting | |
| 160526 16:30:24 [Note] WSREP: Service disconnected. | |
| 160526 16:30:25 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:30:25 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:30:25 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:30:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:30:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.IfRyZW' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:30:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:30:28 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:30:28 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:30:28 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:30:28 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:30:28 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:30:28 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:30:28 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:30:28 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:30:28 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:30:28 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:30:28 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:30:28 [Note] WSREP: Start replication | |
| 160526 16:30:28 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:30:28 [Note] WSREP: protonet asio version 0 | |
| 160526 16:30:28 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:30:28 [Note] WSREP: backend: asio | |
| 160526 16:30:28 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:30:28 [Note] WSREP: restore pc from disk failed | |
| 160526 16:30:28 [Note] WSREP: GMCast version 0 | |
| 160526 16:30:28 [Note] WSREP: (c6878300, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:30:28 [Note] WSREP: (c6878300, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:30:28 [Note] WSREP: EVS version 0 | |
| 160526 16:30:28 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:30:31 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:30:31 [Note] WSREP: view(view_id(NON_PRIM,c6878300,1) memb { | |
| c6878300,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:30:32 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50284S), skipping check | |
| 160526 16:31:01 [Note] WSREP: view((empty)) | |
| 160526 16:31:01 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:31:01 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:31:01 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:31:01 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:31:01 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:31:01 [ERROR] Aborting | |
| 160526 16:31:01 [Note] WSREP: Service disconnected. | |
| 160526 16:31:02 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:31:02 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:31:02 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:31:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:31:03 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.nBoUaF' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:31:03 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:31:05 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:31:05 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:31:05 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:31:05 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:31:05 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:31:05 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:31:05 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:31:05 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:31:05 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:31:05 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:31:05 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:31:05 [Note] WSREP: Start replication | |
| 160526 16:31:05 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:31:05 [Note] WSREP: protonet asio version 0 | |
| 160526 16:31:05 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:31:05 [Note] WSREP: backend: asio | |
| 160526 16:31:05 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:31:05 [Note] WSREP: restore pc from disk failed | |
| 160526 16:31:05 [Note] WSREP: GMCast version 0 | |
| 160526 16:31:05 [Note] WSREP: (dc7e0973, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:31:05 [Note] WSREP: (dc7e0973, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:31:05 [Note] WSREP: EVS version 0 | |
| 160526 16:31:05 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:31:08 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:31:08 [Note] WSREP: view(view_id(NON_PRIM,dc7e0973,1) memb { | |
| dc7e0973,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:31:08 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50289S), skipping check | |
| 160526 16:31:38 [Note] WSREP: view((empty)) | |
| 160526 16:31:38 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:31:38 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:31:38 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:31:38 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:31:38 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:31:38 [ERROR] Aborting | |
| 160526 16:31:38 [Note] WSREP: Service disconnected. | |
| 160526 16:31:39 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:31:39 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:31:39 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:31:39 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:31:39 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.mqkUOs' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:31:39 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:31:42 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:31:42 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:31:42 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:31:42 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:31:42 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:31:42 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:31:42 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:31:42 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:31:42 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:31:42 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:31:42 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:31:42 [Note] WSREP: Start replication | |
| 160526 16:31:42 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:31:42 [Note] WSREP: protonet asio version 0 | |
| 160526 16:31:42 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:31:42 [Note] WSREP: backend: asio | |
| 160526 16:31:42 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:31:42 [Note] WSREP: restore pc from disk failed | |
| 160526 16:31:42 [Note] WSREP: GMCast version 0 | |
| 160526 16:31:42 [Note] WSREP: (f27e1d8d, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:31:42 [Note] WSREP: (f27e1d8d, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:31:42 [Note] WSREP: EVS version 0 | |
| 160526 16:31:42 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:31:45 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:31:45 [Note] WSREP: view(view_id(NON_PRIM,f27e1d8d,1) memb { | |
| f27e1d8d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:31:45 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50197S), skipping check | |
| 160526 16:32:12 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:32:12 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.9Ni9Bj' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:32:12 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:32:15 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:32:15 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:32:15 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:32:15 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:32:15 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:32:15 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:32:15 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:32:15 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:32:15 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:32:15 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:32:15 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:32:15 [Note] WSREP: Start replication | |
| 160526 16:32:15 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:32:15 [Note] WSREP: protonet asio version 0 | |
| 160526 16:32:15 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:32:15 [Note] WSREP: backend: asio | |
| 160526 16:32:15 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:32:15 [Note] WSREP: restore pc from disk failed | |
| 160526 16:32:15 [Note] WSREP: GMCast version 0 | |
| 160526 16:32:15 [Note] WSREP: (05f931be, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:32:15 [Note] WSREP: (05f931be, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:32:15 [Note] WSREP: EVS version 0 | |
| 160526 16:32:15 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:32:18 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:32:18 [Note] WSREP: view(view_id(NON_PRIM,05f931be,1) memb { | |
| 05f931be,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:32:18 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50306S), skipping check | |
| 160526 16:32:48 [Note] WSREP: view((empty)) | |
| 160526 16:32:48 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:32:48 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:32:48 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:32:48 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:32:48 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:32:48 [ERROR] Aborting | |
| 160526 16:32:48 [Note] WSREP: Service disconnected. | |
| 160526 16:32:49 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:32:49 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:32:49 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:32:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:32:49 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.itHKB7' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:32:49 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:32:51 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:32:51 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:32:51 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:32:51 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:32:51 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:32:51 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:32:51 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:32:51 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:32:51 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:32:51 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:32:51 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:32:51 [Note] WSREP: Start replication | |
| 160526 16:32:51 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:32:51 [Note] WSREP: protonet asio version 0 | |
| 160526 16:32:51 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:32:51 [Note] WSREP: backend: asio | |
| 160526 16:32:51 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:32:51 [Note] WSREP: restore pc from disk failed | |
| 160526 16:32:51 [Note] WSREP: GMCast version 0 | |
| 160526 16:32:51 [Note] WSREP: (1bf417ff, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:32:51 [Note] WSREP: (1bf417ff, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:32:51 [Note] WSREP: EVS version 0 | |
| 160526 16:32:51 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:32:54 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:32:54 [Note] WSREP: view(view_id(NON_PRIM,1bf417ff,1) memb { | |
| 1bf417ff,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:32:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50276S), skipping check | |
| 160526 16:33:24 [Note] WSREP: view((empty)) | |
| 160526 16:33:24 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:33:24 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:33:24 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:33:24 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:33:24 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:33:24 [ERROR] Aborting | |
| 160526 16:33:24 [Note] WSREP: Service disconnected. | |
| 160526 16:33:25 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:33:25 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:33:25 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:33:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:33:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.fXOl0C' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:33:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:33:28 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:33:28 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:33:28 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:33:28 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:33:28 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:33:28 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:33:28 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:33:28 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:33:28 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:33:28 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:33:28 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:33:28 [Note] WSREP: Start replication | |
| 160526 16:33:28 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:33:28 [Note] WSREP: protonet asio version 0 | |
| 160526 16:33:28 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:33:28 [Note] WSREP: backend: asio | |
| 160526 16:33:28 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:33:28 [Note] WSREP: restore pc from disk failed | |
| 160526 16:33:28 [Note] WSREP: GMCast version 0 | |
| 160526 16:33:28 [Note] WSREP: (31f3353a, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:33:28 [Note] WSREP: (31f3353a, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:33:28 [Note] WSREP: EVS version 0 | |
| 160526 16:33:28 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:33:31 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:33:31 [Note] WSREP: view(view_id(NON_PRIM,31f3353a,1) memb { | |
| 31f3353a,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:33:32 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50207S), skipping check | |
| 160526 16:34:01 [Note] WSREP: view((empty)) | |
| 160526 16:34:01 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:34:01 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:34:01 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:34:01 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:34:01 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:34:01 [ERROR] Aborting | |
| 160526 16:34:01 [Note] WSREP: Service disconnected. | |
| 160526 16:34:02 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:34:02 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:34:02 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:34:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:34:03 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.zRyjix' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:34:03 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:34:05 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:34:05 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:34:05 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:34:05 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:34:05 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:34:05 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:34:05 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:34:05 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:34:05 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:34:05 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:34:05 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:34:05 [Note] WSREP: Start replication | |
| 160526 16:34:05 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:34:05 [Note] WSREP: protonet asio version 0 | |
| 160526 16:34:05 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:34:05 [Note] WSREP: backend: asio | |
| 160526 16:34:05 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:34:05 [Note] WSREP: restore pc from disk failed | |
| 160526 16:34:05 [Note] WSREP: GMCast version 0 | |
| 160526 16:34:05 [Note] WSREP: (47eb19d6, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:34:05 [Note] WSREP: (47eb19d6, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:34:05 [Note] WSREP: EVS version 0 | |
| 160526 16:34:05 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:34:08 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:34:08 [Note] WSREP: view(view_id(NON_PRIM,47eb19d6,1) memb { | |
| 47eb19d6,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:34:09 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50238S), skipping check | |
| 160526 16:34:38 [Note] WSREP: view((empty)) | |
| 160526 16:34:38 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:34:38 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:34:38 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:34:38 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:34:38 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:34:38 [ERROR] Aborting | |
| 160526 16:34:38 [Note] WSREP: Service disconnected. | |
| 160526 16:34:39 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:34:39 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:34:39 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:34:40 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:34:40 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.dcY1ej' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:34:40 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:34:42 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:34:42 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:34:42 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:34:42 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:34:42 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:34:42 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:34:42 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:34:42 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:34:42 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:34:42 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:34:42 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:34:42 [Note] WSREP: Start replication | |
| 160526 16:34:42 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:34:42 [Note] WSREP: protonet asio version 0 | |
| 160526 16:34:42 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:34:42 [Note] WSREP: backend: asio | |
| 160526 16:34:42 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:34:42 [Note] WSREP: restore pc from disk failed | |
| 160526 16:34:42 [Note] WSREP: GMCast version 0 | |
| 160526 16:34:42 [Note] WSREP: (5de99127, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:34:42 [Note] WSREP: (5de99127, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:34:42 [Note] WSREP: EVS version 0 | |
| 160526 16:34:42 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:34:45 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:34:45 [Note] WSREP: view(view_id(NON_PRIM,5de99127,1) memb { | |
| 5de99127,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:34:46 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50293S), skipping check | |
| 160526 16:35:15 [Note] WSREP: view((empty)) | |
| 160526 16:35:15 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:35:15 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:35:15 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:35:15 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:35:15 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:35:15 [ERROR] Aborting | |
| 160526 16:35:15 [Note] WSREP: Service disconnected. | |
| 160526 16:35:16 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:35:16 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:35:16 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:35:17 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:35:17 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.4ZtQK0' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:35:17 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:35:19 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:35:19 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:35:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:35:19 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:35:19 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:35:19 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:35:19 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:35:19 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:35:19 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:35:19 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:35:19 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:35:19 [Note] WSREP: Start replication | |
| 160526 16:35:19 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:35:19 [Note] WSREP: protonet asio version 0 | |
| 160526 16:35:19 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:35:19 [Note] WSREP: backend: asio | |
| 160526 16:35:19 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:35:19 [Note] WSREP: restore pc from disk failed | |
| 160526 16:35:19 [Note] WSREP: GMCast version 0 | |
| 160526 16:35:19 [Note] WSREP: (73e2ae2f, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:35:19 [Note] WSREP: (73e2ae2f, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:35:19 [Note] WSREP: EVS version 0 | |
| 160526 16:35:19 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:35:22 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:35:22 [Note] WSREP: view(view_id(NON_PRIM,73e2ae2f,1) memb { | |
| 73e2ae2f,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:35:22 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50288S), skipping check | |
| 160526 16:35:52 [Note] WSREP: view((empty)) | |
| 160526 16:35:52 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:35:52 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:35:52 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:35:52 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:35:52 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:35:52 [ERROR] Aborting | |
| 160526 16:35:52 [Note] WSREP: Service disconnected. | |
| 160526 16:35:53 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:35:53 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:35:53 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:35:53 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:35:53 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.wrz4MN' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:35:53 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:35:56 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:35:56 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:35:56 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:35:56 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:35:56 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:35:56 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:35:56 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:35:56 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:35:56 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:35:56 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:35:56 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:35:56 [Note] WSREP: Start replication | |
| 160526 16:35:56 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:35:56 [Note] WSREP: protonet asio version 0 | |
| 160526 16:35:56 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:35:56 [Note] WSREP: backend: asio | |
| 160526 16:35:56 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:35:56 [Note] WSREP: restore pc from disk failed | |
| 160526 16:35:56 [Note] WSREP: GMCast version 0 | |
| 160526 16:35:56 [Note] WSREP: (89de874f, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:35:56 [Note] WSREP: (89de874f, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:35:56 [Note] WSREP: EVS version 0 | |
| 160526 16:35:56 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:35:59 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:35:59 [Note] WSREP: view(view_id(NON_PRIM,89de874f,1) memb { | |
| 89de874f,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:35:59 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50276S), skipping check | |
| 160526 16:36:29 [Note] WSREP: view((empty)) | |
| 160526 16:36:29 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:36:29 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:36:29 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:36:29 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:36:29 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:36:29 [ERROR] Aborting | |
| 160526 16:36:29 [Note] WSREP: Service disconnected. | |
| 160526 16:36:30 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:36:30 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:36:30 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:36:30 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:36:30 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.wilWBL' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:36:30 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:36:33 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:36:33 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:36:33 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:36:33 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:36:33 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:36:33 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:36:33 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:36:33 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:36:33 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:36:33 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:36:33 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:36:33 [Note] WSREP: Start replication | |
| 160526 16:36:33 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:36:33 [Note] WSREP: protonet asio version 0 | |
| 160526 16:36:33 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:36:33 [Note] WSREP: backend: asio | |
| 160526 16:36:33 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:36:33 [Note] WSREP: restore pc from disk failed | |
| 160526 16:36:33 [Note] WSREP: GMCast version 0 | |
| 160526 16:36:33 [Note] WSREP: (9fda2ba6, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:36:33 [Note] WSREP: (9fda2ba6, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:36:33 [Note] WSREP: EVS version 0 | |
| 160526 16:36:33 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:36:36 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:36:36 [Note] WSREP: view(view_id(NON_PRIM,9fda2ba6,1) memb { | |
| 9fda2ba6,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:36:36 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50256S), skipping check | |
| 160526 16:37:06 [Note] WSREP: view((empty)) | |
| 160526 16:37:06 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:37:06 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:37:06 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:37:06 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:37:06 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:37:06 [ERROR] Aborting | |
| 160526 16:37:06 [Note] WSREP: Service disconnected. | |
| 160526 16:37:07 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:37:07 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:37:07 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:37:59 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:37:59 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.cISzdm' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:37:59 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:38:01 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:38:01 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:38:01 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:38:01 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:38:01 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:38:01 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:38:01 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:38:01 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:38:01 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:38:01 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:38:01 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:38:01 [Note] WSREP: Start replication | |
| 160526 16:38:01 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:38:01 [Note] WSREP: protonet asio version 0 | |
| 160526 16:38:01 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:38:01 [Note] WSREP: backend: asio | |
| 160526 16:38:01 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:38:01 [Note] WSREP: restore pc from disk failed | |
| 160526 16:38:01 [Note] WSREP: GMCast version 0 | |
| 160526 16:38:01 [Note] WSREP: (d4a019a0, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:38:01 [Note] WSREP: (d4a019a0, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:38:01 [Note] WSREP: EVS version 0 | |
| 160526 16:38:01 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:38:04 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:38:04 [Note] WSREP: view(view_id(NON_PRIM,d4a019a0,1) memb { | |
| d4a019a0,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:38:05 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50195S), skipping check | |
| 160526 16:38:34 [Note] WSREP: view((empty)) | |
| 160526 16:38:34 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:38:34 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:38:34 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:38:34 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:38:34 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:38:34 [ERROR] Aborting | |
| 160526 16:38:34 [Note] WSREP: Service disconnected. | |
| 160526 16:38:35 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:38:35 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:38:35 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:38:36 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:38:36 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.DFnFiU' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:38:36 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:38:38 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:38:38 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:38:38 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:38:38 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:38:38 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:38:38 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:38:38 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:38:38 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:38:38 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:38:38 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:38:38 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:38:38 [Note] WSREP: Start replication | |
| 160526 16:38:38 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:38:38 [Note] WSREP: protonet asio version 0 | |
| 160526 16:38:38 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:38:38 [Note] WSREP: backend: asio | |
| 160526 16:38:38 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:38:38 [Note] WSREP: restore pc from disk failed | |
| 160526 16:38:38 [Note] WSREP: GMCast version 0 | |
| 160526 16:38:38 [Note] WSREP: (ea9e0d80, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:38:38 [Note] WSREP: (ea9e0d80, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:38:38 [Note] WSREP: EVS version 0 | |
| 160526 16:38:38 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:38:41 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:38:41 [Note] WSREP: view(view_id(NON_PRIM,ea9e0d80,1) memb { | |
| ea9e0d80,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:38:42 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50212S), skipping check | |
| 160526 16:39:11 [Note] WSREP: view((empty)) | |
| 160526 16:39:11 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:39:11 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:39:11 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:39:11 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:39:11 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:39:11 [ERROR] Aborting | |
| 160526 16:39:11 [Note] WSREP: Service disconnected. | |
| 160526 16:39:12 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:39:12 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:39:12 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:39:13 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:39:13 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.hDDf4A' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:39:13 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:39:15 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:39:15 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:39:15 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:39:15 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:39:15 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:39:15 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:39:15 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:39:15 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:39:15 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:39:15 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:39:15 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:39:15 [Note] WSREP: Start replication | |
| 160526 16:39:15 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:39:15 [Note] WSREP: protonet asio version 0 | |
| 160526 16:39:15 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:39:15 [Note] WSREP: backend: asio | |
| 160526 16:39:15 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:39:15 [Note] WSREP: restore pc from disk failed | |
| 160526 16:39:15 [Note] WSREP: GMCast version 0 | |
| 160526 16:39:15 [Note] WSREP: (00950848, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:39:15 [Note] WSREP: (00950848, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:39:15 [Note] WSREP: EVS version 0 | |
| 160526 16:39:15 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:39:18 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:39:18 [Note] WSREP: view(view_id(NON_PRIM,00950848,1) memb { | |
| 00950848,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:39:19 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50288S), skipping check | |
| 160526 16:39:48 [Note] WSREP: view((empty)) | |
| 160526 16:39:48 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:39:48 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:39:48 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:39:48 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:39:48 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:39:48 [ERROR] Aborting | |
| 160526 16:39:48 [Note] WSREP: Service disconnected. | |
| 160526 16:39:49 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:39:49 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:39:49 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:39:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:39:49 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.zpU8lY' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:39:49 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:39:52 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:39:52 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:39:52 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:39:52 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:39:52 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:39:52 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:39:52 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:39:52 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:39:52 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:39:52 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:39:52 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:39:52 [Note] WSREP: Start replication | |
| 160526 16:39:52 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:39:52 [Note] WSREP: protonet asio version 0 | |
| 160526 16:39:52 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:39:52 [Note] WSREP: backend: asio | |
| 160526 16:39:52 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:39:52 [Note] WSREP: restore pc from disk failed | |
| 160526 16:39:52 [Note] WSREP: GMCast version 0 | |
| 160526 16:39:52 [Note] WSREP: (1693a457, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:39:52 [Note] WSREP: (1693a457, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:39:52 [Note] WSREP: EVS version 0 | |
| 160526 16:39:52 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:39:55 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:39:55 [Note] WSREP: view(view_id(NON_PRIM,1693a457,1) memb { | |
| 1693a457,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:39:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50332S), skipping check | |
| 160526 16:40:25 [Note] WSREP: view((empty)) | |
| 160526 16:40:25 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:40:25 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:40:25 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:40:25 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:40:25 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:40:25 [ERROR] Aborting | |
| 160526 16:40:25 [Note] WSREP: Service disconnected. | |
| 160526 16:40:26 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:40:26 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:40:26 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:40:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:40:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.FYI0ph' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:40:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:40:29 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:40:29 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:40:29 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:40:29 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:40:29 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:40:29 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:40:29 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:40:29 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:40:29 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:40:29 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:40:29 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:40:29 [Note] WSREP: Start replication | |
| 160526 16:40:29 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:40:29 [Note] WSREP: protonet asio version 0 | |
| 160526 16:40:29 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:40:29 [Note] WSREP: backend: asio | |
| 160526 16:40:29 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:40:29 [Note] WSREP: restore pc from disk failed | |
| 160526 16:40:29 [Note] WSREP: GMCast version 0 | |
| 160526 16:40:29 [Note] WSREP: (2c8c0977, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:40:29 [Note] WSREP: (2c8c0977, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:40:29 [Note] WSREP: EVS version 0 | |
| 160526 16:40:29 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:40:32 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:40:32 [Note] WSREP: view(view_id(NON_PRIM,2c8c0977,1) memb { | |
| 2c8c0977,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:40:32 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50244S), skipping check | |
| 160526 16:41:02 [Note] WSREP: view((empty)) | |
| 160526 16:41:02 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:41:02 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:41:02 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:41:02 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:41:02 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:41:02 [ERROR] Aborting | |
| 160526 16:41:02 [Note] WSREP: Service disconnected. | |
| 160526 16:41:03 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:41:03 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:41:03 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:41:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:41:03 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.Rty9nW' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:41:03 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:41:06 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:41:06 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:41:06 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:41:06 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:41:06 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:41:06 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:41:06 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:41:06 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:41:06 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:41:06 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:41:06 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:41:06 [Note] WSREP: Start replication | |
| 160526 16:41:06 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:41:06 [Note] WSREP: protonet asio version 0 | |
| 160526 16:41:06 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:41:06 [Note] WSREP: backend: asio | |
| 160526 16:41:06 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:41:06 [Note] WSREP: restore pc from disk failed | |
| 160526 16:41:06 [Note] WSREP: GMCast version 0 | |
| 160526 16:41:06 [Note] WSREP: (4287d459, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:41:06 [Note] WSREP: (4287d459, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:41:06 [Note] WSREP: EVS version 0 | |
| 160526 16:41:06 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:41:09 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:41:09 [Note] WSREP: view(view_id(NON_PRIM,4287d459,1) memb { | |
| 4287d459,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:41:09 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50336S), skipping check | |
| 160526 16:41:39 [Note] WSREP: view((empty)) | |
| 160526 16:41:39 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:41:39 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:41:39 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:41:39 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:41:39 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:41:39 [ERROR] Aborting | |
| 160526 16:41:39 [Note] WSREP: Service disconnected. | |
| 160526 16:41:40 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:41:40 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:41:40 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:41:40 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:41:40 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.raEriv' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:41:40 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:41:43 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:41:43 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:41:43 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:41:43 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:41:43 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:41:43 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:41:43 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:41:43 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:41:43 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:41:43 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:41:43 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:41:43 [Note] WSREP: Start replication | |
| 160526 16:41:43 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:41:43 [Note] WSREP: protonet asio version 0 | |
| 160526 16:41:43 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:41:43 [Note] WSREP: backend: asio | |
| 160526 16:41:43 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:41:43 [Note] WSREP: restore pc from disk failed | |
| 160526 16:41:43 [Note] WSREP: GMCast version 0 | |
| 160526 16:41:43 [Note] WSREP: (58855f3a, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:41:43 [Note] WSREP: (58855f3a, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:41:43 [Note] WSREP: EVS version 0 | |
| 160526 16:41:43 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:41:46 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:41:46 [Note] WSREP: view(view_id(NON_PRIM,58855f3a,1) memb { | |
| 58855f3a,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:41:46 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50294S), skipping check | |
| 160526 16:42:16 [Note] WSREP: view((empty)) | |
| 160526 16:42:16 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:42:16 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:42:16 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:42:16 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:42:16 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:42:16 [ERROR] Aborting | |
| 160526 16:42:16 [Note] WSREP: Service disconnected. | |
| 160526 16:42:17 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:42:17 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:42:17 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:42:17 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:42:17 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.t1drmb' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:42:17 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:42:19 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:42:19 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:42:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:42:19 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:42:19 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:42:19 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:42:19 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:42:19 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:42:19 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:42:19 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:42:19 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:42:19 [Note] WSREP: Start replication | |
| 160526 16:42:19 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:42:19 [Note] WSREP: protonet asio version 0 | |
| 160526 16:42:19 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:42:19 [Note] WSREP: backend: asio | |
| 160526 16:42:19 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:42:19 [Note] WSREP: restore pc from disk failed | |
| 160526 16:42:19 [Note] WSREP: GMCast version 0 | |
| 160526 16:42:19 [Note] WSREP: (6e7884e3, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:42:19 [Note] WSREP: (6e7884e3, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:42:19 [Note] WSREP: EVS version 0 | |
| 160526 16:42:19 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:42:22 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:42:22 [Note] WSREP: view(view_id(NON_PRIM,6e7884e3,1) memb { | |
| 6e7884e3,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:42:23 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50201S), skipping check | |
| 160526 16:42:52 [Note] WSREP: view((empty)) | |
| 160526 16:42:52 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:42:52 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:42:52 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:42:52 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:42:52 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:42:52 [ERROR] Aborting | |
| 160526 16:42:52 [Note] WSREP: Service disconnected. | |
| 160526 16:42:53 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:42:53 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:42:53 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:42:54 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:42:54 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.gWDKV1' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:42:54 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 146 ... | |
| 160526 16:42:56 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:42:56 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 178 ... | |
| 160526 16:42:56 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:42:56 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:42:56 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:42:56 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:42:56 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:42:56 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:42:56 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:42:56 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:42:56 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:42:56 [Note] WSREP: Start replication | |
| 160526 16:42:56 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:42:56 [Note] WSREP: protonet asio version 0 | |
| 160526 16:42:56 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:42:56 [Note] WSREP: backend: asio | |
| 160526 16:42:56 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:42:56 [Note] WSREP: restore pc from disk failed | |
| 160526 16:42:56 [Note] WSREP: GMCast version 0 | |
| 160526 16:42:56 [Note] WSREP: (847a2e50, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:42:56 [Note] WSREP: (847a2e50, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:42:56 [Note] WSREP: EVS version 0 | |
| 160526 16:42:56 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:42:59 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:42:59 [Note] WSREP: view(view_id(NON_PRIM,847a2e50,1) memb { | |
| 847a2e50,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:43:00 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50304S), skipping check | |
| 160526 16:43:29 [Note] WSREP: view((empty)) | |
| 160526 16:43:29 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:43:29 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:43:29 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:43:29 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:43:29 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:43:29 [ERROR] Aborting | |
| 160526 16:43:29 [Note] WSREP: Service disconnected. | |
| 160526 16:43:30 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:43:30 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:43:30 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:43:31 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:43:31 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.7aFz63' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:43:31 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:43:33 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:43:33 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:43:33 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:43:33 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:43:33 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:43:33 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:43:33 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:43:33 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:43:33 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:43:33 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:43:33 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:43:33 [Note] WSREP: Start replication | |
| 160526 16:43:33 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:43:33 [Note] WSREP: protonet asio version 0 | |
| 160526 16:43:33 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:43:33 [Note] WSREP: backend: asio | |
| 160526 16:43:33 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:43:33 [Note] WSREP: restore pc from disk failed | |
| 160526 16:43:33 [Note] WSREP: GMCast version 0 | |
| 160526 16:43:33 [Note] WSREP: (9a7799ce, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:43:33 [Note] WSREP: (9a7799ce, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:43:33 [Note] WSREP: EVS version 0 | |
| 160526 16:43:33 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:43:36 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:43:36 [Note] WSREP: view(view_id(NON_PRIM,9a7799ce,1) memb { | |
| 9a7799ce,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:43:37 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50196S), skipping check | |
| 160526 16:44:06 [Note] WSREP: view((empty)) | |
| 160526 16:44:06 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:44:06 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:44:06 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:44:06 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:44:06 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:44:06 [ERROR] Aborting | |
| 160526 16:44:06 [Note] WSREP: Service disconnected. | |
| 160526 16:44:07 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:44:07 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:44:07 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:44:08 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:44:08 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.9ivRPA' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:44:08 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:44:10 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:44:10 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:44:10 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:44:10 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:44:10 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:44:10 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:44:10 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:44:10 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:44:10 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:44:10 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:44:10 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:44:10 [Note] WSREP: Start replication | |
| 160526 16:44:10 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:44:10 [Note] WSREP: protonet asio version 0 | |
| 160526 16:44:10 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:44:10 [Note] WSREP: backend: asio | |
| 160526 16:44:10 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:44:10 [Note] WSREP: restore pc from disk failed | |
| 160526 16:44:10 [Note] WSREP: GMCast version 0 | |
| 160526 16:44:10 [Note] WSREP: (b081a33f, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:44:10 [Note] WSREP: (b081a33f, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:44:10 [Note] WSREP: EVS version 0 | |
| 160526 16:44:10 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:44:13 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:44:13 [Note] WSREP: view(view_id(NON_PRIM,b081a33f,1) memb { | |
| b081a33f,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:44:14 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5022S), skipping check | |
| 160526 16:44:43 [Note] WSREP: view((empty)) | |
| 160526 16:44:43 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:44:43 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:44:43 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:44:43 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:44:43 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:44:43 [ERROR] Aborting | |
| 160526 16:44:43 [Note] WSREP: Service disconnected. | |
| 160526 16:44:44 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:44:44 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:44:44 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:44:45 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:44:45 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.O6IoZD' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:44:45 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:44:47 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:44:47 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:44:47 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:44:47 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:44:47 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:44:47 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:44:47 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:44:47 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:44:47 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:44:47 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:44:47 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:44:47 [Note] WSREP: Start replication | |
| 160526 16:44:47 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:44:47 [Note] WSREP: protonet asio version 0 | |
| 160526 16:44:47 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:44:47 [Note] WSREP: backend: asio | |
| 160526 16:44:47 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:44:47 [Note] WSREP: restore pc from disk failed | |
| 160526 16:44:47 [Note] WSREP: GMCast version 0 | |
| 160526 16:44:47 [Note] WSREP: (c67d00db, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:44:47 [Note] WSREP: (c67d00db, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:44:47 [Note] WSREP: EVS version 0 | |
| 160526 16:44:47 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:44:50 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:44:50 [Note] WSREP: view(view_id(NON_PRIM,c67d00db,1) memb { | |
| c67d00db,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:44:51 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50192S), skipping check | |
| 160526 16:45:20 [Note] WSREP: view((empty)) | |
| 160526 16:45:20 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:45:20 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:45:20 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:45:20 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:45:20 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:45:20 [ERROR] Aborting | |
| 160526 16:45:20 [Note] WSREP: Service disconnected. | |
| 160526 16:45:21 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:45:21 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:45:21 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:45:22 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:45:22 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.VMg4ub' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:45:22 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:45:24 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:45:24 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:45:24 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:45:24 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:45:24 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:45:24 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:45:24 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:45:24 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:45:24 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:45:24 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:45:24 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:45:24 [Note] WSREP: Start replication | |
| 160526 16:45:24 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:45:24 [Note] WSREP: protonet asio version 0 | |
| 160526 16:45:24 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:45:24 [Note] WSREP: backend: asio | |
| 160526 16:45:24 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:45:24 [Note] WSREP: restore pc from disk failed | |
| 160526 16:45:24 [Note] WSREP: GMCast version 0 | |
| 160526 16:45:24 [Note] WSREP: (dc7bb228, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:45:24 [Note] WSREP: (dc7bb228, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:45:24 [Note] WSREP: EVS version 0 | |
| 160526 16:45:24 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:45:27 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:45:27 [Note] WSREP: view(view_id(NON_PRIM,dc7bb228,1) memb { | |
| dc7bb228,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:45:27 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50319S), skipping check | |
| 160526 16:45:57 [Note] WSREP: view((empty)) | |
| 160526 16:45:57 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:45:57 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:45:57 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:45:57 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:45:57 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:45:57 [ERROR] Aborting | |
| 160526 16:45:57 [Note] WSREP: Service disconnected. | |
| 160526 16:45:58 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:45:58 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:45:58 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:45:58 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:45:58 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.Gzvizn' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:45:58 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:46:01 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:46:01 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:46:01 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:46:01 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:46:01 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:46:01 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:46:01 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:46:01 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:46:01 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:46:01 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:46:01 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:46:01 [Note] WSREP: Start replication | |
| 160526 16:46:01 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:46:01 [Note] WSREP: protonet asio version 0 | |
| 160526 16:46:01 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:46:01 [Note] WSREP: backend: asio | |
| 160526 16:46:01 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:46:01 [Note] WSREP: restore pc from disk failed | |
| 160526 16:46:01 [Note] WSREP: GMCast version 0 | |
| 160526 16:46:01 [Note] WSREP: (f27264f3, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:46:01 [Note] WSREP: (f27264f3, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:46:01 [Note] WSREP: EVS version 0 | |
| 160526 16:46:01 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:46:04 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:46:04 [Note] WSREP: view(view_id(NON_PRIM,f27264f3,1) memb { | |
| f27264f3,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:46:04 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50256S), skipping check | |
| 160526 16:46:34 [Note] WSREP: view((empty)) | |
| 160526 16:46:34 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:46:34 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:46:34 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:46:34 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:46:34 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:46:34 [ERROR] Aborting | |
| 160526 16:46:34 [Note] WSREP: Service disconnected. | |
| 160526 16:46:35 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:46:35 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:46:35 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:46:35 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:46:35 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.q3PFi6' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:46:35 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 146 ... | |
| 160526 16:46:38 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:46:38 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 178 ... | |
| 160526 16:46:38 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:46:38 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:46:38 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:46:38 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:46:38 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:46:38 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:46:38 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:46:38 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:46:38 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:46:38 [Note] WSREP: Start replication | |
| 160526 16:46:38 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:46:38 [Note] WSREP: protonet asio version 0 | |
| 160526 16:46:38 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:46:38 [Note] WSREP: backend: asio | |
| 160526 16:46:38 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:46:38 [Note] WSREP: restore pc from disk failed | |
| 160526 16:46:38 [Note] WSREP: GMCast version 0 | |
| 160526 16:46:38 [Note] WSREP: (086db2dd, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:46:38 [Note] WSREP: (086db2dd, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:46:38 [Note] WSREP: EVS version 0 | |
| 160526 16:46:38 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:46:41 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:46:41 [Note] WSREP: view(view_id(NON_PRIM,086db2dd,1) memb { | |
| 086db2dd,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:46:41 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50233S), skipping check | |
| 160526 16:47:11 [Note] WSREP: view((empty)) | |
| 160526 16:47:11 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:47:11 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:47:11 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:47:11 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:47:11 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:47:11 [ERROR] Aborting | |
| 160526 16:47:11 [Note] WSREP: Service disconnected. | |
| 160526 16:47:12 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:47:12 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:47:12 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:47:12 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:47:12 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.m7BQWP' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:47:12 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:47:15 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:47:15 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:47:15 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:47:15 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:47:15 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:47:15 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:47:15 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:47:15 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:47:15 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:47:15 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:47:15 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:47:15 [Note] WSREP: Start replication | |
| 160526 16:47:15 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:47:15 [Note] WSREP: protonet asio version 0 | |
| 160526 16:47:15 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:47:15 [Note] WSREP: backend: asio | |
| 160526 16:47:15 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:47:15 [Note] WSREP: restore pc from disk failed | |
| 160526 16:47:15 [Note] WSREP: GMCast version 0 | |
| 160526 16:47:15 [Note] WSREP: (1e662655, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:47:15 [Note] WSREP: (1e662655, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:47:15 [Note] WSREP: EVS version 0 | |
| 160526 16:47:15 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:47:18 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:47:18 [Note] WSREP: view(view_id(NON_PRIM,1e662655,1) memb { | |
| 1e662655,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:47:18 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50306S), skipping check | |
| 160526 16:47:48 [Note] WSREP: view((empty)) | |
| 160526 16:47:48 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:47:48 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:47:48 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:47:48 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:47:48 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:47:48 [ERROR] Aborting | |
| 160526 16:47:48 [Note] WSREP: Service disconnected. | |
| 160526 16:47:49 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:47:49 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:47:49 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:47:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:47:49 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.TncU0D' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:47:49 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:47:51 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:47:51 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:47:51 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:47:51 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:47:51 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:47:51 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:47:51 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:47:51 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:47:51 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:47:51 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:47:51 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:47:51 [Note] WSREP: Start replication | |
| 160526 16:47:51 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:47:51 [Note] WSREP: protonet asio version 0 | |
| 160526 16:47:51 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:47:51 [Note] WSREP: backend: asio | |
| 160526 16:47:51 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:47:51 [Note] WSREP: restore pc from disk failed | |
| 160526 16:47:51 [Note] WSREP: GMCast version 0 | |
| 160526 16:47:51 [Note] WSREP: (34625472, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:47:51 [Note] WSREP: (34625472, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:47:51 [Note] WSREP: EVS version 0 | |
| 160526 16:47:51 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:47:54 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:47:54 [Note] WSREP: view(view_id(NON_PRIM,34625472,1) memb { | |
| 34625472,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:47:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50307S), skipping check | |
| 160526 16:48:24 [Note] WSREP: view((empty)) | |
| 160526 16:48:24 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:48:24 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:48:24 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:48:24 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:48:24 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:48:24 [ERROR] Aborting | |
| 160526 16:48:24 [Note] WSREP: Service disconnected. | |
| 160526 16:48:25 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:48:25 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:48:25 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:48:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:48:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.coUg1v' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:48:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:48:28 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:48:28 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:48:28 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:48:28 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:48:28 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:48:28 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:48:28 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:48:28 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:48:28 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:48:28 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:48:28 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:48:28 [Note] WSREP: Start replication | |
| 160526 16:48:28 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:48:28 [Note] WSREP: protonet asio version 0 | |
| 160526 16:48:28 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:48:28 [Note] WSREP: backend: asio | |
| 160526 16:48:28 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:48:28 [Note] WSREP: restore pc from disk failed | |
| 160526 16:48:28 [Note] WSREP: GMCast version 0 | |
| 160526 16:48:28 [Note] WSREP: (4a63a5cc, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:48:28 [Note] WSREP: (4a63a5cc, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:48:28 [Note] WSREP: EVS version 0 | |
| 160526 16:48:28 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:48:31 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:48:31 [Note] WSREP: view(view_id(NON_PRIM,4a63a5cc,1) memb { | |
| 4a63a5cc,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:48:32 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50198S), skipping check | |
| 160526 16:49:01 [Note] WSREP: view((empty)) | |
| 160526 16:49:01 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:49:01 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:49:01 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:49:01 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:49:01 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:49:01 [ERROR] Aborting | |
| 160526 16:49:01 [Note] WSREP: Service disconnected. | |
| 160526 16:49:02 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:49:02 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:49:02 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:49:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:49:03 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.IX0iPz' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:49:03 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:49:05 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:49:05 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:49:05 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:49:05 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:49:05 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:49:05 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:49:05 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:49:05 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:49:05 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:49:05 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:49:05 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:49:05 [Note] WSREP: Start replication | |
| 160526 16:49:05 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:49:05 [Note] WSREP: protonet asio version 0 | |
| 160526 16:49:05 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:49:05 [Note] WSREP: backend: asio | |
| 160526 16:49:05 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:49:05 [Note] WSREP: restore pc from disk failed | |
| 160526 16:49:05 [Note] WSREP: GMCast version 0 | |
| 160526 16:49:05 [Note] WSREP: (60584b01, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:49:05 [Note] WSREP: (60584b01, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:49:05 [Note] WSREP: EVS version 0 | |
| 160526 16:49:05 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:49:08 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:49:08 [Note] WSREP: view(view_id(NON_PRIM,60584b01,1) memb { | |
| 60584b01,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:49:09 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50234S), skipping check | |
| 160526 16:49:38 [Note] WSREP: view((empty)) | |
| 160526 16:49:38 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:49:38 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:49:38 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:49:38 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:49:38 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:49:38 [ERROR] Aborting | |
| 160526 16:49:38 [Note] WSREP: Service disconnected. | |
| 160526 16:49:39 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:49:39 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:49:39 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:49:40 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:49:40 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.PpcZ3D' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:49:40 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:49:42 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:49:42 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:49:42 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:49:42 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:49:42 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:49:42 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:49:42 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:49:42 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:49:42 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:49:42 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:49:42 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:49:42 [Note] WSREP: Start replication | |
| 160526 16:49:42 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:49:42 [Note] WSREP: protonet asio version 0 | |
| 160526 16:49:42 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:49:42 [Note] WSREP: backend: asio | |
| 160526 16:49:42 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:49:42 [Note] WSREP: restore pc from disk failed | |
| 160526 16:49:42 [Note] WSREP: GMCast version 0 | |
| 160526 16:49:42 [Note] WSREP: (76593223, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:49:42 [Note] WSREP: (76593223, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:49:42 [Note] WSREP: EVS version 0 | |
| 160526 16:49:42 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:49:45 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:49:45 [Note] WSREP: view(view_id(NON_PRIM,76593223,1) memb { | |
| 76593223,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:49:46 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50295S), skipping check | |
| 160526 16:50:15 [Note] WSREP: view((empty)) | |
| 160526 16:50:15 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 16:50:15 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 16:50:15 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 16:50:15 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 16:50:15 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 16:50:15 [ERROR] Aborting | |
| 160526 16:50:15 [Note] WSREP: Service disconnected. | |
| 160526 16:50:16 [Note] WSREP: Some threads may fail to exit. | |
| 160526 16:50:16 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 16:50:16 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 16:50:17 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 16:50:17 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.oy5MGd' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 16:50:17 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 16:50:19 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:50:19 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 16:50:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 16:50:19 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 16:50:19 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 16:50:19 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 16:50:19 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 16:50:19 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 16:50:19 [Note] WSREP: Service thread queue flushed. | |
| 160526 16:50:19 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 16:50:19 [Note] WSREP: wsrep_sst_grab() | |
| 160526 16:50:19 [Note] WSREP: Start replication | |
| 160526 16:50:19 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 16:50:19 [Note] WSREP: protonet asio version 0 | |
| 160526 16:50:19 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 16:50:19 [Note] WSREP: backend: asio | |
| 160526 16:50:19 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 16:50:19 [Note] WSREP: restore pc from disk failed | |
| 160526 16:50:19 [Note] WSREP: GMCast version 0 | |
| 160526 16:50:19 [Note] WSREP: (8c4dfffd, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 16:50:19 [Note] WSREP: (8c4dfffd, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 16:50:19 [Note] WSREP: EVS version 0 | |
| 160526 16:50:19 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 16:50:22 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 16:50:22 [Note] WSREP: view(view_id(NON_PRIM,8c4dfffd,1) memb { | |
| 8c4dfffd,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 16:50:22 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50266S), skipping check | |
| 160526 17:00:31 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:00:31 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.Vo5PFU' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:00:31 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:00:34 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:00:34 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:00:34 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:00:34 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:00:34 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:00:34 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:00:34 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:00:34 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:00:34 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:00:34 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:00:34 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:00:34 [Note] WSREP: Start replication | |
| 160526 17:00:34 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:00:34 [Note] WSREP: protonet asio version 0 | |
| 160526 17:00:34 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:00:34 [Note] WSREP: backend: asio | |
| 160526 17:00:34 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:00:34 [Note] WSREP: restore pc from disk failed | |
| 160526 17:00:34 [Note] WSREP: GMCast version 0 | |
| 160526 17:00:34 [Note] WSREP: (fab2e579, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:00:34 [Note] WSREP: (fab2e579, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:00:34 [Note] WSREP: EVS version 0 | |
| 160526 17:00:34 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:00:37 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:00:37 [Note] WSREP: view(view_id(NON_PRIM,fab2e579,1) memb { | |
| fab2e579,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:00:37 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5037S), skipping check | |
| 160526 17:01:07 [Note] WSREP: view((empty)) | |
| 160526 17:01:07 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:01:07 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:01:07 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:01:07 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:01:07 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:01:07 [ERROR] Aborting | |
| 160526 17:01:07 [Note] WSREP: Service disconnected. | |
| 160526 17:01:08 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:01:08 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:01:08 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:01:08 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:01:08 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.kERRuz' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:01:08 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:01:10 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:01:10 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:01:11 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:01:11 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:01:11 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:01:11 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:01:11 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:01:11 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:01:11 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:01:11 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:01:11 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:01:11 [Note] WSREP: Start replication | |
| 160526 17:01:11 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:01:11 [Note] WSREP: protonet asio version 0 | |
| 160526 17:01:11 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:01:11 [Note] WSREP: backend: asio | |
| 160526 17:01:11 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:01:11 [Note] WSREP: restore pc from disk failed | |
| 160526 17:01:11 [Note] WSREP: GMCast version 0 | |
| 160526 17:01:11 [Note] WSREP: (10ae7ac8, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:01:11 [Note] WSREP: (10ae7ac8, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:01:11 [Note] WSREP: EVS version 0 | |
| 160526 17:01:11 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:01:14 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:01:14 [Note] WSREP: view(view_id(NON_PRIM,10ae7ac8,1) memb { | |
| 10ae7ac8,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:01:14 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50288S), skipping check | |
| 160526 17:01:44 [Note] WSREP: view((empty)) | |
| 160526 17:01:44 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:01:44 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:01:44 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:01:44 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:01:44 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:01:44 [ERROR] Aborting | |
| 160526 17:01:44 [Note] WSREP: Service disconnected. | |
| 160526 17:01:45 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:01:45 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:01:45 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:01:45 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:01:45 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.VLkpbC' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:01:45 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:01:47 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:01:47 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:01:47 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:01:47 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:01:47 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:01:47 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:01:47 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:01:47 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:01:47 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:01:47 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:01:47 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:01:47 [Note] WSREP: Start replication | |
| 160526 17:01:47 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:01:47 [Note] WSREP: protonet asio version 0 | |
| 160526 17:01:47 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:01:47 [Note] WSREP: backend: asio | |
| 160526 17:01:47 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:01:47 [Note] WSREP: restore pc from disk failed | |
| 160526 17:01:47 [Note] WSREP: GMCast version 0 | |
| 160526 17:01:47 [Note] WSREP: (26ac953d, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:01:47 [Note] WSREP: (26ac953d, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:01:47 [Note] WSREP: EVS version 0 | |
| 160526 17:01:47 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:01:50 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:01:50 [Note] WSREP: view(view_id(NON_PRIM,26ac953d,1) memb { | |
| 26ac953d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:01:51 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50299S), skipping check | |
| 160526 17:02:20 [Note] WSREP: view((empty)) | |
| 160526 17:02:20 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:02:20 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:02:20 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:02:20 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:02:20 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:02:20 [ERROR] Aborting | |
| 160526 17:02:20 [Note] WSREP: Service disconnected. | |
| 160526 17:02:21 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:02:21 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:02:21 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:02:22 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:02:22 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.WCKYZ4' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:02:22 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:02:24 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:02:24 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:02:24 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:02:24 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:02:24 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:02:24 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:02:24 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:02:24 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:02:24 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:02:24 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:02:24 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:02:24 [Note] WSREP: Start replication | |
| 160526 17:02:24 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:02:24 [Note] WSREP: protonet asio version 0 | |
| 160526 17:02:24 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:02:24 [Note] WSREP: backend: asio | |
| 160526 17:02:24 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:02:24 [Note] WSREP: restore pc from disk failed | |
| 160526 17:02:24 [Note] WSREP: GMCast version 0 | |
| 160526 17:02:24 [Note] WSREP: (3ca396cc, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:02:24 [Note] WSREP: (3ca396cc, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:02:24 [Note] WSREP: EVS version 0 | |
| 160526 17:02:24 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:02:27 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:02:27 [Note] WSREP: view(view_id(NON_PRIM,3ca396cc,1) memb { | |
| 3ca396cc,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:02:28 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50257S), skipping check | |
| 160526 17:02:57 [Note] WSREP: view((empty)) | |
| 160526 17:02:57 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:02:57 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:02:57 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:02:57 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:02:57 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:02:57 [ERROR] Aborting | |
| 160526 17:02:57 [Note] WSREP: Service disconnected. | |
| 160526 17:02:58 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:02:58 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:02:58 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:02:59 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:02:59 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.eERQhW' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:02:59 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:03:01 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:03:01 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:03:01 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:03:01 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:03:01 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:03:01 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:03:01 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:03:01 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:03:01 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:03:01 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:03:01 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:03:01 [Note] WSREP: Start replication | |
| 160526 17:03:01 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:03:01 [Note] WSREP: protonet asio version 0 | |
| 160526 17:03:01 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:03:01 [Note] WSREP: backend: asio | |
| 160526 17:03:01 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:03:01 [Note] WSREP: restore pc from disk failed | |
| 160526 17:03:01 [Note] WSREP: GMCast version 0 | |
| 160526 17:03:01 [Note] WSREP: (5298fc2d, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:03:01 [Note] WSREP: (5298fc2d, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:03:01 [Note] WSREP: EVS version 0 | |
| 160526 17:03:01 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:03:04 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:03:04 [Note] WSREP: view(view_id(NON_PRIM,5298fc2d,1) memb { | |
| 5298fc2d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:03:05 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50222S), skipping check | |
| 160526 17:03:34 [Note] WSREP: view((empty)) | |
| 160526 17:03:34 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:03:34 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:03:34 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:03:34 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:03:34 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:03:34 [ERROR] Aborting | |
| 160526 17:03:34 [Note] WSREP: Service disconnected. | |
| 160526 17:03:35 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:03:35 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:03:35 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:03:36 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:03:36 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.X9ZEjh' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:03:36 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:03:38 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:03:38 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:03:38 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:03:38 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:03:38 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:03:38 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:03:38 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:03:38 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:03:38 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:03:38 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:03:38 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:03:38 [Note] WSREP: Start replication | |
| 160526 17:03:38 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:03:38 [Note] WSREP: protonet asio version 0 | |
| 160526 17:03:38 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:03:38 [Note] WSREP: backend: asio | |
| 160526 17:03:38 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:03:38 [Note] WSREP: restore pc from disk failed | |
| 160526 17:03:38 [Note] WSREP: GMCast version 0 | |
| 160526 17:03:38 [Note] WSREP: (689526ce, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:03:38 [Note] WSREP: (689526ce, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:03:38 [Note] WSREP: EVS version 0 | |
| 160526 17:03:38 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:03:41 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:03:41 [Note] WSREP: view(view_id(NON_PRIM,689526ce,1) memb { | |
| 689526ce,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:03:42 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50282S), skipping check | |
| 160526 17:04:11 [Note] WSREP: view((empty)) | |
| 160526 17:04:11 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:04:11 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:04:11 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:04:11 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:04:11 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:04:11 [ERROR] Aborting | |
| 160526 17:04:11 [Note] WSREP: Service disconnected. | |
| 160526 17:04:12 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:04:12 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:04:12 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:04:12 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:04:12 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.E1sPp2' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:04:12 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:04:15 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:04:15 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:04:15 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:04:15 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:04:15 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:04:15 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:04:15 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:04:15 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:04:15 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:04:15 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:04:15 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:04:15 [Note] WSREP: Start replication | |
| 160526 17:04:15 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:04:15 [Note] WSREP: protonet asio version 0 | |
| 160526 17:04:15 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:04:15 [Note] WSREP: backend: asio | |
| 160526 17:04:15 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:04:15 [Note] WSREP: restore pc from disk failed | |
| 160526 17:04:15 [Note] WSREP: GMCast version 0 | |
| 160526 17:04:15 [Note] WSREP: (7e8a2861, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:04:15 [Note] WSREP: (7e8a2861, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:04:15 [Note] WSREP: EVS version 0 | |
| 160526 17:04:15 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:04:18 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:04:18 [Note] WSREP: view(view_id(NON_PRIM,7e8a2861,1) memb { | |
| 7e8a2861,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:04:18 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50239S), skipping check | |
| 160526 17:04:48 [Note] WSREP: view((empty)) | |
| 160526 17:04:48 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:04:48 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:04:48 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:04:48 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:04:48 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:04:48 [ERROR] Aborting | |
| 160526 17:04:48 [Note] WSREP: Service disconnected. | |
| 160526 17:04:49 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:04:49 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:04:49 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:04:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:04:49 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.PrPiXf' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:04:49 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:04:52 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:04:52 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:04:52 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:04:52 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:04:52 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:04:52 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:04:52 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:04:52 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:04:52 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:04:52 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:04:52 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:04:52 [Note] WSREP: Start replication | |
| 160526 17:04:52 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:04:52 [Note] WSREP: protonet asio version 0 | |
| 160526 17:04:52 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:04:52 [Note] WSREP: backend: asio | |
| 160526 17:04:52 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:04:52 [Note] WSREP: restore pc from disk failed | |
| 160526 17:04:52 [Note] WSREP: GMCast version 0 | |
| 160526 17:04:52 [Note] WSREP: (9486cd86, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:04:52 [Note] WSREP: (9486cd86, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:04:52 [Note] WSREP: EVS version 0 | |
| 160526 17:04:52 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:04:55 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:04:55 [Note] WSREP: view(view_id(NON_PRIM,9486cd86,1) memb { | |
| 9486cd86,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:04:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50297S), skipping check | |
| 160526 17:05:25 [Note] WSREP: view((empty)) | |
| 160526 17:05:25 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:05:25 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:05:25 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:05:25 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:05:25 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:05:25 [ERROR] Aborting | |
| 160526 17:05:25 [Note] WSREP: Service disconnected. | |
| 160526 17:05:26 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:05:26 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:05:26 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:05:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:05:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.dw91eO' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:05:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:05:29 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:05:29 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:05:29 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:05:29 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:05:29 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:05:29 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:05:29 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:05:29 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:05:29 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:05:29 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:05:29 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:05:29 [Note] WSREP: Start replication | |
| 160526 17:05:29 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:05:29 [Note] WSREP: protonet asio version 0 | |
| 160526 17:05:29 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:05:29 [Note] WSREP: backend: asio | |
| 160526 17:05:29 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:05:29 [Note] WSREP: restore pc from disk failed | |
| 160526 17:05:29 [Note] WSREP: GMCast version 0 | |
| 160526 17:05:29 [Note] WSREP: (aa7f867f, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:05:29 [Note] WSREP: (aa7f867f, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:05:29 [Note] WSREP: EVS version 0 | |
| 160526 17:05:29 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:05:32 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:05:32 [Note] WSREP: view(view_id(NON_PRIM,aa7f867f,1) memb { | |
| aa7f867f,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:05:32 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50315S), skipping check | |
| 160526 17:06:02 [Note] WSREP: view((empty)) | |
| 160526 17:06:02 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:06:02 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:06:02 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:06:02 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:06:02 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:06:02 [ERROR] Aborting | |
| 160526 17:06:02 [Note] WSREP: Service disconnected. | |
| 160526 17:06:03 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:06:03 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:06:03 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:06:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:06:03 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.7BWGao' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:06:03 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:06:05 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:06:06 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:06:06 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:06:06 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:06:06 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:06:06 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:06:06 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:06:06 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:06:06 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:06:06 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:06:06 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:06:06 [Note] WSREP: Start replication | |
| 160526 17:06:06 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:06:06 [Note] WSREP: protonet asio version 0 | |
| 160526 17:06:06 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:06:06 [Note] WSREP: backend: asio | |
| 160526 17:06:06 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:06:06 [Note] WSREP: restore pc from disk failed | |
| 160526 17:06:06 [Note] WSREP: GMCast version 0 | |
| 160526 17:06:06 [Note] WSREP: (c0853645, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:06:06 [Note] WSREP: (c0853645, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:06:06 [Note] WSREP: EVS version 0 | |
| 160526 17:06:06 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:06:09 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:06:09 [Note] WSREP: view(view_id(NON_PRIM,c0853645,1) memb { | |
| c0853645,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:06:09 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50294S), skipping check | |
| 160526 17:06:39 [Note] WSREP: view((empty)) | |
| 160526 17:06:39 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:06:39 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:06:39 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:06:39 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:06:39 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:06:39 [ERROR] Aborting | |
| 160526 17:06:39 [Note] WSREP: Service disconnected. | |
| 160526 17:06:40 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:06:40 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:06:40 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:06:40 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:06:40 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.kYJIBI' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:06:40 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:06:42 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:06:42 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:06:42 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:06:42 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:06:42 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:06:42 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:06:42 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:06:42 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:06:42 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:06:42 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:06:42 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:06:42 [Note] WSREP: Start replication | |
| 160526 17:06:42 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:06:42 [Note] WSREP: protonet asio version 0 | |
| 160526 17:06:42 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:06:42 [Note] WSREP: backend: asio | |
| 160526 17:06:42 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:06:42 [Note] WSREP: restore pc from disk failed | |
| 160526 17:06:42 [Note] WSREP: GMCast version 0 | |
| 160526 17:06:42 [Note] WSREP: (d67d7495, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:06:42 [Note] WSREP: (d67d7495, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:06:42 [Note] WSREP: EVS version 0 | |
| 160526 17:06:42 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:06:45 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:06:45 [Note] WSREP: view(view_id(NON_PRIM,d67d7495,1) memb { | |
| d67d7495,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:06:46 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50238S), skipping check | |
| 160526 17:07:15 [Note] WSREP: view((empty)) | |
| 160526 17:07:15 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:07:15 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:07:15 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:07:15 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:07:15 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:07:15 [ERROR] Aborting | |
| 160526 17:07:15 [Note] WSREP: Service disconnected. | |
| 160526 17:07:16 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:07:16 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:07:16 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:07:17 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:07:17 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.6iQxr0' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:07:17 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:07:19 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:07:19 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:07:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:07:19 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:07:19 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:07:19 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:07:19 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:07:19 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:07:19 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:07:19 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:07:19 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:07:19 [Note] WSREP: Start replication | |
| 160526 17:07:19 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:07:19 [Note] WSREP: protonet asio version 0 | |
| 160526 17:07:19 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:07:19 [Note] WSREP: backend: asio | |
| 160526 17:07:19 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:07:19 [Note] WSREP: restore pc from disk failed | |
| 160526 17:07:19 [Note] WSREP: GMCast version 0 | |
| 160526 17:07:19 [Note] WSREP: (ec81d55c, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:07:19 [Note] WSREP: (ec81d55c, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:07:19 [Note] WSREP: EVS version 0 | |
| 160526 17:07:19 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:07:22 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:07:22 [Note] WSREP: view(view_id(NON_PRIM,ec81d55c,1) memb { | |
| ec81d55c,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:07:23 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5029S), skipping check | |
| 160526 17:07:52 [Note] WSREP: view((empty)) | |
| 160526 17:07:52 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:07:52 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:07:52 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:07:52 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:07:52 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:07:52 [ERROR] Aborting | |
| 160526 17:07:52 [Note] WSREP: Service disconnected. | |
| 160526 17:07:53 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:07:53 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:07:53 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:07:54 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:07:54 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.7bLTcE' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:07:54 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:07:56 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:07:56 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:07:56 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:07:56 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:07:56 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:07:56 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:07:56 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:07:56 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:07:56 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:07:56 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:07:56 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:07:56 [Note] WSREP: Start replication | |
| 160526 17:07:56 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:07:56 [Note] WSREP: protonet asio version 0 | |
| 160526 17:07:56 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:07:56 [Note] WSREP: backend: asio | |
| 160526 17:07:56 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:07:56 [Note] WSREP: restore pc from disk failed | |
| 160526 17:07:56 [Note] WSREP: GMCast version 0 | |
| 160526 17:07:56 [Note] WSREP: (02800a00, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:07:56 [Note] WSREP: (02800a00, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:07:56 [Note] WSREP: EVS version 0 | |
| 160526 17:07:56 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:07:59 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:07:59 [Note] WSREP: view(view_id(NON_PRIM,02800a00,1) memb { | |
| 02800a00,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:08:00 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50301S), skipping check | |
| 160526 17:08:29 [Note] WSREP: view((empty)) | |
| 160526 17:08:29 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:08:29 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:08:29 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:08:29 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:08:29 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:08:29 [ERROR] Aborting | |
| 160526 17:08:29 [Note] WSREP: Service disconnected. | |
| 160526 17:08:30 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:08:30 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:08:30 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:08:31 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:08:31 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.pvPyzd' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:08:31 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:08:33 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:08:33 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:08:33 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:08:33 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:08:33 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:08:33 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:08:33 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:08:33 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:08:33 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:08:33 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:08:33 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:08:33 [Note] WSREP: Start replication | |
| 160526 17:08:33 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:08:33 [Note] WSREP: protonet asio version 0 | |
| 160526 17:08:33 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:08:33 [Note] WSREP: backend: asio | |
| 160526 17:08:33 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:08:33 [Note] WSREP: restore pc from disk failed | |
| 160526 17:08:33 [Note] WSREP: GMCast version 0 | |
| 160526 17:08:33 [Note] WSREP: (187a0cbf, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:08:33 [Note] WSREP: (187a0cbf, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:08:33 [Note] WSREP: EVS version 0 | |
| 160526 17:08:33 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:08:36 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:08:36 [Note] WSREP: view(view_id(NON_PRIM,187a0cbf,1) memb { | |
| 187a0cbf,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:08:37 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50352S), skipping check | |
| 160526 17:09:06 [Note] WSREP: view((empty)) | |
| 160526 17:09:06 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:09:06 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:09:06 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:09:06 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:09:06 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:09:06 [ERROR] Aborting | |
| 160526 17:09:06 [Note] WSREP: Service disconnected. | |
| 160526 17:09:07 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:09:07 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:09:07 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:09:08 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:09:08 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.BfSsHS' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:09:08 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:09:10 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:09:10 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:09:10 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:09:10 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:09:10 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:09:10 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:09:10 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:09:10 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:09:10 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:09:10 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:09:10 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:09:10 [Note] WSREP: Start replication | |
| 160526 17:09:10 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:09:10 [Note] WSREP: protonet asio version 0 | |
| 160526 17:09:10 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:09:10 [Note] WSREP: backend: asio | |
| 160526 17:09:10 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:09:10 [Note] WSREP: restore pc from disk failed | |
| 160526 17:09:10 [Note] WSREP: GMCast version 0 | |
| 160526 17:09:10 [Note] WSREP: (2e726513, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:09:10 [Note] WSREP: (2e726513, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:09:10 [Note] WSREP: EVS version 0 | |
| 160526 17:09:10 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:09:13 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:09:13 [Note] WSREP: view(view_id(NON_PRIM,2e726513,1) memb { | |
| 2e726513,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:09:13 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50251S), skipping check | |
| 160526 17:09:43 [Note] WSREP: view((empty)) | |
| 160526 17:09:43 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:09:43 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:09:43 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:09:43 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:09:43 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:09:43 [ERROR] Aborting | |
| 160526 17:09:43 [Note] WSREP: Service disconnected. | |
| 160526 17:09:44 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:09:44 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:09:44 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:09:44 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:09:44 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.2ZtTbv' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:09:44 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:09:47 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:09:47 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:09:47 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:09:47 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:09:47 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:09:47 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:09:47 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:09:47 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:09:47 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:09:47 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:09:47 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:09:47 [Note] WSREP: Start replication | |
| 160526 17:09:47 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:09:47 [Note] WSREP: protonet asio version 0 | |
| 160526 17:09:47 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:09:47 [Note] WSREP: backend: asio | |
| 160526 17:09:47 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:09:47 [Note] WSREP: restore pc from disk failed | |
| 160526 17:09:47 [Note] WSREP: GMCast version 0 | |
| 160526 17:09:47 [Note] WSREP: (446e2d25, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:09:47 [Note] WSREP: (446e2d25, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:09:47 [Note] WSREP: EVS version 0 | |
| 160526 17:09:47 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:09:50 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:09:50 [Note] WSREP: view(view_id(NON_PRIM,446e2d25,1) memb { | |
| 446e2d25,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:09:50 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50301S), skipping check | |
| 160526 17:10:20 [Note] WSREP: view((empty)) | |
| 160526 17:10:20 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:10:20 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:10:20 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:10:20 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:10:20 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:10:20 [ERROR] Aborting | |
| 160526 17:10:20 [Note] WSREP: Service disconnected. | |
| 160526 17:10:21 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:10:21 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:10:21 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:10:21 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:10:21 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.jow6ru' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:10:21 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:10:24 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:10:24 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:10:24 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:10:24 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:10:24 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:10:24 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:10:24 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:10:24 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:10:24 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:10:24 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:10:24 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:10:24 [Note] WSREP: Start replication | |
| 160526 17:10:24 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:10:24 [Note] WSREP: protonet asio version 0 | |
| 160526 17:10:24 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:10:24 [Note] WSREP: backend: asio | |
| 160526 17:10:24 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:10:24 [Note] WSREP: restore pc from disk failed | |
| 160526 17:10:24 [Note] WSREP: GMCast version 0 | |
| 160526 17:10:24 [Note] WSREP: (5a6db091, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:10:24 [Note] WSREP: (5a6db091, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:10:24 [Note] WSREP: EVS version 0 | |
| 160526 17:10:24 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:10:27 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:10:27 [Note] WSREP: view(view_id(NON_PRIM,5a6db091,1) memb { | |
| 5a6db091,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:10:27 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.502S), skipping check | |
| 160526 17:10:57 [Note] WSREP: view((empty)) | |
| 160526 17:10:57 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:10:57 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:10:57 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:10:57 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:10:57 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:10:57 [ERROR] Aborting | |
| 160526 17:10:57 [Note] WSREP: Service disconnected. | |
| 160526 17:10:58 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:10:58 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:10:58 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:10:58 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:10:58 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.g6JVtu' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:10:58 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:11:01 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:11:01 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:11:01 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:11:01 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:11:01 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:11:01 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:11:01 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:11:01 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:11:01 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:11:01 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:11:01 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:11:01 [Note] WSREP: Start replication | |
| 160526 17:11:01 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:11:01 [Note] WSREP: protonet asio version 0 | |
| 160526 17:11:01 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:11:01 [Note] WSREP: backend: asio | |
| 160526 17:11:01 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:11:01 [Note] WSREP: restore pc from disk failed | |
| 160526 17:11:01 [Note] WSREP: GMCast version 0 | |
| 160526 17:11:01 [Note] WSREP: (70690d07, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:11:01 [Note] WSREP: (70690d07, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:11:01 [Note] WSREP: EVS version 0 | |
| 160526 17:11:01 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:11:04 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:11:04 [Note] WSREP: view(view_id(NON_PRIM,70690d07,1) memb { | |
| 70690d07,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:11:04 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5026S), skipping check | |
| 160526 17:11:34 [Note] WSREP: view((empty)) | |
| 160526 17:11:34 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:11:34 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:11:34 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:11:34 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:11:34 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:11:34 [ERROR] Aborting | |
| 160526 17:11:34 [Note] WSREP: Service disconnected. | |
| 160526 17:11:35 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:11:35 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:11:35 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:11:35 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:11:35 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.b7AyAn' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:11:35 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:11:37 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:11:37 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:11:37 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:11:37 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:11:37 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:11:37 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:11:37 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:11:37 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:11:38 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:11:38 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:11:38 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:11:38 [Note] WSREP: Start replication | |
| 160526 17:11:38 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:11:38 [Note] WSREP: protonet asio version 0 | |
| 160526 17:11:38 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:11:38 [Note] WSREP: backend: asio | |
| 160526 17:11:38 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:11:38 [Note] WSREP: restore pc from disk failed | |
| 160526 17:11:38 [Note] WSREP: GMCast version 0 | |
| 160526 17:11:38 [Note] WSREP: (86637910, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:11:38 [Note] WSREP: (86637910, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:11:38 [Note] WSREP: EVS version 0 | |
| 160526 17:11:38 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:11:41 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:11:41 [Note] WSREP: view(view_id(NON_PRIM,86637910,1) memb { | |
| 86637910,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:11:41 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50347S), skipping check | |
| 160526 17:12:11 [Note] WSREP: view((empty)) | |
| 160526 17:12:11 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:12:11 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:12:11 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:12:11 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:12:11 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:12:11 [ERROR] Aborting | |
| 160526 17:12:11 [Note] WSREP: Service disconnected. | |
| 160526 17:12:12 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:12:12 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:12:12 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:12:12 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:12:12 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.hC5dxL' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:12:12 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:12:14 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:12:14 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:12:14 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:12:14 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:12:14 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:12:14 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:12:14 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:12:14 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:12:14 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:12:14 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:12:14 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:12:14 [Note] WSREP: Start replication | |
| 160526 17:12:14 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:12:14 [Note] WSREP: protonet asio version 0 | |
| 160526 17:12:14 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:12:14 [Note] WSREP: backend: asio | |
| 160526 17:12:14 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:12:14 [Note] WSREP: restore pc from disk failed | |
| 160526 17:12:14 [Note] WSREP: GMCast version 0 | |
| 160526 17:12:14 [Note] WSREP: (9c631ed7, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:12:14 [Note] WSREP: (9c631ed7, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:12:14 [Note] WSREP: EVS version 0 | |
| 160526 17:12:14 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:12:17 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:12:17 [Note] WSREP: view(view_id(NON_PRIM,9c631ed7,1) memb { | |
| 9c631ed7,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:12:18 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50268S), skipping check | |
| 160526 17:12:47 [Note] WSREP: view((empty)) | |
| 160526 17:12:47 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:12:47 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:12:47 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:12:47 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:12:47 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:12:47 [ERROR] Aborting | |
| 160526 17:12:47 [Note] WSREP: Service disconnected. | |
| 160526 17:12:48 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:12:48 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:12:48 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:12:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:12:49 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.hIJwhA' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:12:49 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:12:51 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:12:51 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:12:51 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:12:51 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:12:51 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:12:51 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:12:51 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:12:51 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:12:51 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:12:51 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:12:51 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:12:51 [Note] WSREP: Start replication | |
| 160526 17:12:51 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:12:51 [Note] WSREP: protonet asio version 0 | |
| 160526 17:12:51 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:12:51 [Note] WSREP: backend: asio | |
| 160526 17:12:51 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:12:51 [Note] WSREP: restore pc from disk failed | |
| 160526 17:12:51 [Note] WSREP: GMCast version 0 | |
| 160526 17:12:51 [Note] WSREP: (b25da5cf, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:12:51 [Note] WSREP: (b25da5cf, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:12:51 [Note] WSREP: EVS version 0 | |
| 160526 17:12:51 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:12:54 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:12:54 [Note] WSREP: view(view_id(NON_PRIM,b25da5cf,1) memb { | |
| b25da5cf,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:12:55 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50214S), skipping check | |
| 160526 17:13:24 [Note] WSREP: view((empty)) | |
| 160526 17:13:24 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:13:24 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:13:24 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:13:24 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:13:24 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:13:24 [ERROR] Aborting | |
| 160526 17:13:24 [Note] WSREP: Service disconnected. | |
| 160526 17:13:25 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:13:25 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:13:25 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:13:26 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:13:26 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.xM0G5T' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:13:26 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:13:28 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:13:28 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:13:28 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:13:28 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:13:28 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:13:28 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:13:28 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:13:28 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:13:28 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:13:28 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:13:28 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:13:28 [Note] WSREP: Start replication | |
| 160526 17:13:28 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:13:28 [Note] WSREP: protonet asio version 0 | |
| 160526 17:13:28 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:13:28 [Note] WSREP: backend: asio | |
| 160526 17:13:28 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:13:28 [Note] WSREP: restore pc from disk failed | |
| 160526 17:13:28 [Note] WSREP: GMCast version 0 | |
| 160526 17:13:28 [Note] WSREP: (c85e1a19, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:13:28 [Note] WSREP: (c85e1a19, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:13:28 [Note] WSREP: EVS version 0 | |
| 160526 17:13:28 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:13:31 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:13:31 [Note] WSREP: view(view_id(NON_PRIM,c85e1a19,1) memb { | |
| c85e1a19,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:13:32 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50303S), skipping check | |
| 160526 17:14:01 [Note] WSREP: view((empty)) | |
| 160526 17:14:01 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:14:01 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:14:01 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:14:01 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:14:01 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:14:01 [ERROR] Aborting | |
| 160526 17:14:01 [Note] WSREP: Service disconnected. | |
| 160526 17:14:02 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:14:02 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:14:02 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:14:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:14:03 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.2gm1Dj' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:14:03 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:14:05 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:14:05 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:14:05 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:14:05 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:14:05 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:14:05 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:14:05 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:14:05 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:14:05 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:14:05 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:14:05 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:14:05 [Note] WSREP: Start replication | |
| 160526 17:14:05 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:14:05 [Note] WSREP: protonet asio version 0 | |
| 160526 17:14:05 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:14:05 [Note] WSREP: backend: asio | |
| 160526 17:14:05 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:14:05 [Note] WSREP: restore pc from disk failed | |
| 160526 17:14:05 [Note] WSREP: GMCast version 0 | |
| 160526 17:14:05 [Note] WSREP: (de5a9dad, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:14:05 [Note] WSREP: (de5a9dad, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:14:05 [Note] WSREP: EVS version 0 | |
| 160526 17:14:05 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:14:08 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:14:08 [Note] WSREP: view(view_id(NON_PRIM,de5a9dad,1) memb { | |
| de5a9dad,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:14:09 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50236S), skipping check | |
| 160526 17:14:38 [Note] WSREP: view((empty)) | |
| 160526 17:14:38 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:14:38 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:14:38 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:14:38 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:14:38 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:14:38 [ERROR] Aborting | |
| 160526 17:14:38 [Note] WSREP: Service disconnected. | |
| 160526 17:14:39 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:14:39 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:14:39 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:14:40 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:14:40 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.1gtTCn' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:14:40 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:14:42 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:14:42 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:14:42 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:14:42 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:14:42 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:14:42 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:14:42 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:14:42 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:14:42 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:14:42 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:14:42 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:14:42 [Note] WSREP: Start replication | |
| 160526 17:14:42 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:14:42 [Note] WSREP: protonet asio version 0 | |
| 160526 17:14:42 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:14:42 [Note] WSREP: backend: asio | |
| 160526 17:14:42 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:14:42 [Note] WSREP: restore pc from disk failed | |
| 160526 17:14:42 [Note] WSREP: GMCast version 0 | |
| 160526 17:14:42 [Note] WSREP: (f4573039, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:14:42 [Note] WSREP: (f4573039, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:14:42 [Note] WSREP: EVS version 0 | |
| 160526 17:14:42 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:14:45 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:14:45 [Note] WSREP: view(view_id(NON_PRIM,f4573039,1) memb { | |
| f4573039,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:14:45 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50282S), skipping check | |
| 160526 17:15:15 [Note] WSREP: view((empty)) | |
| 160526 17:15:15 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:15:15 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:15:15 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:15:15 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:15:15 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:15:15 [ERROR] Aborting | |
| 160526 17:15:15 [Note] WSREP: Service disconnected. | |
| 160526 17:15:16 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:15:16 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:15:16 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:15:16 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:15:16 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.xcGzjc' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:15:16 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:15:19 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:15:19 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:15:19 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:15:19 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:15:19 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:15:19 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:15:19 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:15:19 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:15:19 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:15:19 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:15:19 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:15:19 [Note] WSREP: Start replication | |
| 160526 17:15:19 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:15:19 [Note] WSREP: protonet asio version 0 | |
| 160526 17:15:19 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:15:19 [Note] WSREP: backend: asio | |
| 160526 17:15:19 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:15:19 [Note] WSREP: restore pc from disk failed | |
| 160526 17:15:19 [Note] WSREP: GMCast version 0 | |
| 160526 17:15:19 [Note] WSREP: (0a4fa059, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:15:19 [Note] WSREP: (0a4fa059, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:15:19 [Note] WSREP: EVS version 0 | |
| 160526 17:15:19 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:15:22 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:15:22 [Note] WSREP: view(view_id(NON_PRIM,0a4fa059,1) memb { | |
| 0a4fa059,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:15:22 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50234S), skipping check | |
| 160526 17:15:52 [Note] WSREP: view((empty)) | |
| 160526 17:15:52 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:15:52 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:15:52 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:15:52 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:15:52 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:15:52 [ERROR] Aborting | |
| 160526 17:15:52 [Note] WSREP: Service disconnected. | |
| 160526 17:15:53 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:15:53 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:15:53 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:15:53 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:15:53 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.fOateE' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:15:53 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:15:56 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:15:56 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:15:56 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:15:56 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:15:56 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:15:56 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:15:56 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:15:56 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:15:56 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:15:56 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:15:56 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:15:56 [Note] WSREP: Start replication | |
| 160526 17:15:56 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:15:56 [Note] WSREP: protonet asio version 0 | |
| 160526 17:15:56 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:15:56 [Note] WSREP: backend: asio | |
| 160526 17:15:56 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:15:56 [Note] WSREP: restore pc from disk failed | |
| 160526 17:15:56 [Note] WSREP: GMCast version 0 | |
| 160526 17:15:56 [Note] WSREP: (20494e59, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:15:56 [Note] WSREP: (20494e59, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:15:56 [Note] WSREP: EVS version 0 | |
| 160526 17:15:56 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:15:59 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:15:59 [Note] WSREP: view(view_id(NON_PRIM,20494e59,1) memb { | |
| 20494e59,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:15:59 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50258S), skipping check | |
| 160526 17:16:29 [Note] WSREP: view((empty)) | |
| 160526 17:16:29 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:16:29 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:16:29 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:16:29 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:16:29 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:16:29 [ERROR] Aborting | |
| 160526 17:16:29 [Note] WSREP: Service disconnected. | |
| 160526 17:16:30 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:16:30 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:16:30 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:16:30 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:16:30 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.am8Kwu' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:16:30 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:16:33 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:16:33 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:16:33 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:16:33 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:16:33 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:16:33 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:16:33 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:16:33 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:16:33 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:16:33 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:16:33 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:16:33 [Note] WSREP: Start replication | |
| 160526 17:16:33 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:16:33 [Note] WSREP: protonet asio version 0 | |
| 160526 17:16:33 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:16:33 [Note] WSREP: backend: asio | |
| 160526 17:16:33 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:16:33 [Note] WSREP: restore pc from disk failed | |
| 160526 17:16:33 [Note] WSREP: GMCast version 0 | |
| 160526 17:16:33 [Note] WSREP: (3646e2b4, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:16:33 [Note] WSREP: (3646e2b4, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:16:33 [Note] WSREP: EVS version 0 | |
| 160526 17:16:33 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:16:36 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:16:36 [Note] WSREP: view(view_id(NON_PRIM,3646e2b4,1) memb { | |
| 3646e2b4,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:16:36 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50305S), skipping check | |
| 160526 17:17:06 [Note] WSREP: view((empty)) | |
| 160526 17:17:06 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:17:06 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:17:06 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:17:06 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:17:06 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:17:06 [ERROR] Aborting | |
| 160526 17:17:06 [Note] WSREP: Service disconnected. | |
| 160526 17:17:07 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:17:07 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:17:07 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:17:07 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:17:07 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.lBoIZl' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:17:07 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:17:09 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:17:09 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:17:09 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:17:09 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:17:09 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:17:09 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:17:09 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:17:09 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:17:09 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:17:09 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:17:09 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:17:09 [Note] WSREP: Start replication | |
| 160526 17:17:09 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:17:09 [Note] WSREP: protonet asio version 0 | |
| 160526 17:17:09 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:17:09 [Note] WSREP: backend: asio | |
| 160526 17:17:09 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:17:09 [Note] WSREP: restore pc from disk failed | |
| 160526 17:17:09 [Note] WSREP: GMCast version 0 | |
| 160526 17:17:09 [Note] WSREP: (4c448dfe, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:17:09 [Note] WSREP: (4c448dfe, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:17:09 [Note] WSREP: EVS version 0 | |
| 160526 17:17:09 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:17:12 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:17:12 [Note] WSREP: view(view_id(NON_PRIM,4c448dfe,1) memb { | |
| 4c448dfe,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:17:13 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5025S), skipping check | |
| 160526 17:17:43 [Note] WSREP: view((empty)) | |
| 160526 17:17:43 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:17:43 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:17:43 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:17:43 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:17:43 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:17:43 [ERROR] Aborting | |
| 160526 17:17:43 [Note] WSREP: Service disconnected. | |
| 160526 17:17:44 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:17:44 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:17:44 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:17:44 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:17:44 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.bXjnok' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:17:44 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:17:46 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:17:46 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:17:46 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:17:46 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:17:46 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:17:46 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:17:46 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:17:46 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:17:46 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:17:46 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:17:46 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:17:46 [Note] WSREP: Start replication | |
| 160526 17:17:46 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:17:46 [Note] WSREP: protonet asio version 0 | |
| 160526 17:17:46 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:17:46 [Note] WSREP: backend: asio | |
| 160526 17:17:46 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:17:46 [Note] WSREP: restore pc from disk failed | |
| 160526 17:17:46 [Note] WSREP: GMCast version 0 | |
| 160526 17:17:46 [Note] WSREP: (6241a6eb, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:17:46 [Note] WSREP: (6241a6eb, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:17:46 [Note] WSREP: EVS version 0 | |
| 160526 17:17:46 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:17:49 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:17:49 [Note] WSREP: view(view_id(NON_PRIM,6241a6eb,1) memb { | |
| 6241a6eb,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:17:50 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50234S), skipping check | |
| 160526 17:18:19 [Note] WSREP: view((empty)) | |
| 160526 17:18:19 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:18:19 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:18:19 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:18:19 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:18:19 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:18:19 [ERROR] Aborting | |
| 160526 17:18:19 [Note] WSREP: Service disconnected. | |
| 160526 17:18:20 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:18:20 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:18:20 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:18:21 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:18:21 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.pZzcLz' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:18:21 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:18:23 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:18:23 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:18:23 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:18:23 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:18:23 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:18:23 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:18:23 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:18:23 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:18:23 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:18:23 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:18:23 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:18:23 [Note] WSREP: Start replication | |
| 160526 17:18:23 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:18:23 [Note] WSREP: protonet asio version 0 | |
| 160526 17:18:23 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:18:23 [Note] WSREP: backend: asio | |
| 160526 17:18:23 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:18:23 [Note] WSREP: restore pc from disk failed | |
| 160526 17:18:23 [Note] WSREP: GMCast version 0 | |
| 160526 17:18:23 [Note] WSREP: (783c3b2d, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:18:23 [Note] WSREP: (783c3b2d, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:18:23 [Note] WSREP: EVS version 0 | |
| 160526 17:18:23 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:18:26 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:18:26 [Note] WSREP: view(view_id(NON_PRIM,783c3b2d,1) memb { | |
| 783c3b2d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:18:27 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50281S), skipping check | |
| 160526 17:18:56 [Note] WSREP: view((empty)) | |
| 160526 17:18:56 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:18:56 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:18:56 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:18:56 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:18:56 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:18:56 [ERROR] Aborting | |
| 160526 17:18:56 [Note] WSREP: Service disconnected. | |
| 160526 17:18:57 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:18:57 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:18:57 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:18:58 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:18:58 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.l5sEsK' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:18:58 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:19:00 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:19:00 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:19:00 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:19:00 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:19:00 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:19:00 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:19:00 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:19:00 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:19:00 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:19:00 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:19:00 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:19:00 [Note] WSREP: Start replication | |
| 160526 17:19:00 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:19:00 [Note] WSREP: protonet asio version 0 | |
| 160526 17:19:00 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:19:00 [Note] WSREP: backend: asio | |
| 160526 17:19:00 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:19:00 [Note] WSREP: restore pc from disk failed | |
| 160526 17:19:00 [Note] WSREP: GMCast version 0 | |
| 160526 17:19:00 [Note] WSREP: (8e339f97, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:19:00 [Note] WSREP: (8e339f97, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:19:00 [Note] WSREP: EVS version 0 | |
| 160526 17:19:00 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:19:03 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:19:03 [Note] WSREP: view(view_id(NON_PRIM,8e339f97,1) memb { | |
| 8e339f97,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:19:04 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5022S), skipping check | |
| 160526 17:19:33 [Note] WSREP: view((empty)) | |
| 160526 17:19:33 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:19:33 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:19:33 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:19:33 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:19:33 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:19:33 [ERROR] Aborting | |
| 160526 17:19:33 [Note] WSREP: Service disconnected. | |
| 160526 17:19:34 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:19:34 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:19:34 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:19:35 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:19:35 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.lKlKvB' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:19:35 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:19:37 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:19:37 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:19:37 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:19:37 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:19:37 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:19:37 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:19:37 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:19:37 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:19:37 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:19:37 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:19:37 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:19:37 [Note] WSREP: Start replication | |
| 160526 17:19:37 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:19:37 [Note] WSREP: protonet asio version 0 | |
| 160526 17:19:37 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:19:37 [Note] WSREP: backend: asio | |
| 160526 17:19:37 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:19:37 [Note] WSREP: restore pc from disk failed | |
| 160526 17:19:37 [Note] WSREP: GMCast version 0 | |
| 160526 17:19:37 [Note] WSREP: (a42edc9b, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:19:37 [Note] WSREP: (a42edc9b, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:19:37 [Note] WSREP: EVS version 0 | |
| 160526 17:19:37 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:19:40 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:19:40 [Note] WSREP: view(view_id(NON_PRIM,a42edc9b,1) memb { | |
| a42edc9b,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:19:40 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50241S), skipping check | |
| 160526 17:20:10 [Note] WSREP: view((empty)) | |
| 160526 17:20:10 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:20:10 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:20:10 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:20:10 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:20:10 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:20:10 [ERROR] Aborting | |
| 160526 17:20:10 [Note] WSREP: Service disconnected. | |
| 160526 17:20:11 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:20:11 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:20:11 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:20:11 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:20:11 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.oRiMBq' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:20:11 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:20:14 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:20:14 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:20:14 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:20:14 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:20:14 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:20:14 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:20:14 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:20:14 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:20:14 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:20:14 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:20:14 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:20:14 [Note] WSREP: Start replication | |
| 160526 17:20:14 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:20:14 [Note] WSREP: protonet asio version 0 | |
| 160526 17:20:14 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:20:14 [Note] WSREP: backend: asio | |
| 160526 17:20:14 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:20:14 [Note] WSREP: restore pc from disk failed | |
| 160526 17:20:14 [Note] WSREP: GMCast version 0 | |
| 160526 17:20:14 [Note] WSREP: (ba287ba6, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:20:14 [Note] WSREP: (ba287ba6, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:20:14 [Note] WSREP: EVS version 0 | |
| 160526 17:20:14 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:20:17 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:20:17 [Note] WSREP: view(view_id(NON_PRIM,ba287ba6,1) memb { | |
| ba287ba6,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:20:17 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50208S), skipping check | |
| 160526 17:20:47 [Note] WSREP: view((empty)) | |
| 160526 17:20:47 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:20:47 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:20:47 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:20:47 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:20:47 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:20:47 [ERROR] Aborting | |
| 160526 17:20:47 [Note] WSREP: Service disconnected. | |
| 160526 17:20:48 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:20:48 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:20:48 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:20:48 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:20:48 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.nnBDMT' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:20:48 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:20:51 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:20:51 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:20:51 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:20:51 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:20:51 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:20:51 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:20:51 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:20:51 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:20:51 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:20:51 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:20:51 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:20:51 [Note] WSREP: Start replication | |
| 160526 17:20:51 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:20:51 [Note] WSREP: protonet asio version 0 | |
| 160526 17:20:51 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:20:51 [Note] WSREP: backend: asio | |
| 160526 17:20:51 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:20:51 [Note] WSREP: restore pc from disk failed | |
| 160526 17:20:51 [Note] WSREP: GMCast version 0 | |
| 160526 17:20:51 [Note] WSREP: (d0275d7b, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:20:51 [Note] WSREP: (d0275d7b, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:20:51 [Note] WSREP: EVS version 0 | |
| 160526 17:20:51 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:20:54 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:20:54 [Note] WSREP: view(view_id(NON_PRIM,d0275d7b,1) memb { | |
| d0275d7b,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:20:54 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50275S), skipping check | |
| 160526 17:21:24 [Note] WSREP: view((empty)) | |
| 160526 17:21:24 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:21:24 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:21:24 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:21:24 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:21:24 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:21:24 [ERROR] Aborting | |
| 160526 17:21:24 [Note] WSREP: Service disconnected. | |
| 160526 17:21:25 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:21:25 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:21:25 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:21:25 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:21:25 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.ktlwDz' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:21:25 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 145 ... | |
| 160526 17:21:28 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:21:28 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 177 ... | |
| 160526 17:21:28 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:21:28 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:21:28 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:21:28 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:21:28 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:21:28 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:21:28 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:21:28 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:21:28 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:21:28 [Note] WSREP: Start replication | |
| 160526 17:21:28 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:21:28 [Note] WSREP: protonet asio version 0 | |
| 160526 17:21:28 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:21:28 [Note] WSREP: backend: asio | |
| 160526 17:21:28 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:21:28 [Note] WSREP: restore pc from disk failed | |
| 160526 17:21:28 [Note] WSREP: GMCast version 0 | |
| 160526 17:21:28 [Note] WSREP: (e620731d, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:21:28 [Note] WSREP: (e620731d, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:21:28 [Note] WSREP: EVS version 0 | |
| 160526 17:21:28 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567' | |
| 160526 17:21:31 [Warning] WSREP: no nodes coming from prim view, prim not possible | |
| 160526 17:21:31 [Note] WSREP: view(view_id(NON_PRIM,e620731d,1) memb { | |
| e620731d,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:21:31 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50321S), skipping check | |
| 160526 17:22:01 [Note] WSREP: view((empty)) | |
| 160526 17:22:01 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out) | |
| at gcomm/src/pc.cpp:connect():162 | |
| 160526 17:22:01 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out) | |
| 160526 17:22:01 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1379: Failed to open channel 'openstack' at 'gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567': -110 (Connection timed out) | |
| 160526 17:22:01 [ERROR] WSREP: gcs connect failed: Connection timed out | |
| 160526 17:22:01 [ERROR] WSREP: wsrep::connect(gcomm://10.25.201.70:4567,10.25.201.71:4567,10.25.201.72:4567) failed: 7 | |
| 160526 17:22:01 [ERROR] Aborting | |
| 160526 17:22:01 [Note] WSREP: Service disconnected. | |
| 160526 17:22:02 [Note] WSREP: Some threads may fail to exit. | |
| 160526 17:22:02 [Note] /usr/sbin/mysqld: Shutdown complete | |
| 160526 17:22:02 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended | |
| 160526 17:24:37 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ | |
| 160526 17:24:37 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql//wsrep_recovery.W1b7qP' --pid-file='/var/lib/mysql//ampvc-dd0070.REDACTED.com-recover.pid' | |
| nohup: ignoring input | |
| 160526 17:24:37 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 151 ... | |
| 160526 17:24:39 mysqld_safe WSREP: Recovered position 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:24:39 [Note] /usr/sbin/mysqld (mysqld 10.0.24-MariaDB-wsrep) starting as process 183 ... | |
| 160526 17:24:39 [Note] WSREP: Read nil XID from storage engines, skipping position init | |
| 160526 17:24:39 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' | |
| 160526 17:24:39 [Note] WSREP: wsrep_load(): Galera 25.3.14(r3560) by Codership Oy <info@codership.com> loaded successfully. | |
| 160526 17:24:39 [Note] WSREP: CRC-32C: using hardware acceleration. | |
| 160526 17:24:39 [Note] WSREP: Found saved state: 9446883f-234c-11e6-8440-966e6fbca58c:-1 | |
| 160526 17:24:39 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.25.201.70; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.25.201.70:4567; gmcast.segment = 0; gmcast.version = 0; ist.recv_addr = 10.25.201.70:4568; pc.announce_tim | |
| 160526 17:24:39 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:24:39 [Note] WSREP: Assign initial position for certification: 6, protocol version: -1 | |
| 160526 17:24:39 [Note] WSREP: wsrep_sst_grab() | |
| 160526 17:24:39 [Note] WSREP: Start replication | |
| 160526 17:24:39 [Note] WSREP: 'wsrep-new-cluster' option used, bootstrapping the cluster | |
| 160526 17:24:39 [Note] WSREP: Setting initial position to 9446883f-234c-11e6-8440-966e6fbca58c:6 | |
| 160526 17:24:39 [Note] WSREP: protonet asio version 0 | |
| 160526 17:24:39 [Note] WSREP: Using CRC-32C for message checksums. | |
| 160526 17:24:39 [Note] WSREP: backend: asio | |
| 160526 17:24:39 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) | |
| 160526 17:24:39 [Note] WSREP: restore pc from disk failed | |
| 160526 17:24:39 [Note] WSREP: GMCast version 0 | |
| 160526 17:24:39 [Note] WSREP: (58385ba2, 'tcp://10.25.201.70:4567') listening at tcp://10.25.201.70:4567 | |
| 160526 17:24:39 [Note] WSREP: (58385ba2, 'tcp://10.25.201.70:4567') multicast: , ttl: 1 | |
| 160526 17:24:39 [Note] WSREP: EVS version 0 | |
| 160526 17:24:39 [Note] WSREP: gcomm: bootstrapping new group 'openstack' | |
| 160526 17:24:39 [Note] WSREP: start_prim is enabled, turn off pc_recovery | |
| 160526 17:24:39 [Note] WSREP: Node 58385ba2 state prim | |
| 160526 17:24:39 [Note] WSREP: view(view_id(PRIM,58385ba2,1) memb { | |
| 58385ba2,0 | |
| } joined { | |
| } left { | |
| } partitioned { | |
| }) | |
| 160526 17:24:39 [Note] WSREP: save pc into disk | |
| 160526 17:24:39 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.71:4567 | |
| 160526 17:24:39 [Note] WSREP: discarding pending addr proto entry 0x7fd54589f2c0 | |
| 160526 17:24:39 [Note] WSREP: discarding pending addr without UUID: tcp://10.25.201.72:4567 | |
| 160526 17:24:39 [Note] WSREP: discarding pending addr proto entry 0x7fd54589f500 | |
| 160526 17:24:39 [Note] WSREP: gcomm: connected | |
| 160526 17:24:39 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 | |
| 160526 17:24:39 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) | |
| 160526 17:24:39 [Note] WSREP: Opened channel 'openstack' | |
| 160526 17:24:39 [Note] WSREP: Waiting for SST to complete. | |
| 160526 17:24:39 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 | |
| 160526 17:24:39 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 583919b2-235e-11e6-b9a0-02bf9ea4dd83 | |
| 160526 17:24:39 [Note] WSREP: STATE EXCHANGE: sent state msg: 583919b2-235e-11e6-b9a0-02bf9ea4dd83 | |
| 160526 17:24:39 [Note] WSREP: STATE EXCHANGE: got state msg: 583919b2-235e-11e6-b9a0-02bf9ea4dd83 from 0 (ampvc-dd0070) | |
| 160526 17:24:39 [Note] WSREP: Quorum results: | |
| version = 3, | |
| component = PRIMARY, | |
| conf_id = 0, | |
| members = 1/1 (joined/total), | |
| act_id = 6, | |
| last_appl. = -1, | |
| protocols = 0/7/3 (gcs/repl/appl), | |
| group UUID = 9446883f-234c-11e6-8440-966e6fbca58c | |
| 160526 17:24:39 [Note] WSREP: Flow-control interval: [16, 16] | |
| 160526 17:24:39 [Note] WSREP: Restored state OPEN -> JOINED (6) | |
| 160526 17:24:39 [Note] WSREP: Member 0.0 (ampvc-dd0070) synced with group. | |
| 160526 17:24:39 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 6) | |
| 160526 17:24:39 [Note] WSREP: New cluster view: global state: 9446883f-234c-11e6-8440-966e6fbca58c:6, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3 | |
| 160526 17:24:39 [Note] WSREP: SST complete, seqno: 6 | |
| 160526 17:24:39 [Note] InnoDB: Using mutexes to ref count buffer pool pages | |
| 160526 17:24:39 [Note] InnoDB: The InnoDB memory heap is disabled | |
| 160526 17:24:39 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins | |
| 160526 17:24:39 [Note] InnoDB: Memory barrier is not used | |
| 160526 17:24:39 [Note] InnoDB: Compressed tables use zlib 1.2.7 | |
| 160526 17:24:39 [Note] InnoDB: Using Linux native AIO | |
| 160526 17:24:39 [Note] InnoDB: Using CPU crc32 instructions | |
| 160526 17:24:39 [Note] InnoDB: Initializing buffer pool, size = 128.0M | |
| 160526 17:24:39 [Note] InnoDB: Completed initialization of buffer pool | |
| 160526 17:24:39 [Note] InnoDB: Highest supported file format is Barracuda. | |
| 160526 17:24:39 [Note] InnoDB: 128 rollback segment(s) are active. | |
| 160526 17:24:39 [Note] InnoDB: Waiting for purge to start | |
| 160526 17:24:39 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 1619341 | |
| 160526 17:24:39 [Note] Plugin 'FEEDBACK' is disabled. | |
| 160526 17:24:39 [Note] Server socket created on IP: '10.25.201.70'. | |
| 160526 17:24:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 17:24:39 [Note] WSREP: REPL Protocols: 7 (3, 2) | |
| 160526 17:24:39 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:24:39 [Note] WSREP: Assign initial position for certification: 6, protocol version: 3 | |
| 160526 17:24:39 [Note] WSREP: Service thread queue flushed. | |
| 160526 17:24:39 [Note] WSREP: Synchronized with group, ready for connections | |
| 160526 17:24:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. | |
| 160526 17:24:39 [Note] /usr/sbin/mysqld: ready for connections. | |
| Version: '10.0.24-MariaDB-wsrep' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server, wsrep_25.13.raf7f02e |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment