Skip to content

Instantly share code, notes, and snippets.

@mauricio
Created December 13, 2012 16:01
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mauricio/4277429 to your computer and use it in GitHub Desktop.
Save mauricio/4277429 to your computer and use it in GitHub Desktop.
2012-12-13 15:55:45,102 - INFO [main:QuorumPeerConfig@90] - Reading configuration from: /etc/zookeeper/zoo.cfg
2012-12-13 15:55:45,111 - WARN [main:QuorumPeerConfig@263] - No server failure will be tolerated. You need at least 3 servers.
2012-12-13 15:55:45,112 - INFO [main:QuorumPeerConfig@310] - Defaulting to majority quorums
2012-12-13 15:55:45,128 - INFO [main:QuorumPeerMain@119] - Starting quorum peer
2012-12-13 15:55:45,156 - INFO [main:NIOServerCnxn$Factory@143] - binding to port 0.0.0.0/0.0.0.0:2181
2012-12-13 15:55:45,179 - INFO [main:QuorumPeer@819] - tickTime set to 2000
2012-12-13 15:55:45,179 - INFO [main:QuorumPeer@830] - minSessionTimeout set to -1
2012-12-13 15:55:45,180 - INFO [main:QuorumPeer@841] - maxSessionTimeout set to -1
2012-12-13 15:55:45,181 - INFO [main:QuorumPeer@856] - initLimit set to 10
2012-12-13 15:55:45,225 - INFO [Thread-1:QuorumCnxManager$Listener@473] - My election bind port: 3888
2012-12-13 15:55:45,246 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumPeer@621] - LOOKING
2012-12-13 15:55:45,248 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@663] - New election. My id = 1, Proposed zxid = 0
2012-12-13 15:55:45,251 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 1 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 1 (n.sid), LOOKING (my state)
2012-12-13 15:55:45,259 - INFO [WorkerSender Thread:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:55:45,462 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:55:45,462 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 400
2012-12-13 15:55:45,864 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:55:45,865 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 800
2012-12-13 15:55:46,667 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:55:46,668 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 1600
2012-12-13 15:55:48,270 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:55:48,271 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 3200
2012-12-13 15:55:51,477 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:55:51,481 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 6400
2012-12-13 15:55:57,883 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:55:57,883 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 12800
2012-12-13 15:56:10,685 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:56:10,686 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 25600
2012-12-13 15:56:36,288 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:56:36,289 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 51200
2012-12-13 15:57:27,490 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:57:27,494 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 60000
2012-12-13 15:58:27,495 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumCnxManager@183] - Have smaller server identifier, so dropping the connection: (2, 1)
2012-12-13 15:58:27,496 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 60000
2012-12-13 15:55:26,458 - INFO [main:QuorumPeerConfig@90] - Reading configuration from: /etc/zookeeper/zoo.cfg
2012-12-13 15:55:26,464 - WARN [main:QuorumPeerConfig@263] - No server failure will be tolerated. You need at least 3 servers.
2012-12-13 15:55:26,465 - INFO [main:QuorumPeerConfig@310] - Defaulting to majority quorums
2012-12-13 15:55:26,479 - INFO [main:QuorumPeerMain@119] - Starting quorum peer
2012-12-13 15:55:26,502 - INFO [main:NIOServerCnxn$Factory@143] - binding to port 0.0.0.0/0.0.0.0:2181
2012-12-13 15:55:26,523 - INFO [main:QuorumPeer@819] - tickTime set to 2000
2012-12-13 15:55:26,523 - INFO [main:QuorumPeer@830] - minSessionTimeout set to -1
2012-12-13 15:55:26,524 - INFO [main:QuorumPeer@841] - maxSessionTimeout set to -1
2012-12-13 15:55:26,524 - INFO [main:QuorumPeer@856] - initLimit set to 10
2012-12-13 15:55:26,550 - INFO [main:FileSnap@82] - Reading snapshot /var/lib/zookeeper/version-2/snapshot.0
2012-12-13 15:55:26,567 - INFO [Thread-1:QuorumCnxManager$Listener@473] - My election bind port: 3888
2012-12-13 15:55:26,579 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:QuorumPeer@621] - LOOKING
2012-12-13 15:55:26,582 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@663] - New election. My id = 2, Proposed zxid = 0
2012-12-13 15:55:26,590 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:26,590 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:26,795 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:26,795 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:26,796 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 400
2012-12-13 15:55:27,197 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:27,197 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:27,197 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 800
2012-12-13 15:55:27,999 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:27,999 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 1600
2012-12-13 15:55:28,000 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:29,601 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 3200
2012-12-13 15:55:29,601 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:29,602 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:32,803 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 6400
2012-12-13 15:55:32,803 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:32,805 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:39,205 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 12800
2012-12-13 15:55:39,207 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:39,207 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:45,260 - WARN [Thread-5:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:55:45,262 - WARN [Thread-5:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:45,261 - WARN [Thread-4:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:45,274 - WARN [Thread-4:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:45,260 - WARN [Thread-3:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:55:45,275 - WARN [Thread-3:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:45,266 - WARN [Thread-2:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:45,277 - WARN [Thread-2:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:45,278 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:45,461 - WARN [Thread-7:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:55:45,462 - WARN [Thread-7:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:45,462 - WARN [Thread-6:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:45,464 - WARN [Thread-6:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:45,465 - WARN [Thread-9:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:55:45,468 - WARN [Thread-9:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:45,468 - WARN [Thread-8:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:45,471 - WARN [Thread-8:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:45,472 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:45,864 - WARN [Thread-11:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:55:45,864 - WARN [Thread-11:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:45,865 - WARN [Thread-10:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:45,866 - WARN [Thread-10:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:45,866 - WARN [Thread-13:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:55:45,866 - WARN [Thread-13:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:45,870 - WARN [Thread-12:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:45,872 - WARN [Thread-12:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:45,873 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:46,667 - WARN [Thread-15:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:55:46,667 - WARN [Thread-15:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:46,667 - WARN [Thread-14:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:46,668 - WARN [Thread-14:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:46,669 - WARN [Thread-17:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:55:46,669 - WARN [Thread-17:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:46,677 - WARN [Thread-16:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:46,678 - WARN [Thread-16:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:46,680 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:48,269 - WARN [Thread-19:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:55:48,270 - WARN [Thread-19:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:48,270 - WARN [Thread-18:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:48,271 - WARN [Thread-18:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:48,272 - WARN [Thread-21:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:55:48,272 - WARN [Thread-21:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:48,275 - WARN [Thread-20:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:48,278 - WARN [Thread-20:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:48,278 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:51,477 - WARN [Thread-22:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:51,477 - WARN [Thread-22:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:51,477 - WARN [Thread-23:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:55:51,479 - WARN [Thread-23:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:51,479 - WARN [Thread-25:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:55:51,480 - WARN [Thread-25:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:51,481 - WARN [Thread-24:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:51,484 - WARN [Thread-24:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:51,484 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:55:57,883 - WARN [Thread-27:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:55:57,884 - WARN [Thread-27:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:57,883 - WARN [Thread-26:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:57,884 - WARN [Thread-26:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:57,885 - WARN [Thread-29:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:55:57,885 - WARN [Thread-29:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:55:57,886 - WARN [Thread-28:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:55:57,889 - WARN [Thread-28:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:55:57,890 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:56:10,685 - WARN [Thread-31:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:56:10,688 - WARN [Thread-31:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:56:10,686 - WARN [Thread-30:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:56:10,688 - WARN [Thread-30:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:56:10,686 - WARN [Thread-33:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:56:10,689 - WARN [Thread-33:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:56:10,690 - WARN [Thread-32:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:56:10,694 - WARN [Thread-32:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:56:10,695 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 25600
2012-12-13 15:56:10,695 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:56:10,696 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:56:10,706 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:56:36,288 - WARN [Thread-35:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:56:36,289 - WARN [Thread-35:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:56:36,289 - WARN [Thread-37:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:56:36,289 - WARN [Thread-37:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:56:36,288 - WARN [Thread-34:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:56:36,290 - WARN [Thread-34:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:56:36,290 - WARN [Thread-36:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:56:36,298 - WARN [Thread-36:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:56:36,299 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:57:01,900 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 51200
2012-12-13 15:57:01,900 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:57:01,901 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:57:27,491 - WARN [Thread-39:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:57:27,491 - WARN [Thread-39:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:57:27,491 - WARN [Thread-41:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:57:27,492 - WARN [Thread-41:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:57:27,491 - WARN [Thread-38:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:57:27,492 - WARN [Thread-38:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:57:27,493 - WARN [Thread-40:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:57:27,496 - WARN [Thread-40:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:57:27,497 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:58:18,697 - INFO [QuorumPeer:/0:0:0:0:0:0:0:0:2181:FastLeaderElection@697] - Notification time out: 60000
2012-12-13 15:58:18,698 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:58:18,698 - INFO [WorkerReceiver Thread:FastLeaderElection@496] - Notification: 2 (n.leader), 0 (n.zxid), 1 (n.round), LOOKING (n.state), 2 (n.sid), LOOKING (my state)
2012-12-13 15:58:27,495 - WARN [Thread-43:QuorumCnxManager$RecvWorker@727] - Connection broken for id 1, my id = 2, error = java.nio.channels.AsynchronousCloseException
2012-12-13 15:58:27,496 - WARN [Thread-43:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:58:27,496 - WARN [Thread-45:QuorumCnxManager$RecvWorker@727] - Connection broken for id 2, my id = 2, error = java.io.IOException: Channel eof
2012-12-13 15:58:27,496 - WARN [Thread-45:QuorumCnxManager$RecvWorker@730] - Interrupting SendWorker
2012-12-13 15:58:27,496 - WARN [Thread-42:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:58:27,497 - WARN [Thread-42:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
2012-12-13 15:58:27,498 - WARN [Thread-44:QuorumCnxManager$SendWorker@633] - Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:622)
2012-12-13 15:58:27,501 - WARN [Thread-44:QuorumCnxManager$SendWorker@642] - Send worker leaving thread
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
dataDir=/var/lib/zookeeper
# the port at which the clients will connect
clientPort=2181
server.1=redis1:2888:3888
server.2=redis2:2888:3888
@eribeiro
Copy link

Protip: Zookeeper should have a odd number of servers so that they can have a quorum even if a node (or two) crashes. Have you tried with 3 nodes? Production environments usually have 3, 5 or 7 ZK servers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment