Skip to content

Instantly share code, notes, and snippets.

@henrikno
Created November 5, 2013 09:25
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save henrikno/7316258 to your computer and use it in GitHub Desktop.
Save henrikno/7316258 to your computer and use it in GitHub Desktop.
LeaderSelector
2013-11-04 18:16:41,219 INFO [main ] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=s02:39000 sessionTimeout=60000 watcher=com.netflix.curator.ConnectionState@31a809e1
2013-11-04 18:16:41,357 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:16:41,372 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:16:41,376 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Socket connection established to s02.acme.com/11.17.9.21:39000, initiating session
2013-11-04 18:16:41,393 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:16:41,406 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session establishment complete on server s02.acme.com/11.17.9.21:39000, sessionid = 0x1422388c0a10005, negotiated timeout = 40000
2013-11-04 18:16:41,407 INFO [main-EventThread ] c.n.c.f.state.ConnectionStateManager - State change: CONNECTED
2013-11-04 18:16:41,407 WARN [ectionStateManager-0] c.n.c.f.state.ConnectionStateManager - There are no ConnectionStateListeners registered.
2013-11-04 18:16:42,756 INFO [main ] s.f.s.i.guice.GuiceServletConfig - Starting application
2013-11-04 18:16:43,416 INFO [main ] s.a.i.c.c.e.ExternalConfigProcessor - Behandler annoterte beans
2013-11-04 18:16:46,571 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) Got leadership
2013-11-04 18:16:46,571 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) Waiting for work
2013-11-04 18:16:46,581 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) We've got work to do! Working...
2013-11-04 18:17:04,115 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 0b4a2c8f-273c-41ed-a8c5-968b100fbd5a
2013-11-04 18:17:16,099 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 28095fed-1ac8-4053-afa1-34f8ac6b0ecf
2013-11-04 18:17:27,761 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 876f22bb-685f-41c9-b881-f38be1a90c9a
2013-11-04 18:17:39,452 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 7fafb3d4-c1d4-4e9c-ba48-51112f506278
2013-11-04 18:17:51,908 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... cddda32f-ce27-43f5-b0c0-e86974f0f559
2013-11-04 18:17:52,855 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) Setting up barrier
2013-11-04 18:17:52,867 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) Waiting for work
2013-11-04 18:22:13,531 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) We've got work to do! Working...
2013-11-04 18:22:23,020 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 79d4c3c5-7de4-4586-a2ef-adfb9e0ca858
2013-11-04 18:22:24,022 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... a2ff9a4b-e502-4cfb-9917-3fdb9464947a
2013-11-04 18:22:24,995 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 89f7685d-0240-49b6-950f-24fbb9735c2d
2013-11-04 18:22:26,044 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Unable to read additional data from server sessionid 0x1422388c0a10005, likely server has closed socket, closing socket connection and attempting reconnect
2013-11-04 18:22:26,147 INFO [main-EventThread ] c.n.c.f.state.ConnectionStateManager - State change: SUSPENDED
2013-11-04 18:22:26,150 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - StateChanged: SUSPENDED
2013-11-04 18:22:26,151 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - Interrupting thread Thread[LeaderSelector-0,5,main]
2013-11-04 18:22:26,388 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... f8184f16-5ab0-4dda-b56d-2d7bef3a2c96
2013-11-04 18:22:27,394 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 16be065b-94a4-4161-8cc0-a103f01e2d40
2013-11-04 18:22:27,678 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:27,678 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:27,678 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:27,687 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x1422388c0a10005 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:28,445 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 618aa34e-f26a-420f-999f-3550cbd6463b
2013-11-04 18:22:29,246 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:29,247 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:29,247 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:29,249 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x1422388c0a10005 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:29,491 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 375c051b-d2be-465d-8a31-28bd87dd1f28
2013-11-04 18:22:30,527 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 6df1165b-5513-49f9-8e28-dbe2a7030b06
2013-11-04 18:22:30,734 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:30,734 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:30,735 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:30,736 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x1422388c0a10005 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:31,509 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 24991ec8-15b9-4396-80b8-8906f59dc3ad
2013-11-04 18:22:32,398 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:32,398 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:32,398 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:32,399 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x1422388c0a10005 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:32,500 ERROR [main-EventThread ] c.n.c.f.imps.CuratorFrameworkImpl - Background operation retry gave up
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at com.netflix.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:486) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:49) [curator-framework-1.3.3.jar:na]
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:606) [zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) [zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:32,501 INFO [main-EventThread ] com.netflix.curator.ConnectionState - lost marked
2013-11-04 18:22:32,501 INFO [main-EventThread ] c.n.c.f.state.ConnectionStateManager - State change: LOST
2013-11-04 18:22:32,501 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - StateChanged: LOST
2013-11-04 18:22:32,501 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - Interrupting thread Thread[LeaderSelector-0,5,main]
2013-11-04 18:22:32,503 INFO [main-EventThread ] c.n.c.f.state.ConnectionStateManager - State change: SUSPENDED
2013-11-04 18:22:32,503 INFO [main-EventThread ] com.netflix.curator.ConnectionState - resetting after loss
2013-11-04 18:22:32,503 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - StateChanged: SUSPENDED
2013-11-04 18:22:32,504 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - Interrupting thread Thread[LeaderSelector-0,5,main]
2013-11-04 18:22:32,505 INFO [LeaderSelector-0 ] s.f.s.i.f.MyService - Working... 7d65a9fc-a0ac-456c-8623-bc797f8aabc9
2013-11-04 18:22:33,045 INFO [main-EventThread ] org.apache.zookeeper.ZooKeeper - Session: 0x1422388c0a10005 closed
2013-11-04 18:22:33,045 INFO [main-EventThread ] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=s02:39000 sessionTimeout=60000 watcher=com.netflix.curator.ConnectionState@31a809e1
2013-11-04 18:22:33,049 INFO [main-EventThread ] org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-11-04 18:22:33,052 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:33,053 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:33,053 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:33,054 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:34,155 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:34,156 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:34,156 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:34,158 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:34,642 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) Waiting for work
2013-11-04 18:22:34,644 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) Interrupted
java.lang.InterruptedException: null
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1325) ~[na:1.7.0_11]
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:282) ~[na:1.7.0_11]
at com.netflix.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:304) ~[curator-client-1.3.3.jar:na]
at com.netflix.curator.RetryLoop.callWithRetry(RetryLoop.java:104) ~[curator-client-1.3.3.jar:na]
at com.netflix.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:156) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:147) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:35) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.recipes.barriers.DistributedBarrier.waitOnBarrier(DistributedBarrier.java:119) ~[curator-recipes-1.3.3.jar:na]
at com.netflix.curator.framework.recipes.barriers.DistributedBarrier.waitOnBarrier(DistributedBarrier.java:99) ~[curator-recipes-1.3.3.jar:na]
at com.acme.my.application.feed.MyListener.waitForWork(MyListener.java:84) ~[my-application-1.6.19.61.jar:na]
at com.acme.my.application.feed.MyListener.waitForAndPerformWork(MyListener.java:62) ~[my-application-1.6.19.61.jar:na]
at com.acme.my.application.feed.MyListener.takeLeadership(MyListener.java:52) ~[my-application-1.6.19.61.jar:na]
at com.netflix.curator.framework.recipes.leader.LeaderSelector$3.run(LeaderSelector.java:326) [curator-recipes-1.3.3.jar:na]
at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:262) [guava-13.0.1.jar:na]
at com.netflix.curator.framework.recipes.leader.LeaderSelector.doWork(LeaderSelector.java:317) [curator-recipes-1.3.3.jar:na]
at com.netflix.curator.framework.recipes.leader.LeaderSelector.doWorkLoop(LeaderSelector.java:373) [curator-recipes-1.3.3.jar:na]
at com.netflix.curator.framework.recipes.leader.LeaderSelector.access$100(LeaderSelector.java:46) [curator-recipes-1.3.3.jar:na]
at com.netflix.curator.framework.recipes.leader.LeaderSelector$2.call(LeaderSelector.java:195) [curator-recipes-1.3.3.jar:na]
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [na:1.7.0_11]
at java.util.concurrent.FutureTask.run(FutureTask.java:166) [na:1.7.0_11]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [na:1.7.0_11]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [na:1.7.0_11]
at java.lang.Thread.run(Thread.java:722) [na:1.7.0_11]
2013-11-04 18:22:34,644 DEBUG [LeaderSelector-0 ] s.f.s.a.feed.MyListener - (Thread[LeaderSelector-0,5,main]) No longer leader for SALDO_RENTE
2013-11-04 18:22:35,259 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:35,259 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:35,259 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:35,260 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:36,361 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:36,361 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:36,361 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:36,363 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:36,464 ERROR [main-EventThread ] c.n.c.f.imps.CuratorFrameworkImpl - Background operation retry gave up
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at com.netflix.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:486) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:49) [curator-framework-1.3.3.jar:na]
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:606) [zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) [zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:36,465 INFO [main-EventThread ] com.netflix.curator.ConnectionState - lost marked
2013-11-04 18:22:36,465 INFO [main-EventThread ] c.n.c.f.state.ConnectionStateManager - State change: LOST
2013-11-04 18:22:36,465 INFO [main-EventThread ] c.n.c.f.state.ConnectionStateManager - State change: SUSPENDED
2013-11-04 18:22:36,465 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - StateChanged: LOST
2013-11-04 18:22:36,465 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - Interrupting thread Thread[LeaderSelector-0,5,main]
2013-11-04 18:22:36,466 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - StateChanged: SUSPENDED
2013-11-04 18:22:36,466 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - Interrupting thread Thread[LeaderSelector-0,5,main]
2013-11-04 18:22:36,465 INFO [main-EventThread ] com.netflix.curator.ConnectionState - resetting after loss
2013-11-04 18:22:37,464 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:37,464 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:37,565 INFO [main-EventThread ] org.apache.zookeeper.ZooKeeper - Session: 0x0 closed
2013-11-04 18:22:37,566 INFO [main-EventThread ] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=s02:39000 sessionTimeout=60000 watcher=com.netflix.curator.ConnectionState@31a809e1
2013-11-04 18:22:37,568 INFO [main-EventThread ] org.apache.zookeeper.ClientCnxn - EventThread shut down
2013-11-04 18:22:37,569 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:37,569 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:37,573 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:37,574 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:38,677 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:38,677 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:38,677 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:38,678 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:39,779 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:39,779 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:39,779 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:39,781 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:40,882 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:40,882 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:40,882 ERROR [main-EventThread ] com.netflix.curator.ConnectionState - Authentication failed
2013-11-04 18:22:40,884 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.7.0_11]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) ~[na:1.7.0_11]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:40,985 ERROR [main-EventThread ] c.n.c.f.imps.CuratorFrameworkImpl - Background operation retry gave up
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at com.netflix.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:486) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:49) [curator-framework-1.3.3.jar:na]
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:606) [zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) [zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:40,985 INFO [main-EventThread ] com.netflix.curator.ConnectionState - lost marked
2013-11-04 18:22:40,985 INFO [main-EventThread ] c.n.c.f.state.ConnectionStateManager - State change: LOST
2013-11-04 18:22:40,986 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - StateChanged: LOST
2013-11-04 18:22:40,986 ERROR [main-EventThread ] c.n.c.f.imps.CuratorFrameworkImpl - Background operation retry gave up
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at com.netflix.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:486) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:49) [curator-framework-1.3.3.jar:na]
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:606) [zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) [zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:40,986 INFO [main-EventThread ] com.netflix.curator.ConnectionState - lost marked
2013-11-04 18:22:40,986 DEBUG [ectionStateManager-0] s.f.s.a.feed.MyListener - Interrupting thread Thread[LeaderSelector-0,5,main]
2013-11-04 18:22:40,986 ERROR [main-EventThread ] c.n.c.f.imps.CuratorFrameworkImpl - Background operation retry gave up
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at com.netflix.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:486) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:49) [curator-framework-1.3.3.jar:na]
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:606) [zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) [zookeeper-3.4.5.jar:3.4.5-1392090]
2013-11-04 18:22:40,986 INFO [main-EventThread ] com.netflix.curator.ConnectionState - lost marked
2013-11-04 18:22:40,986 INFO [main-EventThread ] com.netflix.curator.ConnectionState - resetting after loss
2013-11-04 18:22:41,985 WARN [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: 'config/login.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it.
2013-11-04 18:22:41,985 INFO [s02.acme.com:39000) ] org.apache.zookeeper.ClientCnxn - Opening socket connection to server s02.acme.com/11.17.9.21:39000
2013-11-04 18:22:42,086 INFO [main-EventThread ] org.apache.zookeeper.ZooKeeper - Session: 0x0 closed
2013-11-04 18:22:42,089 INFO [main-EventThread ] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=s02:39000 sessionTimeout=60000 watcher=com.netflix.curator.ConnectionState@31a809e1
2013-11-04 18:22:42,090 ERROR [main-EventThread ] c.n.c.f.imps.CuratorFrameworkImpl - Background operation retry gave up
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.5.jar:3.4.5-1392090]
at com.netflix.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:486) ~[curator-framework-1.3.3.jar:na]
at com.netflix.curator.framework.imps.DeleteBuilderImpl$2.processResult(DeleteBuilderImpl.java:145) [curator-framework-1.3.3.jar:na]
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:606) [zookeeper-3.4.5.jar:3.4.5-1392090]
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) [zookeeper-3.4.5.jar:3.4.5-1392090]
@Override
public void takeLeadership(CuratorFramework curatorFramework) throws Exception {
ourThread = Thread.currentThread();
logger.debug(format("(%s) Got leadership", ourThread));
try {
waitForAndPerformWork();
} catch (InterruptedException e) {
logger.debug(format("(%s) Interrupted ", ourThread), e);
} finally {
logger.debug(format("(%s) No longer leader", ourThread));
}
}
@Override
public void stateChanged(CuratorFramework curatorFramework, ConnectionState newState) {
logger.debug("StateChanged: " + newState);
if ((newState == ConnectionState.LOST) || (newState == ConnectionState.SUSPENDED)) {
if (ourThread != null) {
logger.debug("Interrupting thread " + ourThread);
ourThread.interrupt();
} else {
logger.debug("Thread is null");
}
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment