Skip to content

Instantly share code, notes, and snippets.

@runarmyklebust
Created August 13, 2013 21:05
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save runarmyklebust/6225706 to your computer and use it in GitHub Desktop.
Save runarmyklebust/6225706 to your computer and use it in GitHub Desktop.
Log from node falling out of cluster
2013-08-13 06:32:24,335 WARN [org.elasticsearch.discovery.zen] (elasticsearch[local][clusterService#updateTask][T#1]) [local] received cluster state from [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}] which is also master but with an older cluster_state, telling [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}] to rejoin the cluster
2013-08-13 06:32:24,338 WARN [org.elasticsearch.discovery.zen] (elasticsearch[local][generic][T#460]) [local] failed to send rejoin request to [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}]: org.elasticsearch.transport.SendRequestTransportException: [local][inet[/10.51.9.66:8800]][discovery/zen/rejoin]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:199) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:171) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.discovery.zen.ZenDiscovery$7.execute(ZenDiscovery.java:526) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:223) [elasticsearch-0.20.6.jar:]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_25]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_25]
at java.lang.Thread.run(Thread.java:724) [rt.jar:1.7.0_25]
Caused by: org.elasticsearch.transport.NodeNotConnectedException: [local][inet[/10.51.9.66:8800]] Node not connected
at org.elasticsearch.transport.netty.NettyTransport.nodeChannel(NettyTransport.java:788) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.netty.NettyTransport.sendRequest(NettyTransport.java:522) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:184) [elasticsearch-0.20.6.jar:]
... 6 more
2013-08-13 06:32:24,374 WARN [org.elasticsearch.discovery.zen] (elasticsearch[local][clusterService#updateTask][T#1]) [local] received cluster state from [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}] which is also master but with an older cluster_state, telling [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}] to rejoin the cluster
2013-08-13 06:32:24,375 WARN [org.elasticsearch.discovery.zen] (elasticsearch[local][generic][T#462]) [local] failed to send rejoin request to [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}]: org.elasticsearch.transport.SendRequestTransportException: [local][inet[/10.51.9.66:8800]][discovery/zen/rejoin]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:199) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:171) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.discovery.zen.ZenDiscovery$7.execute(ZenDiscovery.java:526) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:223) [elasticsearch-0.20.6.jar:]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_25]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_25]
at java.lang.Thread.run(Thread.java:724) [rt.jar:1.7.0_25]
Caused by: org.elasticsearch.transport.NodeNotConnectedException: [local][inet[/10.51.9.66:8800]] Node not connected
at org.elasticsearch.transport.netty.NettyTransport.nodeChannel(NettyTransport.java:788) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.netty.NettyTransport.sendRequest(NettyTransport.java:522) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:184) [elasticsearch-0.20.6.jar:]
... 6 more
2013-08-13 06:32:25,263 WARN [org.elasticsearch.discovery.zen] (elasticsearch[local][clusterService#updateTask][T#1]) [local] received cluster state from [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}] which is also master but with an older cluster_state, telling [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}] to rejoin the cluster
2013-08-13 06:32:25,264 WARN [org.elasticsearch.discovery.zen] (elasticsearch[local][generic][T#462]) [local] failed to send rejoin request to [[local][AaxhMxGQTA-IvO88ORiL5w][inet[/10.51.9.66:8800]]{local=false}]: org.elasticsearch.transport.SendRequestTransportException: [local][inet[/10.51.9.66:8800]][discovery/zen/rejoin]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:199) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:171) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.discovery.zen.ZenDiscovery$7.execute(ZenDiscovery.java:526) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:223) [elasticsearch-0.20.6.jar:]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_25]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_25]
at java.lang.Thread.run(Thread.java:724) [rt.jar:1.7.0_25]
Caused by: org.elasticsearch.transport.NodeNotConnectedException: [local][inet[/10.51.9.66:8800]] Node not connected
at org.elasticsearch.transport.netty.NettyTransport.nodeChannel(NettyTransport.java:788) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.netty.NettyTransport.sendRequest(NettyTransport.java:522) [elasticsearch-0.20.6.jar:]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:184) [elasticsearch-0.20.6.jar:]
... 6 more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment