Skip to content

Instantly share code, notes, and snippets.

@elhu
Last active December 18, 2015 15:39
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save elhu/5805776 to your computer and use it in GitHub Desktop.
Save elhu/5805776 to your computer and use it in GitHub Desktop.
ElasticSearch unicast discovery problem
# from java1
cluster.name: dimelo
network.bind_host: 0.0.0.0
network.publish_host: 10.10.4.8
discovery.zen.ping.multicast.enabled: false
discovery.zen.ping.unicast.hosts: ["java1.dimelo:9200", "java2.dimelo:9200"]
# from java2
[2013-06-18 12:06:13,781][TRACE][discovery.zen.ping.unicast] [Storm] failed to connect to [#zen_unicast_1#][inet[java1.dimelo/10.10.4.8:9200]]
org.elasticsearch.transport.NodeDisconnectedException: [][inet[java1.dimelo/10.10.4.8:9200]][discovery/zen/unicast] disconnected
[2013-06-18 12:06:15,276][TRACE][discovery.zen.ping.unicast] [Storm] [1] connecting (light) to [#zen_unicast_2#][inet[java2.dimelo/10.10.4.15:9200]]
[2013-06-18 12:06:15,276][TRACE][discovery.zen.ping.unicast] [Storm] [1] connecting (light) to [#zen_unicast_1#][inet[java1.dimelo/10.10.4.8:9200]]
[2013-06-18 12:06:15,278][TRACE][discovery.zen.ping.unicast] [Storm] [1] failed to connect to [#zen_unicast_2#][inet[java2.dimelo/10.10.4.15:9200]]
org.elasticsearch.transport.ConnectTransportException: [][inet[java2.dimelo/10.10.4.15:9200]] connect_timeout[30s]
at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:644)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:606)
at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:575)
at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:131)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:273)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.ConnectException: Connection refused: java2.dimelo/10.10.4.15:9200
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:150)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
... 3 more
[2013-06-18 12:06:15,280][TRACE][discovery.zen.ping.unicast] [Storm] [1] connected to [#zen_unicast_1#][inet[java1.dimelo/10.10.4.8:9200]]
[2013-06-18 12:06:15,280][TRACE][discovery.zen.ping.unicast] [Storm] [1] sending to [#zen_unicast_1#][inet[java1.dimelo/10.10.4.8:9200]]
[2013-06-18 12:06:15,283][TRACE][discovery.zen.ping.unicast] [Storm] failed to connect to [#zen_unicast_1#][inet[java1.dimelo/10.10.4.8:9200]]
org.elasticsearch.transport.NodeDisconnectedException: [][inet[java1.dimelo/10.10.4.8:9200]][discovery/zen/unicast] disconnected
[2013-06-18 12:06:15,283][TRACE][discovery.zen.ping.unicast] [Storm] [1] disconnecting from [#zen_unicast_1#][inet[java1.dimelo/10.10.4.8:9200]]
[2013-06-18 12:06:15,283][TRACE][discovery.zen.ping.unicast] [Storm] [1] disconnecting from [#zen_unicast_2#][inet[java2.dimelo/10.10.4.15:9200]]
[2013-06-18 12:06:15,284][TRACE][discovery.zen ] [Storm] full ping responses: {none}
[2013-06-18 12:06:15,284][DEBUG][discovery.zen ] [Storm] filtered ping responses: (filter_client[true], filter_data[false]) {none}
[2013-06-18 12:06:15,289][INFO ][cluster.service ] [Storm] new_master [Storm][STcJFys-QPaCS3ItBtDpsg][inet[/10.10.4.15:9300]], reason: zen-disco-join (elected_as_master)
[2013-06-18 12:06:15,301][TRACE][discovery ] [Storm] initial state set from discovery
[2013-06-18 12:06:15,301][INFO ][discovery ] [Storm] dimelo/STcJFys-QPaCS3ItBtDpsg
[2013-06-18 12:06:15,339][INFO ][http ] [Storm] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/10.10.4.15:9200]}
[2013-06-18 12:06:15,339][INFO ][node ] [Storm] {0.90.0}[22798]: started
[2013-06-18 12:06:15,386][INFO ][gateway ] [Storm] recovered [0] indices into cluster_state
[2013-06-18 12:07:39,924][WARN ][http.netty ] [Storm] Caught exception while handling client http traffic, closing connection [id: 0xe913752f, /10.10.4.8:5961 => /10.10.4.15:9200]
java.lang.IllegalArgumentException: empty text
at org.elasticsearch.common.netty.handler.codec.http.HttpVersion.<init>(HttpVersion.java:97)
at org.elasticsearch.common.netty.handler.codec.http.HttpVersion.valueOf(HttpVersion.java:62)
at org.elasticsearch.common.netty.handler.codec.http.HttpRequestDecoder.createMessage(HttpRequestDecoder.java:75)
at org.elasticsearch.common.netty.handler.codec.http.HttpMessageDecoder.decode(HttpMessageDecoder.java:189)
at org.elasticsearch.common.netty.handler.codec.http.HttpMessageDecoder.decode(HttpMessageDecoder.java:101)
at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500)
at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:107)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
# from java2
cluster.name: dimelo
network.bind_host: 0.0.0.0
network.publish_host: 10.10.4.15
discovery.zen.ping.multicast.enabled: false
discovery.zen.ping.unicast.hosts: ["java1.dimelo:9200", "java2.dimelo:9200"]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment