Skip to content

Instantly share code, notes, and snippets.

@danfairs

danfairs/gist:4547184

Created January 16, 2013 13:34
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save danfairs/4547184 to your computer and use it in GitHub Desktop.
Save danfairs/4547184 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
Non-default config:
cluster.name: staging-es
http.port: 9600
transport.tcp.port: 9700
index.cache.field.type: soft
script.native:
excludetags.type: com.secondsync.elasticsearch.script.ExcludeTagsScriptFactory
discovery.zen.ping.multicast.enabled: false
discovery.zen.ping.unicast.enabled: true
discovery.zen.ping.unicast.hosts: ["176.58.126.151:9700"]
discovery.zen.ping.timeout: 15s
discovery.zen.fd.ping_interval: 5s
discovery.zen.fd.ping_timeout: 30s
discovery.zen.fd.ping_retries: 6
Log from Linode (which I'm starting first, and is has the IP address in unicast.hosts):
[2013-01-16 13:29:16,657][WARN ][bootstrap ] jvm uses the client vm, make sure to run `java` with the server vm for best performance by adding `-server` to the command line
[2013-01-16 13:29:16,672][INFO ][node ] [Silver Dagger] {0.19.8}[32698]: initializing ...
[2013-01-16 13:29:16,743][INFO ][plugins ] [Silver Dagger] loaded [], sites [bigdesk, head]
[2013-01-16 13:29:20,291][DEBUG][discovery.zen.ping.unicast] [Silver Dagger] using initial hosts [176.58.126.151:9700], with concurrent_connects [10]
[2013-01-16 13:29:20,293][DEBUG][discovery.zen ] [Silver Dagger] using ping.timeout [15s], master_election.filter_client [true], master_election.filter_data [false]
[2013-01-16 13:29:20,302][DEBUG][discovery.zen.elect ] [Silver Dagger] using minimum_master_nodes [-1]
[2013-01-16 13:29:20,304][DEBUG][discovery.zen.fd ] [Silver Dagger] [master] uses ping_interval [5s], ping_timeout [30s], ping_retries [6]
[2013-01-16 13:29:20,312][DEBUG][discovery.zen.fd ] [Silver Dagger] [node ] uses ping_interval [5s], ping_timeout [30s], ping_retries [6]
[2013-01-16 13:29:23,143][INFO ][node ] [Silver Dagger] {0.19.8}[32698]: initialized
[2013-01-16 13:29:23,143][INFO ][node ] [Silver Dagger] {0.19.8}[32698]: starting ...
[2013-01-16 13:29:23,394][INFO ][transport ] [Silver Dagger] bound_address {inet[/0:0:0:0:0:0:0:0:9700]}, publish_address {inet[/176.58.126.151:9700]}
[2013-01-16 13:29:23,411][TRACE][discovery ] [Silver Dagger] waiting for 30s for the initial state to be set by the discovery
[2013-01-16 13:29:23,415][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] connecting to [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:23,504][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] connected to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:23,512][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] sending to [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:23,554][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] received response from [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]: [ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}]
[2013-01-16 13:29:30,916][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] sending to [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:30,919][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] received response from [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]: [ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}]
[2013-01-16 13:29:38,418][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] sending to [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:38,420][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] received response from [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]: [ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}]
[2013-01-16 13:29:38,423][TRACE][discovery.zen.ping.unicast] [Silver Dagger] [1] disconnecting from [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:38,423][TRACE][discovery.zen ] [Silver Dagger] full ping responses: {none}
[2013-01-16 13:29:38,425][DEBUG][discovery.zen ] [Silver Dagger] filtered ping responses: (filter_client[true], filter_data[false]) {none}
[2013-01-16 13:29:38,436][INFO ][cluster.service ] [Silver Dagger] new_master [Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]], reason: zen-disco-join (elected_as_master)
[2013-01-16 13:29:38,447][TRACE][discovery ] [Silver Dagger] initial state set from discovery
[2013-01-16 13:29:38,447][INFO ][discovery ] [Silver Dagger] staging-es/3WJRm7oNRNKcJhJVofLZhA
[2013-01-16 13:29:38,585][INFO ][http ] [Silver Dagger] bound_address {inet[/0:0:0:0:0:0:0:0:9600]}, publish_address {inet[/176.58.126.151:9600]}
[2013-01-16 13:29:38,585][INFO ][node ] [Silver Dagger] {0.19.8}[32698]: started
[2013-01-16 13:29:39,999][INFO ][gateway ] [Silver Dagger] recovered [23] indices into cluster_state
Log from the EC2 instance:
[2013-01-16 13:29:53,768][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] connected to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:53,768][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:29:53,811][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:30:01,235][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:01,252][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:30:08,737][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:08,766][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:30:08,767][TRACE][discovery.zen ] [Grey, Rachel] full ping responses:
--> target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]]
[2013-01-16 13:30:08,768][DEBUG][discovery.zen ] [Grey, Rachel] filtered ping responses: (filter_client[true], filter_data[false])
--> target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]]
[2013-01-16 13:30:08,771][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [1] disconnecting from [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:23,732][WARN ][discovery ] [Grey, Rachel] waited for 30s and no initial state was set by the discovery
[2013-01-16 13:30:23,732][INFO ][discovery ] [Grey, Rachel] staging-es/kCdKvx2VQgSyZyAvc1Xv8Q
[2013-01-16 13:30:23,736][INFO ][http ] [Grey, Rachel] bound_address {inet[/0:0:0:0:0:0:0:0:9600]}, publish_address {inet[/10.33.160.162:9600]}
[2013-01-16 13:30:23,737][INFO ][node ] [Grey, Rachel] {0.19.8}[8582]: started
[2013-01-16 13:30:23,802][INFO ][discovery.zen ] [Grey, Rachel] failed to send join request to master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], reason [org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for task.]
[2013-01-16 13:30:23,802][TRACE][discovery.zen ] [Grey, Rachel] detailed failed reason
org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for task.
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:63)
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:35)
at org.elasticsearch.discovery.zen.membership.MembershipAction.sendJoinRequestBlocking(MembershipAction.java:84)
at org.elasticsearch.discovery.zen.ZenDiscovery.innterJoinCluster(ZenDiscovery.java:335)
at org.elasticsearch.discovery.zen.ZenDiscovery.access$500(ZenDiscovery.java:75)
at org.elasticsearch.discovery.zen.ZenDiscovery$1.run(ZenDiscovery.java:280)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
[2013-01-16 13:30:23,805][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] connecting (light) to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:23,820][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] connected to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:23,821][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:23,836][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:30:31,305][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:31,323][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:30:38,806][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:38,822][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:30:38,823][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [2] disconnecting from [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:38,823][TRACE][discovery.zen ] [Grey, Rachel] full ping responses:
--> target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]]
[2013-01-16 13:30:38,826][DEBUG][discovery.zen ] [Grey, Rachel] filtered ping responses: (filter_client[true], filter_data[false])
--> target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]]
[2013-01-16 13:30:53,826][INFO ][discovery.zen ] [Grey, Rachel] failed to send join request to master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], reason [org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for task.]
[2013-01-16 13:30:53,827][TRACE][discovery.zen ] [Grey, Rachel] detailed failed reason
org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for task.
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:63)
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:35)
at org.elasticsearch.discovery.zen.membership.MembershipAction.sendJoinRequestBlocking(MembershipAction.java:84)
at org.elasticsearch.discovery.zen.ZenDiscovery.innterJoinCluster(ZenDiscovery.java:335)
at org.elasticsearch.discovery.zen.ZenDiscovery.access$500(ZenDiscovery.java:75)
at org.elasticsearch.discovery.zen.ZenDiscovery$1.run(ZenDiscovery.java:280)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
[2013-01-16 13:30:53,828][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] connecting (light) to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:53,843][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] connected to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:53,843][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:30:53,858][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:31:01,329][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:31:01,348][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:31:08,829][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:31:08,847][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
[2013-01-16 13:31:08,847][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [3] disconnecting from [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:31:08,848][TRACE][discovery.zen ] [Grey, Rachel] full ping responses:
--> target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]]
[2013-01-16 13:31:08,849][DEBUG][discovery.zen ] [Grey, Rachel] filtered ping responses: (filter_client[true], filter_data[false])
--> target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]]
[2013-01-16 13:31:23,849][INFO ][discovery.zen ] [Grey, Rachel] failed to send join request to master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], reason [org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for task.]
[2013-01-16 13:31:23,849][TRACE][discovery.zen ] [Grey, Rachel] detailed failed reason
org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for task.
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:63)
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:35)
at org.elasticsearch.discovery.zen.membership.MembershipAction.sendJoinRequestBlocking(MembershipAction.java:84)
at org.elasticsearch.discovery.zen.ZenDiscovery.innterJoinCluster(ZenDiscovery.java:335)
at org.elasticsearch.discovery.zen.ZenDiscovery.access$500(ZenDiscovery.java:75)
at org.elasticsearch.discovery.zen.ZenDiscovery$1.run(ZenDiscovery.java:280)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
[2013-01-16 13:31:23,851][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [4] connecting (light) to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:31:23,866][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [4] connected to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:31:23,866][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [4] sending to [#zen_unicast_1#][inet[/176.58.126.151:9700]]
[2013-01-16 13:31:23,881][TRACE][discovery.zen.ping.unicast] [Grey, Rachel] [4] received response from [#zen_unicast_1#][inet[/176.58.126.151:9700]]: [ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Grey, Rachel][kCdKvx2VQgSyZyAvc1Xv8Q][inet[/10.33.160.162:9700]]], master [null], cluster_name[staging-es]}, ping_response{target [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], master [[Silver Dagger][3WJRm7oNRNKcJhJVofLZhA][inet[/176.58.126.151:9700]]], cluster_name[staging-es]}]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment