Skip to content

Instantly share code, notes, and snippets.

@imotov

imotov/gist:a1512b9a27a2854c90f5 Secret

Created August 24, 2015 21:05
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save imotov/a1512b9a27a2854c90f5 to your computer and use it in GitHub Desktop.
Save imotov/a1512b9a27a2854c90f5 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
Suite: org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests
1> [2015-08-24 10:02:04,630][DEBUG][discovery.zen.publish ] [node] received full cluster state version [1] with size [94]
1> [2015-08-24 10:02:04,644][DEBUG][discovery.zen.publish ] [node] received full cluster state version [2] with size [94]
1> [2015-08-24 10:02:04,645][DEBUG][discovery.zen.publish ] [node] received version [2], uuid [KexKd7JsRAC7ukW9Rvwasg]
1> [2015-08-24 10:02:04,720][DEBUG][discovery.zen.publish ] [nodeB] received diff for but don't have any local cluster state - requesting full state
1> [2015-08-24 10:02:04,748][DEBUG][discovery.zen.publish ] [nodeA] resending full cluster state to node {nodeB}{nodeB}{local}{local[14]} reason RemoteTransportException[[nodeA][local[13]][internal:discovery/zen/publish/send]]; nested: IncompatibleClusterStateVersionException[have no local cluster state];; org.elasticsearch.cluster.IncompatibleClusterStateVersionException: have no local cluster state
1> [2015-08-24 10:02:04,775][DEBUG][discovery.zen.publish ] [nodeB] received full cluster state version [1] with size [104]
1> [2015-08-24 10:02:04,791][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [TGVk4FO1TaOvxSfBcIkT1w], version [1]) to [{nodeB}{nodeB}{local}{local[14]}]
1> [2015-08-24 10:02:04,809][DEBUG][discovery.zen.publish ] [nodeB] received version [1], uuid [TGVk4FO1TaOvxSfBcIkT1w]
1> [2015-08-24 10:02:04,858][INFO ][discovery.zen.publish ] --> testing acceptances of any master when having no master
1> [2015-08-24 10:02:04,858][INFO ][discovery.zen.publish ] --> testing rejection of another master
1> [2015-08-24 10:02:04,858][WARN ][discovery.zen.publish ] [node] received a cluster state from a different master than the current one, rejecting (received null, current null)
1> [2015-08-24 10:02:04,858][INFO ][discovery.zen.publish ] --> test state from the current master is accepted
1> [2015-08-24 10:02:04,858][INFO ][discovery.zen.publish ] --> testing rejection of another cluster name
1> [2015-08-24 10:02:04,858][WARN ][discovery.zen.publish ] [node] received cluster state from [null] which is also master but with a different cluster name [Cluster [ohgIOhvKwL]]
1> [2015-08-24 10:02:04,859][INFO ][discovery.zen.publish ] --> testing rejection of a cluster state with wrong local node
1> [2015-08-24 10:02:04,859][WARN ][discovery.zen.publish ] [node] received a cluster state from [null] and not part of the cluster, should not happen
1> [2015-08-24 10:02:04,870][WARN ][discovery.zen.publish ] [node] received a cluster state from [null] and not part of the cluster, should not happen
1> [2015-08-24 10:02:04,900][DEBUG][discovery.zen.publish ] [nodeB] received diff for but don't have any local cluster state - requesting full state
1> [2015-08-24 10:02:04,906][DEBUG][discovery.zen.publish ] [nodeA] resending full cluster state to node {nodeB}{nodeB}{local}{local[18]} reason RemoteTransportException[[nodeA][local[17]][internal:discovery/zen/publish/send]]; nested: IncompatibleClusterStateVersionException[have no local cluster state];; org.elasticsearch.cluster.IncompatibleClusterStateVersionException: have no local cluster state
1> [2015-08-24 10:02:04,929][DEBUG][discovery.zen.publish ] [nodeB] received full cluster state version [1] with size [104]
1> [2015-08-24 10:02:04,932][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [GbGE_nfGRGOiXQlkpC1IPQ], version [1]) to [{nodeB}{nodeB}{local}{local[18]}]
1> [2015-08-24 10:02:04,933][DEBUG][discovery.zen.publish ] [nodeB] received version [1], uuid [GbGE_nfGRGOiXQlkpC1IPQ]
1> [2015-08-24 10:02:04,942][DEBUG][discovery.zen.publish ] [nodeB] received diff cluster state version [2] with uuid [OY14CT-vRbmoUGmISEudQA], diff size [133]
1> [2015-08-24 10:02:04,947][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [OY14CT-vRbmoUGmISEudQA], version [2]) to [{nodeB}{nodeB}{local}{local[18]}]
1> [2015-08-24 10:02:04,947][DEBUG][discovery.zen.publish ] [nodeB] received version [2], uuid [OY14CT-vRbmoUGmISEudQA]
1> [2015-08-24 10:02:04,970][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [1] with size [194]
1> [2015-08-24 10:02:04,979][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [1] with size [194]
1> [2015-08-24 10:02:05,033][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [Jl3hD61XRz-ZeSDgYTlfCw], version [1]) to [{node2}{node2}{local}{local[21]}]
1> [2015-08-24 10:02:05,034][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [Jl3hD61XRz-ZeSDgYTlfCw], version [1]) to [{node1}{node1}{local}{local[20]}]
1> [2015-08-24 10:02:05,037][DEBUG][discovery.zen.publish ] [node2] received version [1], uuid [Jl3hD61XRz-ZeSDgYTlfCw]
1> [2015-08-24 10:02:05,042][DEBUG][discovery.zen.publish ] [node1] received version [1], uuid [Jl3hD61XRz-ZeSDgYTlfCw]
1> [2015-08-24 10:02:05,060][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [2] with size [206]
1> [2015-08-24 10:02:05,061][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [yJsXjHuXTmuqzv2N11jUFA], version [2]) to [{node1}{node1}{local}{local[20]}]
1> [2015-08-24 10:02:05,062][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [2] with size [206]
1> [2015-08-24 10:02:05,063][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [yJsXjHuXTmuqzv2N11jUFA], version [2]) to [{node2}{node2}{local}{local[21]}]
1> [2015-08-24 10:02:05,063][DEBUG][discovery.zen.publish ] [node1] received version [2], uuid [yJsXjHuXTmuqzv2N11jUFA]
1> [2015-08-24 10:02:05,064][DEBUG][discovery.zen.publish ] [node2] received version [2], uuid [yJsXjHuXTmuqzv2N11jUFA]
1> [2015-08-24 10:02:05,065][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [3] with size [211]
1> [2015-08-24 10:02:05,070][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [3] with size [211]
1> [2015-08-24 10:02:05,070][TRACE][discovery.zen.publish ] [node0] master node {node1}{node1}{local}{local[20]} acked cluster state version [3]. processing ... (current pending [2], needed [2])
1> [2015-08-24 10:02:05,070][TRACE][discovery.zen.publish ] [node0] master node {node2}{node2}{local}{local[21]} acked cluster state version [3]. processing ... (current pending [1], needed [1])
1> [2015-08-24 10:02:05,071][TRACE][discovery.zen.publish ] [node0] committing version [3]
1> [2015-08-24 10:02:05,071][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [nihaL_--ROCtzPG1VrsDLw], version [3]) to [{node1}{node1}{local}{local[20]}]
1> [2015-08-24 10:02:05,071][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [nihaL_--ROCtzPG1VrsDLw], version [3]) to [{node2}{node2}{local}{local[21]}]
1> [2015-08-24 10:02:05,071][DEBUG][discovery.zen.publish ] [node1] received version [3], uuid [nihaL_--ROCtzPG1VrsDLw]
1> [2015-08-24 10:02:05,071][DEBUG][discovery.zen.publish ] [node2] received version [3], uuid [nihaL_--ROCtzPG1VrsDLw]
1> [2015-08-24 10:02:05,073][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [4] with size [219]
1> [2015-08-24 10:02:05,073][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [4] with size [219]
1> [2015-08-24 10:02:05,074][TRACE][discovery.zen.publish ] [node0] master node {node1}{node1}{local}{local[20]} acked cluster state version [4]. processing ... (current pending [2], needed [1])
1> [2015-08-24 10:02:05,074][TRACE][discovery.zen.publish ] [node0] committing version [4]
1> [2015-08-24 10:02:05,074][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [fWOqhSMjSiGFRkGfNCryng], version [4]) to [{node1}{node1}{local}{local[20]}]
1> [2015-08-24 10:02:05,074][DEBUG][discovery.zen.publish ] [node1] received version [4], uuid [fWOqhSMjSiGFRkGfNCryng]
1> [2015-08-24 10:02:05,075][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [fWOqhSMjSiGFRkGfNCryng], version [4]) to [{node2}{node2}{local}{local[21]}]
1> [2015-08-24 10:02:05,076][DEBUG][discovery.zen.publish ] [node2] received version [4], uuid [fWOqhSMjSiGFRkGfNCryng]
1> [2015-08-24 10:02:05,077][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [5] with size [231]
1> [2015-08-24 10:02:05,077][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [5] with size [231]
1> [2015-08-24 10:02:05,077][TRACE][discovery.zen.publish ] [node0] master node {node1}{node1}{local}{local[20]} acked cluster state version [5]. processing ... (current pending [2], needed [1])
1> [2015-08-24 10:02:05,078][TRACE][discovery.zen.publish ] [node0] committing version [5]
1> [2015-08-24 10:02:05,078][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [iUL3v_Y5REOPbFJ-jOQcWw], version [5]) to [{node1}{node1}{local}{local[20]}]
1> [2015-08-24 10:02:05,078][DEBUG][discovery.zen.publish ] [node1] received version [5], uuid [iUL3v_Y5REOPbFJ-jOQcWw]
1> [2015-08-24 10:02:05,078][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [iUL3v_Y5REOPbFJ-jOQcWw], version [5]) to [{node2}{node2}{local}{local[21]}]
1> [2015-08-24 10:02:05,079][DEBUG][discovery.zen.publish ] [node2] received version [5], uuid [iUL3v_Y5REOPbFJ-jOQcWw]
1> [2015-08-24 10:02:05,080][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [6] with size [231]
1> [2015-08-24 10:02:05,081][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [6] with size [231]
1> [2015-08-24 10:02:05,081][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [X0AThK90QruCwF60JgHyrA], version [6]) to [{node1}{node1}{local}{local[20]}]
1> [2015-08-24 10:02:05,081][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [X0AThK90QruCwF60JgHyrA], version [6]) to [{node2}{node2}{local}{local[21]}]
1> [2015-08-24 10:02:05,081][DEBUG][discovery.zen.publish ] [node1] received version [6], uuid [X0AThK90QruCwF60JgHyrA]
1> [2015-08-24 10:02:05,087][DEBUG][discovery.zen.publish ] [node2] received version [6], uuid [X0AThK90QruCwF60JgHyrA]
1> [2015-08-24 10:02:05,088][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [7] with size [238]
1> [2015-08-24 10:02:05,088][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [7] with size [238]
1> [2015-08-24 10:02:05,089][TRACE][discovery.zen.publish ] [node0] master node {node2}{node2}{local}{local[21]} acked cluster state version [7]. processing ... (current pending [2], needed [1])
1> [2015-08-24 10:02:05,089][TRACE][discovery.zen.publish ] [node0] committing version [7]
1> [2015-08-24 10:02:05,089][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [tM7xNG7KR_eNAceNJmbA3Q], version [7]) to [{node2}{node2}{local}{local[21]}]
1> [2015-08-24 10:02:05,089][DEBUG][discovery.zen.publish ] [node2] received version [7], uuid [tM7xNG7KR_eNAceNJmbA3Q]
1> [2015-08-24 10:02:05,089][TRACE][discovery.zen.publish ] [node0] sending commit for cluster state (uuid: [tM7xNG7KR_eNAceNJmbA3Q], version [7]) to [{node1}{node1}{local}{local[20]}]
1> [2015-08-24 10:02:05,089][DEBUG][discovery.zen.publish ] [node1] received version [7], uuid [tM7xNG7KR_eNAceNJmbA3Q]
1> [2015-08-24 10:02:05,152][DEBUG][discovery.zen.publish ] [nodeB] received full cluster state version [1] with size [104]
1> [2015-08-24 10:02:05,171][TRACE][discovery.zen.publish ] [nodeA] master node {nodeB}{nodeB}{local}{local[23]} acked cluster state version [1]. processing ... (current pending [1], needed [1])
1> [2015-08-24 10:02:05,171][TRACE][discovery.zen.publish ] [nodeA] committing version [1]
1> [2015-08-24 10:02:05,171][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [hC1eDUQeST6J7HeRnMCfaw], version [1]) to [{nodeB}{nodeB}{local}{local[23]}]
1> [2015-08-24 10:02:05,174][DEBUG][discovery.zen.publish ] [nodeB] received version [1], uuid [hC1eDUQeST6J7HeRnMCfaw]
1> [2015-08-24 10:02:05,181][DEBUG][discovery.zen.publish ] [nodeB] received full cluster state version [2] with size [144]
1> [2015-08-24 10:02:05,182][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [74uo2cj3QmiMyH-QwajnYQ], version [2]) to [{nodeB}{nodeB}{local}{local[23]}]
1> [2015-08-24 10:02:05,184][DEBUG][discovery.zen.publish ] [nodeB] received version [2], uuid [74uo2cj3QmiMyH-QwajnYQ]
1> [2015-08-24 10:02:05,279][DEBUG][discovery.zen.publish ] failed to publish as expected
1> FailedToCommitException[not enough masters to ack sent cluster state. [11] needed , have [8]]
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction$SendingController.<init>(PublishClusterStateAction.java:480)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction$SendingController.<init>(PublishClusterStateAction.java:453)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction.publish(PublishClusterStateAction.java:122)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction.publish(PublishClusterStateAction.java:109)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests.publishState(PublishClusterStateActionTests.java:723)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests.testFailToPublishWithLessThanMinMasterNodes(PublishClusterStateActionTests.java:477)
1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
1> at java.lang.reflect.Method.invoke(Method.java:497)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1638)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:883)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:897)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:856)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:758)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:792)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:803)
1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
1> at java.lang.Thread.run(Thread.java:745)
1> [2015-08-24 10:02:05,346][DEBUG][discovery.zen.publish ] --> publishing version [1], UUID [T7hR3e0XSA2RE9EhEdpOlQ]
1> [2015-08-24 10:02:05,350][DEBUG][discovery.zen.publish ] [node] received full cluster state version [1] with size [109]
1> [2015-08-24 10:02:05,350][TRACE][discovery.zen.publish ] [master] failed to commit version [1]. timed out waiting for commit (commit timeout [1ms]
1> [2015-08-24 10:02:05,351][DEBUG][discovery.zen.publish ] --> publishing [failed], verifying...
1> [2015-08-24 10:02:05,351][DEBUG][discovery.zen.publish ] --> publishing version [2], UUID [3JwQUMalTRW_LErOc8zt0g]
1> [2015-08-24 10:02:05,358][TRACE][discovery.zen.publish ] [master] ignoring ack from [{node}{node}{local}{local[37]}] for cluster state version [1]. already failed
1> [2015-08-24 10:02:05,358][DEBUG][discovery.zen.publish ] [node] received full cluster state version [2] with size [110]
1> [2015-08-24 10:02:05,359][TRACE][discovery.zen.publish ] [master] failed to commit version [2]. timed out waiting for commit (commit timeout [1ms]
1> [2015-08-24 10:02:05,359][DEBUG][discovery.zen.publish ] --> publishing [failed], verifying...
1> [2015-08-24 10:02:05,359][DEBUG][discovery.zen.publish ] --> publishing version [3], UUID [NAernx8mR2aF542tyzXYjg]
1> [2015-08-24 10:02:05,393][DEBUG][discovery.zen.publish ] [node] received full cluster state version [3] with size [110]
1> [2015-08-24 10:02:05,394][TRACE][discovery.zen.publish ] [master] failed to commit version [3]. timed out waiting for commit (commit timeout [1ms]
1> [2015-08-24 10:02:05,394][DEBUG][discovery.zen.publish ] --> publishing [failed], verifying...
1> [2015-08-24 10:02:05,394][DEBUG][discovery.zen.publish ] --> publishing version [4], UUID [07AypvKMSUa-M0IBb77rXQ]
1> [2015-08-24 10:02:05,398][TRACE][discovery.zen.publish ] [master] ignoring ack from [{node}{node}{local}{local[37]}] for cluster state version [2]. already failed
1> [2015-08-24 10:02:05,414][TRACE][discovery.zen.publish ] [master] ignoring ack from [{node}{node}{local}{local[37]}] for cluster state version [3]. already failed
1> [2015-08-24 10:02:05,415][TRACE][discovery.zen.publish ] [master] failed to commit version [4]. timed out waiting for commit (commit timeout [1ms]
1> [2015-08-24 10:02:05,415][DEBUG][discovery.zen.publish ] --> publishing [failed], verifying...
1> [2015-08-24 10:02:05,415][DEBUG][discovery.zen.publish ] --> publishing version [5], UUID [B89DSR-EQgau9-Zs8TDR8Q]
1> [2015-08-24 10:02:05,416][DEBUG][discovery.zen.publish ] [node] received full cluster state version [5] with size [110]
1> [2015-08-24 10:02:05,417][TRACE][discovery.zen.publish ] [master] failed to commit version [5]. timed out waiting for commit (commit timeout [1ms]
1> [2015-08-24 10:02:05,417][DEBUG][discovery.zen.publish ] --> publishing [failed], verifying...
1> [2015-08-24 10:02:05,417][DEBUG][discovery.zen.publish ] --> publishing version [6], UUID [P8A6Cn7bQUSq-MuD4OxElg]
1> [2015-08-24 10:02:05,426][DEBUG][discovery.zen.publish ] [node] received full cluster state version [6] with size [110]
1> [2015-08-24 10:02:05,426][TRACE][discovery.zen.publish ] [master] master node {node}{node}{local}{local[37]} acked cluster state version [6]. processing ... (current pending [1], needed [1])
1> [2015-08-24 10:02:05,426][DEBUG][discovery.zen.publish ] [node] received full cluster state version [4] with size [110]
1> [2015-08-24 10:02:05,426][TRACE][discovery.zen.publish ] [master] committing version [6]
1> [2015-08-24 10:02:05,428][TRACE][discovery.zen.publish ] [master] sending commit for cluster state (uuid: [P8A6Cn7bQUSq-MuD4OxElg], version [6]) to [{node}{node}{local}{local[37]}]
1> [2015-08-24 10:02:05,429][DEBUG][discovery.zen.publish ] [master] failed to commit cluster state (uuid [P8A6Cn7bQUSq-MuD4OxElg], version [6]) to {node}{node}{local}{local[37]}
1> RemoteTransportException[[master][local[36]][internal:discovery/zen/publish/commit]]; nested: IllegalStateException[tried to commit cluster state UUID [P8A6Cn7bQUSq-MuD4OxElg], but last seen UUID is [07AypvKMSUa-M0IBb77rXQ]];
1> Caused by: java.lang.IllegalStateException: tried to commit cluster state UUID [P8A6Cn7bQUSq-MuD4OxElg], but last seen UUID is [07AypvKMSUa-M0IBb77rXQ]
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction.handleCommitRequest(PublishClusterStateAction.java:372)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests$MockPublishAction.handleCommitRequest(PublishClusterStateActionTests.java:813)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction$CommitClusterStateRequestHandler.messageReceived(PublishClusterStateAction.java:413)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction$CommitClusterStateRequestHandler.messageReceived(PublishClusterStateAction.java:410)
1> at org.elasticsearch.transport.local.LocalTransport.handleRequest(LocalTransport.java:274)
1> at org.elasticsearch.transport.local.LocalTransport.messageReceived(LocalTransport.java:235)
1> at org.elasticsearch.transport.local.LocalTransport$1.run(LocalTransport.java:213)
1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
1> at java.lang.Thread.run(Thread.java:745)
1> [2015-08-24 10:02:05,430][TRACE][discovery.zen.publish ] [master] ignoring ack from [{node}{node}{local}{local[37]}] for cluster state version [5]. already failed
1> [2015-08-24 10:02:05,430][TRACE][discovery.zen.publish ] [master] ignoring ack from [{node}{node}{local}{local[37]}] for cluster state version [4]. already failed
2>
2> 1) Thread[id=4, name=Signal Dispatcher, state=RUNNABLE, group=system]
2> at (empty stack)
2> 2) Thread[id=10, name=JUnit4-serializer-daemon, state=TIMED_WAITING, group=main]
2> at java.lang.Thread.sleep(Native Method)
2> at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47)
2> 3) Thread[id=3, name=Finalizer, state=WAITING, group=system]
2> at java.lang.Object.wait(Native Method)
2> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
2> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
2> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
2> 4) Thread[id=2, name=Reference Handler, state=WAITING, group=system]
2> at java.lang.Object.wait(Native Method)
2> at java.lang.Object.wait(Object.java:502)
2> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
2> 5) Thread[id=1, name=main, state=WAITING, group=main]
2> at java.lang.Object.wait(Native Method)
2> at java.lang.Thread.join(Thread.java:1245)
2> at java.lang.Thread.join(Thread.java:1319)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:589)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:444)
2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:242)
2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:353)
2> at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
2> 6) Thread[id=301, name=TEST-PublishClusterStateActionTests.testTimeoutOrCommit-seed#[8302BF8B33D58713], state=RUNNABLE, group=TGRP-PublishClusterStateActionTests]
2> at java.lang.Thread.dumpThreads(Native Method)
2> at java.lang.Thread.getAllStackTraces(Thread.java:1603)
2> at org.elasticsearch.test.junit.listeners.AssertionErrorThreadDumpPrinter.testFailure(AssertionErrorThreadDumpPrinter.java:32)
2> at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$4.notifyListener(OrderedRunNotifier.java:129)
2> at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier$SafeNotifier.run(OrderedRunNotifier.java:63)
2> at com.carrotsearch.ant.tasks.junit4.slave.OrderedRunNotifier.fireTestFailure(OrderedRunNotifier.java:131)
2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$SubNotifier.fireTestFailure(ThreadLeakControl.java:181)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner.fireTestFailure(RandomizedRunner.java:774)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:862)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:758)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:792)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:803)
2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
2> at java.lang.Thread.run(Thread.java:745)
2> 7) Thread[id=300, name=SUITE-PublishClusterStateActionTests-seed#[8302BF8B33D58713], state=TIMED_WAITING, group=TGRP-PublishClusterStateActionTests]
2> at java.lang.Object.wait(Native Method)
2> at java.lang.Thread.join(Thread.java:1253)
2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:803)
2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:401)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:662)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138)
2> at com.carrotsearch.randomizedtesting.RandomizedRunner$1.run(RandomizedRunner.java:579)
2> REPRODUCE WITH: mvn test -Pdev -pl org.elasticsearch:elasticsearch -Dtests.seed=8302BF8B33D58713 -Dtests.class=org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests -Dtests.method="testTimeoutOrCommit" -Des.logger.level=ERROR -Dtests.assertion.disabled=false -Dtests.security.manager=true -Dtests.heap.size=512m -Dtests.locale=ar_QA -Dtests.timezone=Pacific/Kwajalein
FAILURE 0.23s J0 | PublishClusterStateActionTests.testTimeoutOrCommit <<<
> Throwable #1: java.lang.AssertionError:
> Expected: an empty iterable
> but: [<Tuple [v1={node}{node}{local}{local[37]}, v2=RemoteTransportException[[master][local[36]][internal:discovery/zen/publish/commit]]; nested: IllegalStateException[tried to commit cluster state UUID [P8A6Cn7bQUSq-MuD4OxElg], but last seen UUID is [07AypvKMSUa-M0IBb77rXQ]];]>]
> at __randomizedtesting.SeedInfo.seed([8302BF8B33D58713:F751AB56DE3AE301]:0)
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests$AssertingAckListener.await(PublishClusterStateActionTests.java:755)
> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests.testTimeoutOrCommit(PublishClusterStateActionTests.java:676)
> at java.lang.Thread.run(Thread.java:745)
1> [2015-08-24 10:02:05,606][DEBUG][discovery.zen.publish ] [nodeB] received full cluster state version [1] with size [104]
1> [2015-08-24 10:02:05,628][TRACE][discovery.zen.publish ] [nodeA] master node {nodeB}{nodeB}{local}{local[39]} acked cluster state version [1]. processing ... (current pending [1], needed [1])
1> [2015-08-24 10:02:05,628][TRACE][discovery.zen.publish ] [nodeA] committing version [1]
1> [2015-08-24 10:02:05,628][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [8neXb5SBRaKlOFV1uJIJ-g], version [1]) to [{nodeB}{nodeB}{local}{local[39]}]
1> [2015-08-24 10:02:05,638][DEBUG][discovery.zen.publish ] [nodeB] received version [1], uuid [8neXb5SBRaKlOFV1uJIJ-g]
1> [2015-08-24 10:02:05,662][DEBUG][discovery.zen.publish ] [nodeB] received diff cluster state version [2] with uuid [d47dRQF3TfW3_0Zfl76Bgg], diff size [133]
1> [2015-08-24 10:02:05,676][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [d47dRQF3TfW3_0Zfl76Bgg], version [2]) to [{nodeB}{nodeB}{local}{local[39]}]
1> [2015-08-24 10:02:05,693][DEBUG][discovery.zen.publish ] [nodeB] received version [2], uuid [d47dRQF3TfW3_0Zfl76Bgg]
1> [2015-08-24 10:02:05,714][DEBUG][discovery.zen.publish ] [nodeB] received diff cluster state version [3] with uuid [p-l42S5HT5W07i_NDKwP4w], diff size [91]
1> [2015-08-24 10:02:05,717][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [p-l42S5HT5W07i_NDKwP4w], version [3]) to [{nodeB}{nodeB}{local}{local[39]}]
1> [2015-08-24 10:02:05,717][DEBUG][discovery.zen.publish ] [nodeB] received version [3], uuid [p-l42S5HT5W07i_NDKwP4w]
1> [2015-08-24 10:02:05,732][DEBUG][discovery.zen.publish ] [nodeB] received diff cluster state version [4] with uuid [vTA8To7HTWyni4U1WIIoGQ], diff size [139]
1> [2015-08-24 10:02:05,738][TRACE][discovery.zen.publish ] [nodeA] master node {nodeB}{nodeB}{local}{local[39]} acked cluster state version [4]. processing ... (current pending [2], needed [2])
1> [2015-08-24 10:02:05,739][DEBUG][discovery.zen.publish ] [nodeC] received full cluster state version [4] with size [115]
1> [2015-08-24 10:02:05,746][TRACE][discovery.zen.publish ] [nodeA] master node {nodeC}{nodeC}{local}{local[40]} acked cluster state version [4]. processing ... (current pending [1], needed [1])
1> [2015-08-24 10:02:05,746][TRACE][discovery.zen.publish ] [nodeA] committing version [4]
1> [2015-08-24 10:02:05,746][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [vTA8To7HTWyni4U1WIIoGQ], version [4]) to [{nodeB}{nodeB}{local}{local[39]}]
1> [2015-08-24 10:02:05,746][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [vTA8To7HTWyni4U1WIIoGQ], version [4]) to [{nodeC}{nodeC}{local}{local[40]}]
1> [2015-08-24 10:02:05,746][DEBUG][discovery.zen.publish ] [nodeB] received version [4], uuid [vTA8To7HTWyni4U1WIIoGQ]
1> [2015-08-24 10:02:05,759][DEBUG][discovery.zen.publish ] [nodeC] received version [4], uuid [vTA8To7HTWyni4U1WIIoGQ]
1> [2015-08-24 10:02:05,760][DEBUG][discovery.zen.publish ] [nodeB] received diff cluster state version [5] with uuid [ME3LlqcGSre7VzKDb9nGSg], diff size [100]
1> [2015-08-24 10:02:05,760][TRACE][discovery.zen.publish ] [nodeA] master node {nodeB}{nodeB}{local}{local[39]} acked cluster state version [5]. processing ... (current pending [2], needed [2])
1> [2015-08-24 10:02:05,763][DEBUG][discovery.zen.publish ] [nodeC] received diff cluster state version [5] with uuid [ME3LlqcGSre7VzKDb9nGSg], diff size [100]
1> [2015-08-24 10:02:05,763][TRACE][discovery.zen.publish ] [nodeA] master node {nodeC}{nodeC}{local}{local[40]} acked cluster state version [5]. processing ... (current pending [1], needed [1])
1> [2015-08-24 10:02:05,763][TRACE][discovery.zen.publish ] [nodeA] committing version [5]
1> [2015-08-24 10:02:05,763][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [ME3LlqcGSre7VzKDb9nGSg], version [5]) to [{nodeB}{nodeB}{local}{local[39]}]
1> [2015-08-24 10:02:05,764][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [ME3LlqcGSre7VzKDb9nGSg], version [5]) to [{nodeC}{nodeC}{local}{local[40]}]
1> [2015-08-24 10:02:05,764][DEBUG][discovery.zen.publish ] [nodeB] received version [5], uuid [ME3LlqcGSre7VzKDb9nGSg]
1> [2015-08-24 10:02:05,771][DEBUG][discovery.zen.publish ] [nodeC] received version [5], uuid [ME3LlqcGSre7VzKDb9nGSg]
1> [2015-08-24 10:02:05,772][DEBUG][discovery.zen.publish ] [nodeA] resending full cluster state to node {nodeC}{nodeC}{local}{local[40]} reason RemoteTransportException[[nodeA][local[38]][internal:discovery/zen/publish/send]]; nested: IncompatibleClusterStateVersionException[Expected diff for version 5 with uuid ME3LlqcGSre7VzKDb9nGSg got version 6 and uuid j2GVPJWiRzuxkI5G1yPr9A];; org.elasticsearch.cluster.IncompatibleClusterStateVersionException: Expected diff for version 5 with uuid ME3LlqcGSre7VzKDb9nGSg got version 6 and uuid j2GVPJWiRzuxkI5G1yPr9A
1> [2015-08-24 10:02:05,772][DEBUG][discovery.zen.publish ] [nodeA] resending full cluster state to node {nodeB}{nodeB}{local}{local[39]} reason RemoteTransportException[[nodeA][local[38]][internal:discovery/zen/publish/send]]; nested: IncompatibleClusterStateVersionException[Expected diff for version 5 with uuid ME3LlqcGSre7VzKDb9nGSg got version 6 and uuid j2GVPJWiRzuxkI5G1yPr9A];; org.elasticsearch.cluster.IncompatibleClusterStateVersionException: Expected diff for version 5 with uuid ME3LlqcGSre7VzKDb9nGSg got version 6 and uuid j2GVPJWiRzuxkI5G1yPr9A
1> [2015-08-24 10:02:05,772][DEBUG][discovery.zen.publish ] [nodeC] received full cluster state version [6] with size [124]
1> [2015-08-24 10:02:05,772][DEBUG][discovery.zen.publish ] [nodeB] received full cluster state version [6] with size [124]
1> [2015-08-24 10:02:05,773][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [cFtUqJ9oRm-3siD0n0nqiA], version [6]) to [{nodeC}{nodeC}{local}{local[40]}]
1> [2015-08-24 10:02:05,773][TRACE][discovery.zen.publish ] [nodeA] sending commit for cluster state (uuid: [cFtUqJ9oRm-3siD0n0nqiA], version [6]) to [{nodeB}{nodeB}{local}{local[39]}]
1> [2015-08-24 10:02:05,774][DEBUG][discovery.zen.publish ] [nodeC] received version [6], uuid [cFtUqJ9oRm-3siD0n0nqiA]
1> [2015-08-24 10:02:05,774][DEBUG][discovery.zen.publish ] [nodeB] received version [6], uuid [cFtUqJ9oRm-3siD0n0nqiA]
1> [2015-08-24 10:02:05,775][DEBUG][discovery.zen.publish ] [nodeA] received diff for but don't have any local cluster state - requesting full state
1> [2015-08-24 10:02:05,776][DEBUG][discovery.zen.publish ] [nodeB] resending full cluster state to node {nodeA}{nodeA}{local}{local[38]} reason RemoteTransportException[[nodeB][local[39]][internal:discovery/zen/publish/send]]; nested: IncompatibleClusterStateVersionException[have no local cluster state];; org.elasticsearch.cluster.IncompatibleClusterStateVersionException: have no local cluster state
1> [2015-08-24 10:02:05,776][DEBUG][discovery.zen.publish ] [nodeA] received full cluster state version [7] with size [127]
1> [2015-08-24 10:02:05,777][DEBUG][discovery.zen.publish ] [nodeB] resending full cluster state to node {nodeC}{nodeC}{local}{local[40]} reason RemoteTransportException[[nodeB][local[39]][internal:discovery/zen/publish/send]]; nested: IncompatibleClusterStateVersionException[Expected diff for version 6 with uuid cFtUqJ9oRm-3siD0n0nqiA got version 7 and uuid TeI6JazERcirnbW9hrUuyg];; org.elasticsearch.cluster.IncompatibleClusterStateVersionException: Expected diff for version 6 with uuid cFtUqJ9oRm-3siD0n0nqiA got version 7 and uuid TeI6JazERcirnbW9hrUuyg
1> [2015-08-24 10:02:05,777][DEBUG][discovery.zen.publish ] [nodeC] received full cluster state version [7] with size [127]
1> [2015-08-24 10:02:05,777][TRACE][discovery.zen.publish ] [nodeB] sending commit for cluster state (uuid: [obUeEwGvSXKWc1DGHnDSYQ], version [7]) to [{nodeA}{nodeA}{local}{local[38]}]
1> [2015-08-24 10:02:05,778][TRACE][discovery.zen.publish ] [nodeB] sending commit for cluster state (uuid: [obUeEwGvSXKWc1DGHnDSYQ], version [7]) to [{nodeC}{nodeC}{local}{local[40]}]
1> [2015-08-24 10:02:05,778][DEBUG][discovery.zen.publish ] [nodeA] received version [7], uuid [obUeEwGvSXKWc1DGHnDSYQ]
1> [2015-08-24 10:02:05,778][DEBUG][discovery.zen.publish ] [nodeC] received version [7], uuid [obUeEwGvSXKWc1DGHnDSYQ]
1> [2015-08-24 10:02:05,862][INFO ][discovery.zen.publish ] --> expecting commit to timeout. good nodes [5], errors [1], timeouts [2]. min_master_nodes [7]
1> [2015-08-24 10:02:05,886][DEBUG][discovery.zen.publish ] [node2] received full cluster state version [0] with size [210]
1> [2015-08-24 10:02:05,906][DEBUG][discovery.zen.publish ] [master] failed to send cluster state to {node4}{node4}{local}{local[46]}
1> RemoteTransportException[[master][local[41]][internal:discovery/zen/publish/send]]; nested: ElasticsearchException[forced error on incoming cluster state];
1> Caused by: ElasticsearchException[forced error on incoming cluster state]
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests$MockPublishAction.handleIncomingClusterStateRequest(PublishClusterStateActionTests.java:797)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction$SendClusterStateRequestHandler.messageReceived(PublishClusterStateAction.java:406)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction$SendClusterStateRequestHandler.messageReceived(PublishClusterStateAction.java:402)
1> at org.elasticsearch.transport.local.LocalTransport.handleRequest(LocalTransport.java:274)
1> at org.elasticsearch.transport.local.LocalTransport.messageReceived(LocalTransport.java:235)
1> at org.elasticsearch.transport.local.LocalTransport$1.run(LocalTransport.java:213)
1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
1> at java.lang.Thread.run(Thread.java:745)
1> [2015-08-24 10:02:05,906][TRACE][discovery.zen.publish ] [master] master node {node4}{node4}{local}{local[46]} failed to ack cluster state version [0]. processing ... (current pending [7], needed [6])
1> [2015-08-24 10:02:05,926][DEBUG][discovery.zen.publish ] [node3] received full cluster state version [0] with size [210]
1> [2015-08-24 10:02:05,936][DEBUG][discovery.zen.publish ] [data_0] received full cluster state version [0] with size [210]
1> [2015-08-24 10:02:05,937][DEBUG][discovery.zen.publish ] [node0] received full cluster state version [0] with size [210]
1> [2015-08-24 10:02:05,938][DEBUG][discovery.zen.publish ] [data_2] received full cluster state version [0] with size [210]
1> [2015-08-24 10:02:05,970][TRACE][discovery.zen.publish ] [master] master node {node2}{node2}{local}{local[44]} acked cluster state version [0]. processing ... (current pending [6], needed [6])
1> [2015-08-24 10:02:05,971][DEBUG][discovery.zen.publish ] [node1] received full cluster state version [0] with size [210]
1> [2015-08-24 10:02:05,971][DEBUG][discovery.zen.publish ] [data_1] received full cluster state version [0] with size [210]
1> [2015-08-24 10:02:05,971][TRACE][discovery.zen.publish ] [master] master node {node1}{node1}{local}{local[43]} acked cluster state version [0]. processing ... (current pending [5], needed [5])
1> [2015-08-24 10:02:05,972][TRACE][discovery.zen.publish ] [master] master node {node0}{node0}{local}{local[42]} acked cluster state version [0]. processing ... (current pending [4], needed [4])
1> [2015-08-24 10:02:05,985][TRACE][discovery.zen.publish ] [master] master node {node3}{node3}{local}{local[45]} acked cluster state version [0]. processing ... (current pending [3], needed [3])
1> [2015-08-24 10:02:06,064][TRACE][discovery.zen.publish ] [master] failed to commit version [0]. timed out waiting for commit (commit timeout [100ms]
1> [2015-08-24 10:02:06,064][DEBUG][discovery.zen.publish ] failed to publish as expected
1> FailedToCommitException[timed out while waiting for enough masters to ack sent cluster state. [2] left]
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction$SendingController.waitForCommit(PublishClusterStateAction.java:500)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction.publish(PublishClusterStateAction.java:143)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateAction.publish(PublishClusterStateAction.java:109)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests.publishState(PublishClusterStateActionTests.java:723)
1> at org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests.testPublishingWithSendingErrors(PublishClusterStateActionTests.java:554)
1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
1> at java.lang.reflect.Method.invoke(Method.java:497)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1638)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:883)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:897)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:856)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:758)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:792)
1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:803)
1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
1> at java.lang.Thread.run(Thread.java:745)
1> [2015-08-24 10:02:06,067][DEBUG][discovery.zen.publish ] [master] failed to send cluster state to {node5}{node5}{local}{local[47]}
1> NodeDisconnectedException[[node5][local[47]][internal:discovery/zen/publish/send] disconnected]
1> [2015-08-24 10:02:06,068][TRACE][discovery.zen.publish ] [master] master node {node5}{node5}{local}{local[47]} failed to ack cluster state version [0]. processing ... (current pending [2], needed [2])
1> [2015-08-24 10:02:06,068][DEBUG][discovery.zen.publish ] [master] failed to send cluster state to {node6}{node6}{local}{local[48]}
1> NodeDisconnectedException[[node6][local[48]][internal:discovery/zen/publish/send] disconnected]
1> [2015-08-24 10:02:06,069][TRACE][discovery.zen.publish ] [master] master node {node6}{node6}{local}{local[48]} failed to ack cluster state version [0]. processing ... (current pending [1], needed [2])
2> NOTE: leaving temporary files on disk at: /home/igor/Projects/elasticsearch/core/target/J0/temp/org.elasticsearch.discovery.zen.publish.PublishClusterStateActionTests_8302BF8B33D58713-001
2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=ar_QA, timezone=Pacific/Kwajalein
2> NOTE: Linux 4.0.4-301.fc22.x86_64 amd64/Oracle Corporation 1.8.0_51 (64-bit)/cpus=8,threads=1,free=441164240,total=524812288
2> NOTE: All tests run in this JVM: [SimilarityTests, RoutingTableTest, CompletionPostingsFormatTest, LuceneTest, StringFieldTypeTests, DoubleFieldDataTests, TerminalTests, UidTests, LegacyVerificationTests, ArrayUtilsTests, ShardVersioningTests, ClusterHealthResponsesTests, SkipSectionParserTests, CliToolTests, RefCountedTest, ElectMasterServiceTest, CreateIndexRequestBuilderTest, TestMergeMapperTests, StartedShardsRoutingTests, ParentQueryTests, ShardsLimitAllocationTests, NativeScriptTests, VersionUtilsTests, PutWarmerRequestTests, ParseDocumentTypeLevelsTests, CountRequestBuilderTests, OsProbeTests, CustomPostingsHighlighterTests, DiffableTests, ShapeBuilderTests, CompressSourceMappingTests, FloatFieldTypeTests, Base64Test, GeoEncodingTests, DistanceUnitTests, BlobStoreTest, SlicedInputStreamTest, IndicesSegmentsRequestTests, JNANativesTests, UidFieldTypeTests, SingleOrdinalsTests, PrimaryElectionRoutingTests, GeoPointFieldTypeTests, IndexRequestTests, BigArraysTests, FieldStatsRequestTest, TestSectionParserTests, Log4jESLoggerTests, ReplicaAllocatedAfterPrimaryTests, PreBuiltTokenizerFactoryFactoryTests, BalanceConfigurationTests, ParentChildFieldDataTests, MemoryCircuitBreakerTests, AnalyzerBackwardsCompatTests, DoubleFieldTypeTests, SyncedFlushUnitTests, MoreLikeThisQueryTests, AggregationCollectorTests, PluginManagerCliTests, CodecTests, HeadersAndContextCopyClientTests, AwarenessAllocationTests, TermVectorsUnitTests, KeepTypesFilterFactoryTests, XContentMapValuesTests, PublishClusterStateActionTests]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment