Skip to content

Instantly share code, notes, and snippets.

Created July 24, 2012 11:32
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save anonymous/3169484 to your computer and use it in GitHub Desktop.
Save anonymous/3169484 to your computer and use it in GitHub Desktop.
Unasigned shard
On Node es1-01:
[2012-07-23 05:03:37,749][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [STARTED]->[CLOSED], reason [shutdown]
[2012-07-23 05:26:12,817][DEBUG][indices.cluster ] [es1-01] [6090232_m][0] creating shard
[2012-07-23 05:26:12,828][DEBUG][index.store ] [es1-01] [6090232_m][0] using compress.stored [false], compress.tv [false]
[2012-07-23 05:26:12,835][DEBUG][index.deletionpolicy ] [es1-01] [6090232_m][0] Using [keep_only_last] deletion policy
[2012-07-23 05:26:12,836][DEBUG][index.merge.policy ] [es1-01] [6090232_m][0] [tiered] merge policy changing max_merge_at_once from [10] to [9] because segments_per_tier [9.2] has to be higher or equal to it
[2012-07-23 05:26:12,836][DEBUG][index.merge.policy ] [es1-01] [6090232_m][0] using [tiered] merge policy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[9], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[9.2], reclaim_deletes_weight[2.0], async_merge[true]
[2012-07-23 05:26:12,837][DEBUG][index.merge.scheduler ] [es1-01] [6090232_m][0] using [concurrent] merge scheduler with max_thread_count[3]
[2012-07-23 05:26:12,838][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [CREATED]
[2012-07-23 05:26:12,839][DEBUG][index.translog ] [es1-01] [6090232_m][0] interval [5s], flush_threshold_ops [5000], flush_threshold_size [200mb], flush_threshold_period [30m]
[2012-07-23 05:26:12,840][DEBUG][indices.memory ] [es1-01] recalculating shard indexing buffer (reason=created_shard[6090232_m][0]), total is [5.9gb] with [229] active shards, each shard set to [26.8mb]
[2012-07-23 05:26:12,841][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [CREATED]->[RECOVERING], reason [from [es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 05:26:34,736][DEBUG][index.engine.robin ] [es1-01] [6090232_m][0] Starting engine
[2012-07-23 05:26:34,739][DEBUG][index.engine.robin ] [es1-01] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 05:26:34,743][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [RECOVERING]->[STARTED], reason [post recovery]
[2012-07-23 05:26:34,744][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] scheduling refresher every 1s
[2012-07-23 05:26:34,746][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] scheduling optimizer / merger every 1s
[2012-07-23 05:26:34,846][DEBUG][cluster.action.shard ] [es1-01] sending shard started for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING], reason [master [es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as initializing, but shard already started, mark shard as started]
[2012-07-23 05:26:35,370][TRACE][gateway.local.state.shards] [es1-01] [6090232_m][0] writing shard state, reason [version changed from [56] to [61]]
[2012-07-23 05:57:24,686][DEBUG][indices.memory ] [es1-01] marking shard [6090232_m][0] as inactive (inactive_time[30m]) indexing wise, setting size to [500kb]
[2012-07-23 05:57:24,713][DEBUG][index.engine.robin ] [es1-01] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 06:16:41,432][DEBUG][indices.cluster ] [es1-01] [6090232_m][0] removing shard on ignored recovery, reason [source node disconnected ([es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true})]
[2012-07-23 06:16:41,433][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [STARTED]->[CLOSED], reason [ignore recovery: source node disconnected ([es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true})]
[2012-07-23 06:16:41,436][DEBUG][indices.memory ] [es1-01] recalculating shard indexing buffer (reason=removed_shard[6090232_m][0]), total is [5.9gb] with [94] active shards, each shard set to [65.3mb]
[2012-07-23 06:16:41,506][WARN ][indices.cluster ] [es1-01] [6090232_m][0] master [[es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] marked shard as started, but shard have not been created, mark shard as failed
[2012-07-23 06:16:41,506][WARN ][cluster.action.shard ] [es1-01] sending failed shard for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:41,812][WARN ][indices.cluster ] [es1-01] [6090232_m][0] master [[es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] marked shard as started, but shard have not been created, mark shard as failed
[2012-07-23 06:16:41,813][WARN ][cluster.action.shard ] [es1-01] sending failed shard for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:41,938][WARN ][indices.cluster ] [es1-01] [6090232_m][0] master [[es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] marked shard as started, but shard have not been created, mark shard as failed
[2012-07-23 06:16:41,940][WARN ][cluster.action.shard ] [es1-01] sending failed shard for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [P], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:50,804][TRACE][gateway.local.state.shards] [es1-01] [6090232_m][0] writing shard state, reason [version changed from [61] to [63]]
[2012-07-23 10:33:27,012][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 10:33:31,187][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 10:33:31,340][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 10:33:35,834][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 10:33:39,956][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 10:33:45,573][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: allocating [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] on primary allocation
[2012-07-23 10:33:46,371][DEBUG][indices.cluster ] [es1-01] [6090232_m][0] creating shard
[2012-07-23 10:33:46,422][DEBUG][index.store ] [es1-01] [6090232_m][0] using compress.stored [false], compress.tv [false]
[2012-07-23 10:33:46,422][DEBUG][index.deletionpolicy ] [es1-01] [6090232_m][0] Using [keep_only_last] deletion policy
[2012-07-23 10:33:46,422][DEBUG][index.merge.policy ] [es1-01] [6090232_m][0] [tiered] merge policy changing max_merge_at_once from [10] to [9] because segments_per_tier [9.2] has to be higher or equal to it
[2012-07-23 10:33:46,423][DEBUG][index.merge.policy ] [es1-01] [6090232_m][0] using [tiered] merge policy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[9], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[9.2], reclaim_deletes_weight[2.0], async_merge[true]
[2012-07-23 10:33:46,423][DEBUG][index.merge.scheduler ] [es1-01] [6090232_m][0] using [concurrent] merge scheduler with max_thread_count[3]
[2012-07-23 10:33:46,424][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [CREATED]
[2012-07-23 10:33:46,425][DEBUG][index.translog ] [es1-01] [6090232_m][0] interval [5s], flush_threshold_ops [5000], flush_threshold_size [200mb], flush_threshold_period [30m]
[2012-07-23 10:33:46,425][DEBUG][indices.memory ] [es1-01] recalculating shard indexing buffer (reason=created_shard[6090232_m][0]), total is [5.9gb] with [81] active shards, each shard set to [75.8mb]
[2012-07-23 10:33:46,461][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [CREATED]->[RECOVERING], reason [from gateway]
[2012-07-23 10:33:46,462][DEBUG][index.engine.robin ] [es1-01] [6090232_m][0] Starting engine
[2012-07-23 10:33:46,480][DEBUG][index.engine.robin ] [es1-01] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 10:33:46,523][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [RECOVERING]->[STARTED], reason [post recovery]
[2012-07-23 10:33:46,523][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] scheduling refresher every 1s
[2012-07-23 10:33:46,524][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] scheduling optimizer / merger every 1s
[2012-07-23 10:33:46,525][DEBUG][cluster.action.shard ] [es1-01] sending shard started for [6090232_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], reason [after recovery from gateway]
[2012-07-23 10:33:46,526][DEBUG][cluster.action.shard ] [es1-01] received shard started for [6090232_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], reason [after recovery from gateway]
[2012-07-23 10:33:54,109][DEBUG][cluster.action.shard ] [es1-01] applying started shards [[6098292_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6090052_m][1], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6148981_s][1], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6090212_m][2], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6090072_m][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6148681_m][4], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6148101_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6090042_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6149601_s][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [5330211_s][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6144971_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [eran][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6125831_m][4], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6141701_xl][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6090102_m][3], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6193802_l][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6178971_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6090232_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6088372_m][4], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6120171_l][4], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6088492_m][2], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [731481_l][9], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6117841_s][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6163391_l][4], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6182062_m][2], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6163541_s][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6117841_s][1], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6090162_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6163541_s][1], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6090142_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [1087401_s][1], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6090032_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6133711_s][1], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6090122_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [P], s[INITIALIZING], [6181592_xl][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [517891_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6070222_m][3], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6120781_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6090152_m][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6190011_s][1], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6158901_m][2], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6125012_l][2], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6120451_s][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6125012_l][3], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6125012_l][6], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6088372_m][1], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [731481_l][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6185181_s][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6193881_s][1], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6090172_m][4], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6181771_m][3], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING], [6132431_s][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6132431_s][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6117261_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6181091_m][3], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6158601_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6090132_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6090132_m][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [6090132_m][2], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], [1069621_xl][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], [P], s[INITIALIZING]], reason [after recovery from gateway]
[2012-07-23 10:33:57,395][TRACE][gateway.local.state.shards] [es1-01] [6090232_m][0] writing shard state, reason [version changed from [63] to [65]]
[2012-07-23 10:33:59,415][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:33:59,416][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:33:59,416][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:33:59,416][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:33:59,417][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:34:09,062][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:09,062][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:09,062][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:09,063][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:09,063][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:34:13,951][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:13,952][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:13,952][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:13,952][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:13,953][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:34:26,058][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:26,059][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:26,059][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:26,059][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:26,060][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:34:33,014][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:33,014][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:33,014][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:33,015][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:33,015][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:34:40,526][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:40,527][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:40,527][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:40,527][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:40,528][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:34:49,579][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:49,579][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:49,579][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:49,580][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:49,580][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:34:57,992][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:57,993][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:57,996][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:57,996][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:34:57,997][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:35:06,876][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:06,877][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:06,877][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:06,877][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:06,878][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:35:12,102][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:12,102][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:12,103][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:12,103][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:12,103][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:35:24,229][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:24,229][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-03][bG_cxcEnTsCaVBIc_cQ-6Q][inet[/10.1.101.153:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:24,229][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:24,229][TRACE][gateway.local ] [es1-01] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:24,230][DEBUG][gateway.local ] [es1-01] [6090232_m][0]: allocating [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-02][TvrZZLiCRn2UrqOiszhY-w][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 10:35:27,769][DEBUG][cluster.action.shard ] [es1-01] received shard started for [6090232_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:35:29,453][TRACE][gateway.local.state.shards] [es1-01] [6090232_m][0] writing shard state, reason [version changed from [65] to [66]]
[2012-07-23 10:35:38,393][DEBUG][cluster.action.shard ] [es1-01] applying started shards [[eran][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6127761_s][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6165771_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6090182_m][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6154541_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6132351_s][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6151441_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6070222_m][2], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6190011_s][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6180841_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6059962_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6088492_m][3], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6181771_m][3], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6141691_xl][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6177051_s][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6173451_xs][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6160531_m][4], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6160531_m][2], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [731481_l][1], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6160531_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [R], s[INITIALIZING], [6162671_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6136561_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6132361_s][1], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6125831_m][2], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [1087401_s][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [268621_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6131251_l][2], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6131251_l][9], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6090232_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6182701_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6182701_m][2], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6163391_l][5], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [5930442_l][1], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6120631_s][1], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6117261_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6158901_m][1], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6158601_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6090032_m][4], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [6187691_xs][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], [5930442_l][3], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING]], reason [after recovery from gateway]
[2012-07-23 10:35:51,074][TRACE][gateway.local.state.shards] [es1-01] [6090232_m][0] writing shard state, reason [version changed from [66] to [67]]
[2012-07-23 10:36:02,704][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING]), reason [after recovery from gateway]]: execute
[2012-07-23 10:36:02,705][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING]), reason [after recovery from gateway]]: no change in cluster_state
[2012-07-23 10:36:04,760][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]: execute
[2012-07-23 10:36:04,761][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]: no change in cluster_state
[2012-07-23 10:39:59,025][TRACE][gateway.local.state.shards] [es1-01] [6090232_m][0] writing shard state, reason [version changed from [67] to [68]]
[2012-07-23 10:40:19,343][DEBUG][cluster.action.shard ] [es1-01] received shard started for [6090232_m][0], node[SOVhC-myTNWwzGscL3DB0g], relocating [BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:40:19,465][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[SOVhC-myTNWwzGscL3DB0g], relocating [BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]: execute
[2012-07-23 10:40:19,466][DEBUG][cluster.action.shard ] [es1-01] applying started shards [[6090232_m][0], node[SOVhC-myTNWwzGscL3DB0g], relocating [BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING]], reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:40:19,530][DEBUG][cluster.service ] [es1-01] cluster state updated, version [138], source [shard-started ([6090232_m][0], node[SOVhC-myTNWwzGscL3DB0g], relocating [BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]
[2012-07-23 10:40:19,550][DEBUG][indices.cluster ] [es1-01] [6090232_m][0] removing shard (not allocated)
[2012-07-23 10:40:19,551][DEBUG][index.shard.service ] [es1-01] [6090232_m][0] state: [STARTED]->[CLOSED], reason [removing shard (not allocated)]
[2012-07-23 10:40:19,552][DEBUG][indices.memory ] [es1-01] recalculating shard indexing buffer (reason=removed_shard[6090232_m][0]), total is [5.9gb] with [330] active shards, each shard set to [18.6mb]
[2012-07-23 10:40:19,554][DEBUG][indices.store ] [es1-01] [6090232_m][0] deleting unallocated shard
[2012-07-23 10:40:19,627][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[SOVhC-myTNWwzGscL3DB0g], relocating [BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]: done applying updated cluster_state
[2012-07-23 10:58:45,148][DEBUG][cluster.action.shard ] [es1-01] received shard started for [6090232_m][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], relocating [TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], reason [after recovery (replica) from node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:58:45,149][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], relocating [TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]: execute
[2012-07-23 10:58:45,149][DEBUG][cluster.action.shard ] [es1-01] applying started shards [[6090232_m][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], relocating [TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING]], reason [after recovery (replica) from node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:58:45,210][DEBUG][cluster.service ] [es1-01] cluster state updated, version [234], source [shard-started ([6090232_m][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], relocating [TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]
[2012-07-23 10:58:45,235][DEBUG][cluster.service ] [es1-01] processing [shard-started ([6090232_m][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], relocating [TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING]), reason [after recovery (replica) from node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]]: done applying updated cluster_state
On Node es1-02:
[2012-07-23 05:05:54,669][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [56] to [57]]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
----shard_id [6090232_m][0]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
--------[6090232_m][0], node[LGPVC4ZDSz6ZP9M5GVTY5Q], [P], s[STARTED]
--------[6090232_m][0], node[null], [R], s[UNASSIGNED]
[2012-07-23 05:18:29,295][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [STARTED]->[CLOSED], reason [shutdown]
[2012-07-23 05:21:45,601][DEBUG][gateway.local ] [es1-02] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 05:21:49,711][DEBUG][gateway.local ] [es1-02] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 05:21:53,441][DEBUG][gateway.local ] [es1-02] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 05:21:58,026][DEBUG][gateway.local ] [es1-02] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 05:22:01,651][DEBUG][gateway.local ] [es1-02] [6090232_m][0]: throttling allocation [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]] on primary allocation
[2012-07-23 05:22:05,719][DEBUG][gateway.local ] [es1-02] [6090232_m][0]: allocating [[6090232_m][0], node[null], [P], s[UNASSIGNED]] to [[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] on primary allocation
[2012-07-23 05:22:06,561][DEBUG][indices.cluster ] [es1-02] [6090232_m][0] creating shard
[2012-07-23 05:22:06,575][DEBUG][index.store ] [es1-02] [6090232_m][0] using compress.stored [false], compress.tv [false]
[2012-07-23 05:22:06,575][DEBUG][index.deletionpolicy ] [es1-02] [6090232_m][0] Using [keep_only_last] deletion policy
[2012-07-23 05:22:06,576][DEBUG][index.merge.policy ] [es1-02] [6090232_m][0] [tiered] merge policy changing max_merge_at_once from [10] to [9] because segments_per_tier [9.2] has to be higher or equal to it
[2012-07-23 05:22:06,576][DEBUG][index.merge.policy ] [es1-02] [6090232_m][0] using [tiered] merge policy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[9], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[9.2], reclaim_deletes_weight[2.0], async_merge[true]
[2012-07-23 05:22:06,577][DEBUG][index.merge.scheduler ] [es1-02] [6090232_m][0] using [concurrent] merge scheduler with max_thread_count[3]
[2012-07-23 05:22:06,578][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [CREATED]
[2012-07-23 05:22:06,579][DEBUG][index.translog ] [es1-02] [6090232_m][0] interval [5s], flush_threshold_ops [5000], flush_threshold_size [200mb], flush_threshold_period [30m]
[2012-07-23 05:22:06,580][DEBUG][indices.memory ] [es1-02] recalculating shard indexing buffer (reason=created_shard[6090232_m][0]), total is [5.9gb] with [96] active shards, each shard set to [63.9mb]
[2012-07-23 05:22:06,703][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [CREATED]->[RECOVERING], reason [from gateway]
[2012-07-23 05:22:06,705][DEBUG][index.engine.robin ] [es1-02] [6090232_m][0] Starting engine
[2012-07-23 05:22:06,718][DEBUG][index.engine.robin ] [es1-02] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 05:22:06,739][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [RECOVERING]->[STARTED], reason [post recovery]
[2012-07-23 05:22:06,739][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] scheduling refresher every 1s
[2012-07-23 05:22:06,740][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] scheduling optimizer / merger every 1s
[2012-07-23 05:22:06,741][DEBUG][cluster.action.shard ] [es1-02] sending shard started for [6090232_m][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], reason [after recovery from gateway]
[2012-07-23 05:22:06,742][DEBUG][cluster.action.shard ] [es1-02] received shard started for [6090232_m][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], reason [after recovery from gateway]
[2012-07-23 05:22:08,920][DEBUG][cluster.action.shard ] [es1-02] applying started shards [[731481_l][3], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [731481_l][4], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [5930442_l][4], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [1069621_xl][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6127481_xs][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6132361_s][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [5787421_xs][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [5930442_l][4], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6090232_m][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6144971_xs][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6195371_s][1], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6163561_s][1], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6163011_m][4], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6185071_xs][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING], [6090072_m][4], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING], [6088372_m][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [731481_l][3], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [731481_l][4], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6185121_xs][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6117841_s][1], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6158901_m][2], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6158901_m][4], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6099052_m][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [6163391_l][2], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING], [713721_s][1], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING]], reason [after recovery from gateway]
[2012-07-23 05:22:11,145][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [57] to [59]]
[2012-07-23 05:23:40,749][DEBUG][cluster.service ] [es1-02] processing [shard-started ([6090232_m][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING]), reason [after recovery from gateway]]: execute
[2012-07-23 05:23:40,750][DEBUG][cluster.service ] [es1-02] processing [shard-started ([6090232_m][0], node[WJ4HTRXvQGCCZk8Fq8wevw], [P], s[INITIALIZING]), reason [after recovery from gateway]]: no change in cluster_state
[2012-07-23 05:26:12,706][TRACE][gateway.local ] [es1-02] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-01][vAwk3EXPQvOVvJrVUZb5VA][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 05:26:12,706][TRACE][gateway.local ] [es1-02] [6090232_m][0], node[null], [R], s[UNASSIGNED]: checking node [[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 05:26:12,706][DEBUG][gateway.local ] [es1-02] [6090232_m][0]: allocating [[6090232_m][0], node[null], [R], s[UNASSIGNED]] to [[es1-01][vAwk3EXPQvOVvJrVUZb5VA][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}] in order to reuse its unallocated persistent store with total_size [84.7kb]
[2012-07-23 05:26:12,862][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [59] to [60]]
[2012-07-23 05:26:34,954][DEBUG][cluster.action.shard ] [es1-02] received shard started for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING], reason [master [es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as initializing, but shard already started, mark shard as started]
[2012-07-23 05:26:35,074][DEBUG][cluster.action.shard ] [es1-02] applying started shards [[6090112_m][4], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING], [6090112_m][4], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING], [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING]], reason [after recovery (replica) from node [[es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 05:26:35,434][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [60] to [61]]
[2012-07-23 05:26:35,652][DEBUG][cluster.service ] [es1-02] processing [shard-started ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING]), reason [master [es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as initializing, but shard already started, mark shard as started]]: execute
[2012-07-23 05:26:35,652][DEBUG][cluster.service ] [es1-02] processing [shard-started ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[INITIALIZING]), reason [master [es1-02][WJ4HTRXvQGCCZk8Fq8wevw][inet[/10.1.101.152:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as initializing, but shard already started, mark shard as started]]: no change in cluster_state
[2012-07-23 06:16:23,088][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [STARTED]->[CLOSED], reason [shutdown]
[2012-07-23 10:35:27,858][DEBUG][indices.cluster ] [es1-02] [6090232_m][0] creating shard
[2012-07-23 10:35:27,868][DEBUG][index.store ] [es1-02] [6090232_m][0] using compress.stored [false], compress.tv [false]
[2012-07-23 10:35:27,869][DEBUG][index.deletionpolicy ] [es1-02] [6090232_m][0] Using [keep_only_last] deletion policy
[2012-07-23 10:35:27,870][DEBUG][index.merge.policy ] [es1-02] [6090232_m][0] [tiered] merge policy changing max_merge_at_once from [10] to [9] because segments_per_tier [9.2] has to be higher or equal to it
[2012-07-23 10:35:27,870][DEBUG][index.merge.policy ] [es1-02] [6090232_m][0] using [tiered] merge policy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[9], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[9.2], reclaim_deletes_weight[2.0], async_merge[true]
[2012-07-23 10:35:27,871][DEBUG][index.merge.scheduler ] [es1-02] [6090232_m][0] using [concurrent] merge scheduler with max_thread_count[3]
[2012-07-23 10:35:27,871][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [CREATED]
[2012-07-23 10:35:27,873][DEBUG][index.translog ] [es1-02] [6090232_m][0] interval [5s], flush_threshold_ops [5000], flush_threshold_size [200mb], flush_threshold_period [30m]
[2012-07-23 10:35:27,874][DEBUG][indices.memory ] [es1-02] recalculating shard indexing buffer (reason=created_shard[6090232_m][0]), total is [5.9gb] with [281] active shards, each shard set to [21.8mb]
[2012-07-23 10:35:27,874][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [CREATED]->[RECOVERING], reason [from [es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:35:27,886][DEBUG][index.engine.robin ] [es1-02] [6090232_m][0] Starting engine
[2012-07-23 10:35:27,889][DEBUG][index.engine.robin ] [es1-02] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 10:35:27,893][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [RECOVERING]->[STARTED], reason [post recovery]
[2012-07-23 10:35:27,893][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] scheduling refresher every 1s
[2012-07-23 10:35:27,894][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] scheduling optimizer / merger every 1s
[2012-07-23 10:35:27,897][DEBUG][indices.recovery ] [es1-02] [6090232_m][0] recovery completed from [es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}, took[22ms]
[2012-07-23 10:35:27,899][DEBUG][cluster.action.shard ] [es1-02] sending shard started for [6090232_m][0], node[TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:35:42,389][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [61] to [67]]
[2012-07-23 10:39:59,157][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [67] to [68]]
[2012-07-23 10:40:19,758][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [68] to [69]]
[2012-07-23 10:58:43,815][TRACE][gateway.local.state.shards] [es1-02] [6090232_m][0] writing shard state, reason [version changed from [69] to [70]]
[2012-07-23 10:58:45,373][DEBUG][indices.cluster ] [es1-02] [6090232_m][0] removing shard (not allocated)
[2012-07-23 10:58:45,373][DEBUG][index.shard.service ] [es1-02] [6090232_m][0] state: [STARTED]->[CLOSED], reason [removing shard (not allocated)]
[2012-07-23 10:58:45,375][DEBUG][indices.memory ] [es1-02] recalculating shard indexing buffer (reason=removed_shard[6090232_m][0]), total is [5.9gb] with [281] active shards, each shard set to [21.8mb]
[2012-07-23 10:58:45,377][DEBUG][indices.store ] [es1-02] [6090232_m][0] deleting unallocated shard
On Node es1-03:
[2012-07-23 10:58:44,103][DEBUG][indices.cluster ] [es1-03] [6090232_m][0] creating shard
[2012-07-23 10:58:44,114][DEBUG][index.store ] [es1-03] [6090232_m][0] using compress.stored [false], compress.tv [false]
[2012-07-23 10:58:44,114][DEBUG][index.deletionpolicy ] [es1-03] [6090232_m][0] Using [keep_only_last] deletion policy
[2012-07-23 10:58:44,116][DEBUG][index.merge.policy ] [es1-03] [6090232_m][0] [tiered] merge policy changing max_merge_at_once from [10] to [9] because segments_per_tier [9.2] has to be higher or equal to it
[2012-07-23 10:58:44,116][DEBUG][index.merge.policy ] [es1-03] [6090232_m][0] using [tiered] merge policy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[9], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[9.2], reclaim_deletes_weight[2.0], async_merge[true]
[2012-07-23 10:58:44,117][DEBUG][index.merge.scheduler ] [es1-03] [6090232_m][0] using [concurrent] merge scheduler with max_thread_count[3]
[2012-07-23 10:58:44,119][DEBUG][index.shard.service ] [es1-03] [6090232_m][0] state: [CREATED]
[2012-07-23 10:58:44,121][DEBUG][index.translog ] [es1-03] [6090232_m][0] interval [5s], flush_threshold_ops [5000], flush_threshold_size [200mb], flush_threshold_period [30m]
[2012-07-23 10:58:44,122][DEBUG][indices.memory ] [es1-03] recalculating shard indexing buffer (reason=created_shard[6090232_m][0]), total is [5.9gb] with [257] active shards, each shard set to [23.8mb]
[2012-07-23 10:58:44,123][DEBUG][index.shard.service ] [es1-03] [6090232_m][0] state: [CREATED]->[RECOVERING], reason [from [es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:58:45,549][DEBUG][index.engine.robin ] [es1-03] [6090232_m][0] Starting engine
[2012-07-23 10:58:45,553][DEBUG][index.engine.robin ] [es1-03] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 10:58:45,556][DEBUG][index.shard.service ] [es1-03] [6090232_m][0] state: [RECOVERING]->[STARTED], reason [post recovery]
[2012-07-23 10:58:45,557][DEBUG][index.shard.service ] [es1-03] [6090232_m][0] scheduling refresher every 1s
[2012-07-23 10:58:45,557][DEBUG][index.shard.service ] [es1-03] [6090232_m][0] scheduling optimizer / merger every 1s
[2012-07-23 10:58:45,558][DEBUG][indices.recovery ] [es1-03] [6090232_m][0] recovery completed from [es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}, took[1.4s]
[2012-07-23 10:58:45,560][DEBUG][cluster.action.shard ] [es1-03] sending shard started for [6090232_m][0], node[bG_cxcEnTsCaVBIc_cQ-6Q], relocating [TvrZZLiCRn2UrqOiszhY-w], [R], s[INITIALIZING], reason [after recovery (replica) from node [[es1-04][SOVhC-myTNWwzGscL3DB0g][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:58:45,666][TRACE][gateway.local.state.shards] [es1-03] [6090232_m][0] writing shard state, reason [freshly started, version [71]]
[2012-07-23 11:29:46,213][DEBUG][indices.memory ] [es1-03] marking shard [6090232_m][0] as inactive (inactive_time[30m]) indexing wise, setting size to [500kb]
[2012-07-23 11:29:46,216][DEBUG][index.engine.robin ] [es1-03] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 12:00:04,307][INFO ][index.translog ] [es1-03] [6090232_m][0] updating disable_flush from [false] to [true]
[2012-07-23 12:00:54,309][INFO ][index.translog ] [es1-03] [6090232_m][0] updating disable_flush from [true] to [false]
[2012-07-23 16:00:04,413][INFO ][index.translog ] [es1-03] [6090232_m][0] updating disable_flush from [false] to [true]
[2012-07-23 16:00:54,270][INFO ][index.translog ] [es1-03] [6090232_m][0] updating disable_flush from [true] to [false]
[2012-07-23 20:00:05,291][INFO ][index.translog ] [es1-03] [6090232_m][0] updating disable_flush from [false] to [true]
[2012-07-23 20:00:53,538][INFO ][index.translog ] [es1-03] [6090232_m][0] updating disable_flush from [true] to [false]
On Node es1-04:
[2012-07-23 06:16:41,619][WARN ][cluster.action.shard ] [es1-04] received shard failed for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:41,924][WARN ][cluster.action.shard ] [es1-04] received shard failed for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:42,051][WARN ][cluster.action.shard ] [es1-04] received shard failed for [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [P], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:43,553][DEBUG][cluster.service ] [es1-04] processing [shard-failed ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED]), reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]]: execute
[2012-07-23 06:16:43,553][DEBUG][cluster.action.shard ] [es1-04] Received failed shard [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:43,742][DEBUG][cluster.action.shard ] [es1-04] Applying failed shard [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:43,762][DEBUG][cluster.service ] [es1-04] cluster state updated, version [317], source [shard-failed ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED]), reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]]
[2012-07-23 06:16:43,799][DEBUG][cluster.service ] [es1-04] processing [shard-failed ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED]), reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]]: done applying updated cluster_state
[2012-07-23 06:16:43,951][DEBUG][cluster.service ] [es1-04] processing [shard-failed ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED]), reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]]: execute
[2012-07-23 06:16:43,952][DEBUG][cluster.action.shard ] [es1-04] Received failed shard [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:43,953][DEBUG][cluster.service ] [es1-04] processing [shard-failed ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [R], s[STARTED]), reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]]: no change in cluster_state
[2012-07-23 06:16:43,955][DEBUG][cluster.service ] [es1-04] processing [shard-failed ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [P], s[STARTED]), reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]]: execute
[2012-07-23 06:16:43,956][DEBUG][cluster.action.shard ] [es1-04] Received failed shard [6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [P], s[STARTED], reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]
[2012-07-23 06:16:43,957][DEBUG][cluster.service ] [es1-04] processing [shard-failed ([6090232_m][0], node[vAwk3EXPQvOVvJrVUZb5VA], [P], s[STARTED]), reason [master [es1-04][8RGOKe2pS-WNdwfbpgn8jQ][inet[/10.1.101.154:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true} marked shard as started, but shard have not been created, mark shard as failed]]: no change in cluster_state
[2012-07-23 10:39:59,397][DEBUG][indices.cluster ] [es1-04] [6090232_m][0] creating shard
[2012-07-23 10:39:59,412][DEBUG][index.store ] [es1-04] [6090232_m][0] using compress.stored [false], compress.tv [false]
[2012-07-23 10:39:59,413][DEBUG][index.deletionpolicy ] [es1-04] [6090232_m][0] Using [keep_only_last] deletion policy
[2012-07-23 10:39:59,414][DEBUG][index.merge.policy ] [es1-04] [6090232_m][0] [tiered] merge policy changing max_merge_at_once from [10] to [9] because segments_per_tier [9.2] has to be higher or equal to it
[2012-07-23 10:39:59,414][DEBUG][index.merge.policy ] [es1-04] [6090232_m][0] using [tiered] merge policy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[9], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[9.2], reclaim_deletes_weight[2.0], async_merge[true]
[2012-07-23 10:39:59,415][DEBUG][index.merge.scheduler ] [es1-04] [6090232_m][0] using [concurrent] merge scheduler with max_thread_count[3]
[2012-07-23 10:39:59,416][DEBUG][index.shard.service ] [es1-04] [6090232_m][0] state: [CREATED]
[2012-07-23 10:39:59,418][DEBUG][index.translog ] [es1-04] [6090232_m][0] interval [5s], flush_threshold_ops [5000], flush_threshold_size [200mb], flush_threshold_period [30m]
[2012-07-23 10:39:59,419][DEBUG][indices.memory ] [es1-04] recalculating shard indexing buffer (reason=created_shard[6090232_m][0]), total is [5.9gb] with [193] active shards, each shard set to [31.8mb]
[2012-07-23 10:39:59,420][DEBUG][index.shard.service ] [es1-04] [6090232_m][0] state: [CREATED]->[RECOVERING], reason [from [es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]
[2012-07-23 10:40:19,461][DEBUG][index.engine.robin ] [es1-04] [6090232_m][0] Starting engine
[2012-07-23 10:40:19,465][DEBUG][index.engine.robin ] [es1-04] [6090232_m][0] using bloom filter enhanced delete handling
[2012-07-23 10:40:19,469][DEBUG][index.shard.service ] [es1-04] [6090232_m][0] state: [RECOVERING]->[STARTED], reason [post recovery]
[2012-07-23 10:40:19,470][DEBUG][index.shard.service ] [es1-04] [6090232_m][0] scheduling refresher every 1s
[2012-07-23 10:40:19,471][DEBUG][index.shard.service ] [es1-04] [6090232_m][0] scheduling optimizer / merger every 1s
[2012-07-23 10:40:19,472][DEBUG][indices.recovery ] [es1-04] [6090232_m][0] recovery completed from [es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}, took[20s]
[2012-07-23 10:40:19,473][DEBUG][cluster.action.shard ] [es1-04] sending shard started for [6090232_m][0], node[SOVhC-myTNWwzGscL3DB0g], relocating [BzkPRQKTRx-cvOKJ_41Qhw], [P], s[INITIALIZING], reason [after recovery (replica) from node [[es1-01][BzkPRQKTRx-cvOKJ_41Qhw][inet[/10.1.101.151:9300]]{data_center=ny4, max_local_storage_nodes=1, master=true}]]
[2012-07-23 10:40:19,778][TRACE][gateway.local.state.shards] [es1-04] [6090232_m][0] writing shard state, reason [freshly started, version [69]]
[2012-07-23 10:58:43,810][TRACE][gateway.local.state.shards] [es1-04] [6090232_m][0] writing shard state, reason [version changed from [69] to [70]]
[2012-07-23 10:58:51,766][TRACE][gateway.local.state.shards] [es1-04] [6090232_m][0] writing shard state, reason [version changed from [70] to [71]]
[2012-07-23 11:11:19,892][DEBUG][indices.memory ] [es1-04] marking shard [6090232_m][0] as inactive (inactive_time[30m]) indexing wise, setting size to [500kb]
[2012-07-23 11:11:19,913][DEBUG][index.engine.robin ] [es1-04] [6090232_m][0] using bloom filter enhanced delete handling
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment