Skip to content

Instantly share code, notes, and snippets.

@sushanth45
Last active March 1, 2021 04:59
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save sushanth45/7df48d27b35be2baba212d9986504b6b to your computer and use it in GitHub Desktop.
Save sushanth45/7df48d27b35be2baba212d9986504b6b to your computer and use it in GitHub Desktop.
Hot threads and logs for high CPU util in ES cluster(used for logging)
::: { node-1}{8WjFXK39T9ykS5HOO22A3Q}{NCWvcpSOT5-AHpPWyQMwng}{ x.x.x.217}{ x.x.x.217:9300}{di}{xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.545Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
::: { node-2}{NAOT4Kg_Tj6SYONld6epgA}{mby8TiBfSEK_ozy4yvOsVQ}{ x.x.x.216}{ x.x.x.216:9300}{di}{xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.546Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
68.1% (340.2ms out of 500ms) cpu usage by thread 'elasticsearch[ node-2][[index-2021.03.01][0]: Lucene Merge Thread #82]'
10/10 snapshots sharing following 9 elements
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
18.4% (91.7ms out of 500ms) cpu usage by thread 'elasticsearch[ node-2][write][T#1]'
3/10 snapshots sharing following 182 elements
app//org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:943)
app//org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:813)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:785)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:742)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:267)
app//org.elasticsearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:157)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:202)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:114)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:81)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:895)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:109)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:374)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:297)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$4902/0x000000080196a040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.index.shard.IndexShard.lambda$wrapPrimaryOperationPermitListener$24(IndexShard.java:2791)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$4889/0x000000080195e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$3.onResponse(ActionListener.java:113)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:285)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:237)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2765)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:836)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:293)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.handlePrimaryRequest(TransportReplicationAction.java:256)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$$Lambda$2967/0x000000080153d040.messageReceived(Unknown Source)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:257)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.lambda$messageReceived$0(SecurityServerTransportInterceptor.java:306)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$$Lambda$4101/0x000000080178f440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:344)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4271/0x0000000801806840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:82)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:71)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:102)
org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:345)
org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:322)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:263)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4256/0x0000000801803040.accept(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:591)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:507)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$3(RBACEngine.java:298)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4260/0x0000000801804440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:554)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:251)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4264/0x0000000801805440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:329)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:247)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4254/0x0000000801801c40.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:250)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4255/0x0000000801802440.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:290)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4258/0x0000000801803c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:314)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:287)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:261)
org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:227)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:193)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4225/0x00000008017f9c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:117)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4227/0x00000008017fa440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:155)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:246)
org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:123)
org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:111)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:195)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.lambda$inbound$1(ServerTransportFilter.java:130)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile$$Lambda$4103/0x000000080178ec40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:248)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4105/0x000000080178e440.accept(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:310)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4106/0x000000080178d840.run(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:321)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:245)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:196)
org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:139)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.inbound(ServerTransportFilter.java:121)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:313)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:762)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:692)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
3/10 snapshots sharing following 185 elements
app//org.elasticsearch.index.mapper.DocumentParser.parseObjectOrNested(DocumentParser.java:395)
app//org.elasticsearch.index.mapper.DocumentParser.internalParseDocument(DocumentParser.java:112)
app//org.elasticsearch.index.mapper.DocumentParser.parseDocument(DocumentParser.java:71)
app//org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:267)
app//org.elasticsearch.index.shard.IndexShard.prepareIndex(IndexShard.java:793)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:770)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:742)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:267)
app//org.elasticsearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:157)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:202)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:114)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:81)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:895)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:109)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:374)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:297)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$4902/0x000000080196a040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.index.shard.IndexShard.lambda$wrapPrimaryOperationPermitListener$24(IndexShard.java:2791)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$4889/0x000000080195e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$3.onResponse(ActionListener.java:113)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:285)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:237)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2765)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:836)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:293)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.handlePrimaryRequest(TransportReplicationAction.java:256)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$$Lambda$2967/0x000000080153d040.messageReceived(Unknown Source)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:257)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.lambda$messageReceived$0(SecurityServerTransportInterceptor.java:306)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$$Lambda$4101/0x000000080178f440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:344)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4271/0x0000000801806840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:82)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:71)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:102)
org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:345)
org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:322)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:263)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4256/0x0000000801803040.accept(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:591)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:507)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$3(RBACEngine.java:298)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4260/0x0000000801804440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:554)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:251)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4264/0x0000000801805440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:329)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:247)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4254/0x0000000801801c40.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:250)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4255/0x0000000801802440.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:290)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4258/0x0000000801803c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:314)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:287)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:261)
org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:227)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:193)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4225/0x00000008017f9c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:117)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4227/0x00000008017fa440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:155)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:246)
org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:123)
org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:111)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:195)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.lambda$inbound$1(ServerTransportFilter.java:130)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile$$Lambda$4103/0x000000080178ec40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:248)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4105/0x000000080178e440.accept(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:310)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4106/0x000000080178d840.run(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:321)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:245)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:196)
org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:139)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.inbound(ServerTransportFilter.java:121)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:313)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:762)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:692)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
2/10 snapshots sharing following 193 elements
app//org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:262)
app//org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:151)
app//org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:862)
app//org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:442)
app//org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:406)
app//org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:250)
app//org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:495)
app//org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594)
app//org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1213)
app//org.elasticsearch.index.engine.InternalEngine.addDocs(InternalEngine.java:1157)
app//org.elasticsearch.index.engine.InternalEngine.indexIntoLucene(InternalEngine.java:1094)
app//org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:934)
app//org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:813)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:785)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:742)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:267)
app//org.elasticsearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:157)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:202)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:114)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:81)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:895)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:109)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:374)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:297)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$4902/0x000000080196a040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.index.shard.IndexShard.lambda$wrapPrimaryOperationPermitListener$24(IndexShard.java:2791)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$4889/0x000000080195e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$3.onResponse(ActionListener.java:113)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:285)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:237)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2765)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:836)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:293)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.handlePrimaryRequest(TransportReplicationAction.java:256)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$$Lambda$2967/0x000000080153d040.messageReceived(Unknown Source)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:257)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.lambda$messageReceived$0(SecurityServerTransportInterceptor.java:306)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$$Lambda$4101/0x000000080178f440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:344)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4271/0x0000000801806840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:82)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:71)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:102)
org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:345)
org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:322)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:263)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4256/0x0000000801803040.accept(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:591)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:507)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$3(RBACEngine.java:298)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4260/0x0000000801804440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:554)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:251)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4264/0x0000000801805440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:329)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:247)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4254/0x0000000801801c40.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:250)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4255/0x0000000801802440.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:290)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4258/0x0000000801803c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:314)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:287)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:261)
org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:227)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:193)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4225/0x00000008017f9c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:117)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4227/0x00000008017fa440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:155)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:246)
org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:123)
org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:111)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:195)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.lambda$inbound$1(ServerTransportFilter.java:130)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile$$Lambda$4103/0x000000080178ec40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:248)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4105/0x000000080178e440.accept(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:310)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4106/0x000000080178d840.run(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:321)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:245)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:196)
org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:139)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.inbound(ServerTransportFilter.java:121)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:313)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:762)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:692)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
2/10 snapshots sharing following 192 elements
app//org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:151)
app//org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:862)
app//org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:442)
app//org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:406)
app//org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:250)
app//org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:495)
app//org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594)
app//org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1213)
app//org.elasticsearch.index.engine.InternalEngine.addDocs(InternalEngine.java:1157)
app//org.elasticsearch.index.engine.InternalEngine.indexIntoLucene(InternalEngine.java:1094)
app//org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:934)
app//org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:813)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:785)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:742)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:267)
app//org.elasticsearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:157)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:202)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:114)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:81)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:895)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:109)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:374)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:297)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$4902/0x000000080196a040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.index.shard.IndexShard.lambda$wrapPrimaryOperationPermitListener$24(IndexShard.java:2791)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$4889/0x000000080195e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$3.onResponse(ActionListener.java:113)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:285)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:237)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2765)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:836)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:293)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.handlePrimaryRequest(TransportReplicationAction.java:256)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$$Lambda$2967/0x000000080153d040.messageReceived(Unknown Source)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:257)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.lambda$messageReceived$0(SecurityServerTransportInterceptor.java:306)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$$Lambda$4101/0x000000080178f440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:344)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4271/0x0000000801806840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:82)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:71)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4269/0x0000000801807040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4087/0x000000080177e840.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:102)
org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:345)
org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:322)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:263)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4256/0x0000000801803040.accept(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:591)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:507)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$3(RBACEngine.java:298)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4260/0x0000000801804440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:554)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:251)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4264/0x0000000801805440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4262/0x0000000801804c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:329)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:247)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4254/0x0000000801801c40.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:250)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4255/0x0000000801802440.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:290)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4258/0x0000000801803c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:314)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:287)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:261)
org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:227)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:193)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4225/0x00000008017f9c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:117)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4227/0x00000008017fa440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:155)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:246)
org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:123)
org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:111)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:195)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.lambda$inbound$1(ServerTransportFilter.java:130)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile$$Lambda$4103/0x000000080178ec40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:248)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4105/0x000000080178e440.accept(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:310)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4106/0x000000080178d840.run(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:321)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:245)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:196)
org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:139)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.inbound(ServerTransportFilter.java:121)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:313)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:762)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:692)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
12.1% (60.4ms out of 500ms) cpu usage by thread 'elasticsearch[ node-2][[indexwarehouse-supply-streamer-app-000008][0]: Lucene Merge Thread #44]'
9/10 snapshots sharing following 12 elements
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.pushTerm(BlockTreeTermsWriter.java:906)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:870)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
unique snapshot
app//org.apache.lucene.index.MultiTermsEnum.pushTop(MultiTermsEnum.java:275)
app//org.apache.lucene.index.MultiTermsEnum.next(MultiTermsEnum.java:301)
app//org.apache.lucene.index.FilterLeafReader$FilterTermsEnum.next(FilterLeafReader.java:194)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:336)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
::: { node-0}{01CwMq5dTOuc3z8eRwrpxQ}{MKTSRLu7RV2azOFExPbK_g}{ x.x.x.11}{ x.x.x.11:9300}{dilm}{ml.machine_memory=63157198848, xpack.installed=true, ml.max_open_jobs=20}
Hot threads at 2021-03-01T02:27:36.544Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
::: { node-1}{FIKLeU1TRUKaCI9EJQHb-g}{4pLgnZitTNmILGVbDVq-AQ}{ x.x.x.197}{ x.x.x.197:9300}{dilm}{ml.machine_memory=63157243904, ml.max_open_jobs=20, xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.544Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
95.0% (474.8ms out of 500ms) cpu usage by thread 'elasticsearch[ node-1][[index-indexapi-gc-000008][0]: Lucene Merge Thread #19]'
2/10 snapshots sharing following 12 elements
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:129)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
8/10 snapshots sharing following 10 elements
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
1.5% (7.3ms out of 500ms) cpu usage by thread 'elasticsearch[ node-1][[indexinventory-app-000008][0]: Lucene Merge Thread #201]'
10/10 snapshots sharing following 16 elements
java.base@13.0.2/jdk.internal.misc.Unsafe.park(Native Method)
java.base@13.0.2/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:235)
java.base@13.0.2/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
app//org.apache.lucene.index.MergePolicy$OneMergeProgress.pauseNanos(MergePolicy.java:156)
app//org.apache.lucene.index.MergeRateLimiter.maybePause(MergeRateLimiter.java:148)
app//org.apache.lucene.index.MergeRateLimiter.pause(MergeRateLimiter.java:93)
app//org.apache.lucene.store.RateLimitedIndexOutput.checkRate(RateLimitedIndexOutput.java:78)
app//org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:72)
app//org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
app//org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
app//org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5014)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4527)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
::: { node-3}{1-v1j8f_StiGJHu4DsU24w}{Net5jpBoRqqiKLuUEJMNEA}{ x.x.x.222}{ x.x.x.222:9300}{di}{xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.545Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
3.8% (18.7ms out of 500ms) cpu usage by thread 'elasticsearch[ node-3][[logging-nginxperimeter-000008][0]: Lucene Merge Thread #256]'
10/10 snapshots sharing following 16 elements
java.base@13.0.2/jdk.internal.misc.Unsafe.park(Native Method)
java.base@13.0.2/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:235)
java.base@13.0.2/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
app//org.apache.lucene.index.MergePolicy$OneMergeProgress.pauseNanos(MergePolicy.java:156)
app//org.apache.lucene.index.MergeRateLimiter.maybePause(MergeRateLimiter.java:148)
app//org.apache.lucene.index.MergeRateLimiter.pause(MergeRateLimiter.java:93)
app//org.apache.lucene.store.RateLimitedIndexOutput.checkRate(RateLimitedIndexOutput.java:78)
app//org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:72)
app//org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
app//org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:96)
app//org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:5014)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4527)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
2.1% (10.4ms out of 500ms) cpu usage by thread 'elasticsearch[ node-3][http_server_worker][T#16]'
2/10 snapshots sharing following 3 elements
io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
::: { node-1}{bHn0L-QdQRCX9lUTNNzmRw}{dm3PbG5rTxiq0McRM8m_tQ}{ x.x.x.196}{ x.x.x.196:9300}{dilm}{ml.machine_memory=63157198848, ml.max_open_jobs=20, xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.545Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
9.0% (45.1ms out of 500ms) cpu usage by thread 'elasticsearch[ node-1][[index-indexhz-gc-000008][0]: Lucene Merge Thread #52]'
2/10 snapshots sharing following 24 elements
java.base@13.0.2/jdk.internal.misc.Unsafe.park(Native Method)
java.base@13.0.2/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:235)
java.base@13.0.2/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
app//org.apache.lucene.index.MergePolicy$OneMergeProgress.pauseNanos(MergePolicy.java:156)
app//org.apache.lucene.index.MergeRateLimiter.maybePause(MergeRateLimiter.java:148)
app//org.apache.lucene.index.MergeRateLimiter.pause(MergeRateLimiter.java:93)
app//org.apache.lucene.store.RateLimitedIndexOutput.checkRate(RateLimitedIndexOutput.java:78)
app//org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:72)
app//org.apache.lucene.store.DataOutput.writeBytes(DataOutput.java:52)
app//org.apache.lucene.store.RAMOutputStream.writeTo(RAMOutputStream.java:90)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.writeBlock(BlockTreeTermsWriter.java:831)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.writeBlocks(BlockTreeTermsWriter.java:625)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.pushTerm(BlockTreeTermsWriter.java:906)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:870)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
8/10 snapshots sharing following 10 elements
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
::: { node-0}{ImvuJ-IYROOq4JaeVS1h8Q}{T7c9PCcvSLqrib2qzJvr-A}{ x.x.x.13}{ x.x.x.13:9300}{dilm}{ml.machine_memory=63157198848, ml.max_open_jobs=20, xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.545Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
10.5% (52.4ms out of 500ms) cpu usage by thread 'elasticsearch[ node-0][transport_worker][T#18]'
2/10 snapshots sharing following 37 elements
app//org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:139)
app//org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:103)
app//org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:667)
org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:62)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:326)
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:300)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1478)
io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1227)
io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1274)
io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:503)
io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:442)
io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:281)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:600)
io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:554)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
7/10 snapshots sharing following 9 elements
java.base@13.0.2/sun.nio.ch.EPoll.wait(Native Method)
java.base@13.0.2/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
java.base@13.0.2/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
java.base@13.0.2/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:824)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457)
io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
unique snapshot
java.base@13.0.2/com.sun.crypto.provider.GaloisCounterMode.doLastBlock(GaloisCounterMode.java:418)
java.base@13.0.2/com.sun.crypto.provider.GaloisCounterMode.encryptFinal(GaloisCounterMode.java:496)
java.base@13.0.2/com.sun.crypto.provider.CipherCore.finalNoPadding(CipherCore.java:1118)
java.base@13.0.2/com.sun.crypto.provider.CipherCore.fillOutputBuffer(CipherCore.java:1053)
java.base@13.0.2/com.sun.crypto.provider.CipherCore.doFinal(CipherCore.java:941)
java.base@13.0.2/com.sun.crypto.provider.AESCipher.engineDoFinal(AESCipher.java:491)
java.base@13.0.2/javax.crypto.CipherSpi.bufferCrypt(CipherSpi.java:794)
java.base@13.0.2/javax.crypto.CipherSpi.engineDoFinal(CipherSpi.java:730)
java.base@13.0.2/javax.crypto.Cipher.doFinal(Cipher.java:2503)
java.base@13.0.2/sun.security.ssl.SSLCipher$T13GcmWriteCipherGenerator$GcmWriteCipher.encrypt(SSLCipher.java:2079)
java.base@13.0.2/sun.security.ssl.OutputRecord.t13Encrypt(OutputRecord.java:413)
java.base@13.0.2/sun.security.ssl.OutputRecord.encrypt(OutputRecord.java:336)
java.base@13.0.2/sun.security.ssl.SSLEngineOutputRecord.encode(SSLEngineOutputRecord.java:278)
java.base@13.0.2/sun.security.ssl.SSLEngineOutputRecord.encode(SSLEngineOutputRecord.java:180)
java.base@13.0.2/sun.security.ssl.SSLEngineImpl.encode(SSLEngineImpl.java:298)
java.base@13.0.2/sun.security.ssl.SSLEngineImpl.writeRecord(SSLEngineImpl.java:244)
java.base@13.0.2/sun.security.ssl.SSLEngineImpl.wrap(SSLEngineImpl.java:146)
java.base@13.0.2/sun.security.ssl.SSLEngineImpl.wrap(SSLEngineImpl.java:123)
java.base@13.0.2/javax.net.ssl.SSLEngine.wrap(SSLEngine.java:519)
io.netty.handler.ssl.SslHandler.wrap(SslHandler.java:1046)
io.netty.handler.ssl.SslHandler.wrap(SslHandler.java:832)
io.netty.handler.ssl.SslHandler.wrapAndFlush(SslHandler.java:800)
io.netty.handler.ssl.SslHandler.flush(SslHandler.java:781)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:749)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:741)
io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:727)
io.netty.handler.logging.LoggingHandler.flush(LoggingHandler.java:265)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:749)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:741)
io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:727)
org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.doFlush(Netty4MessageChannelHandler.java:163)
org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelWritabilityChanged(Netty4MessageChannelHandler.java:91)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelWritabilityChanged(AbstractChannelHandlerContext.java:436)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelWritabilityChanged(AbstractChannelHandlerContext.java:423)
io.netty.channel.AbstractChannelHandlerContext.fireChannelWritabilityChanged(AbstractChannelHandlerContext.java:416)
io.netty.handler.logging.LoggingHandler.channelWritabilityChanged(LoggingHandler.java:257)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelWritabilityChanged(AbstractChannelHandlerContext.java:436)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelWritabilityChanged(AbstractChannelHandlerContext.java:423)
io.netty.channel.AbstractChannelHandlerContext.fireChannelWritabilityChanged(AbstractChannelHandlerContext.java:416)
io.netty.channel.DefaultChannelPipeline$HeadContext.channelWritabilityChanged(DefaultChannelPipeline.java:1445)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelWritabilityChanged(AbstractChannelHandlerContext.java:436)
io.netty.channel.AbstractChannelHandlerContext.invokeChannelWritabilityChanged(AbstractChannelHandlerContext.java:423)
io.netty.channel.DefaultChannelPipeline.fireChannelWritabilityChanged(DefaultChannelPipeline.java:943)
io.netty.channel.ChannelOutboundBuffer.fireChannelWritabilityChanged(ChannelOutboundBuffer.java:626)
io.netty.channel.ChannelOutboundBuffer.setWritable(ChannelOutboundBuffer.java:592)
io.netty.channel.ChannelOutboundBuffer.decrementPendingOutboundBytes(ChannelOutboundBuffer.java:194)
io.netty.channel.ChannelOutboundBuffer.remove(ChannelOutboundBuffer.java:271)
io.netty.channel.ChannelOutboundBuffer.removeBytes(ChannelOutboundBuffer.java:350)
org.elasticsearch.transport.CopyBytesSocketChannel.doWrite(CopyBytesSocketChannel.java:111)
io.netty.channel.AbstractChannel$AbstractUnsafe.flush0(AbstractChannel.java:931)
io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.flush0(AbstractNioChannel.java:354)
io.netty.channel.AbstractChannel$AbstractUnsafe.flush(AbstractChannel.java:898)
io.netty.channel.DefaultChannelPipeline$HeadContext.flush(DefaultChannelPipeline.java:1384)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:749)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:741)
io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:727)
io.netty.handler.ssl.SslHandler.forceFlush(SslHandler.java:2033)
io.netty.handler.ssl.SslHandler.wrapAndFlush(SslHandler.java:804)
io.netty.handler.ssl.SslHandler.flush(SslHandler.java:781)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:749)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:741)
io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:727)
io.netty.handler.logging.LoggingHandler.flush(LoggingHandler.java:265)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:749)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:741)
io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:727)
org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.doFlush(Netty4MessageChannelHandler.java:163)
org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.flush(Netty4MessageChannelHandler.java:100)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:749)
io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:741)
io.netty.channel.AbstractChannelHandlerContext.access$2100(AbstractChannelHandlerContext.java:56)
io.netty.channel.AbstractChannelHandlerContext$WriteAndFlushTask.write(AbstractChannelHandlerContext.java:1150)
io.netty.channel.AbstractChannelHandlerContext$AbstractWriteTask.run(AbstractChannelHandlerContext.java:1073)
io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:510)
io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:518)
io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050)
io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
::: { node-0}{Qu5U8EbtTcuIpzwMjWiT5g}{iPZyuXX2QHKgbLZ2stxCNw}{ x.x.x.12}{ x.x.x.12:9300}{dilm}{ml.machine_memory=63157198848, ml.max_open_jobs=20, xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.544Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
92.8% (464ms out of 500ms) cpu usage by thread 'elasticsearch[ node-0][[index-indexhz-app-000050][0]: Lucene Merge Thread #639]'
2/10 snapshots sharing following 16 elements
app//org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:212)
app//org.apache.lucene.codecs.lucene84.ForUtil.encode(ForUtil.java:291)
app//org.apache.lucene.codecs.lucene84.ForDeltaUtil.encodeDeltas(ForDeltaUtil.java:67)
app//org.apache.lucene.codecs.lucene84.Lucene84PostingsWriter.startDoc(Lucene84PostingsWriter.java:251)
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:148)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
3/10 snapshots sharing following 12 elements
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:148)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
5/10 snapshots sharing following 11 elements
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
88.0% (439.8ms out of 500ms) cpu usage by thread 'elasticsearch[ node-0][[index-indexhz-app-000050][0]: Lucene Merge Thread #636]'
3/10 snapshots sharing following 16 elements
app//org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:213)
app//org.apache.lucene.codecs.lucene84.ForUtil.encode(ForUtil.java:291)
app//org.apache.lucene.codecs.lucene84.ForDeltaUtil.encodeDeltas(ForDeltaUtil.java:67)
app//org.apache.lucene.codecs.lucene84.Lucene84PostingsWriter.startDoc(Lucene84PostingsWriter.java:251)
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:148)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
2/10 snapshots sharing following 16 elements
app//org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:212)
app//org.apache.lucene.codecs.lucene84.ForUtil.encode(ForUtil.java:291)
app//org.apache.lucene.codecs.lucene84.ForDeltaUtil.encodeDeltas(ForDeltaUtil.java:67)
app//org.apache.lucene.codecs.lucene84.Lucene84PostingsWriter.startDoc(Lucene84PostingsWriter.java:251)
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:148)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
3/10 snapshots sharing following 12 elements
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:148)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
2/10 snapshots sharing following 15 elements
app//org.apache.lucene.index.MappingMultiPostingsEnum$MappingPostingsSub.nextDoc(MappingMultiPostingsEnum.java:51)
app//org.apache.lucene.index.DocIDMerger$SequentialDocIDMerger.next(DocIDMerger.java:99)
app//org.apache.lucene.index.MappingMultiPostingsEnum.nextDoc(MappingMultiPostingsEnum.java:103)
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:135)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
75.8% (379.2ms out of 500ms) cpu usage by thread 'elasticsearch[ node-0][[index-indexhz-app-000050][0]: Lucene Merge Thread #581]'
10/10 snapshots sharing following 11 elements
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:197)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:245)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:140)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4463)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4057)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
::: { node-3}{uFpScRo9QTavK1z4cJTbFg}{6fUMSmhTRrCn-udUR4C7Dg}{ x.x.x.221}{ x.x.x.221:9300}{di}{xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.545Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
17.8% (89.1ms out of 500ms) cpu usage by thread 'elasticsearch[ node-3][write][T#13]'
2/10 snapshots sharing following 188 elements
app//org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:250)
app//org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:495)
app//org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594)
app//org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1213)
app//org.elasticsearch.index.engine.InternalEngine.addDocs(InternalEngine.java:1157)
app//org.elasticsearch.index.engine.InternalEngine.indexIntoLucene(InternalEngine.java:1094)
app//org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:934)
app//org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:813)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:785)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:742)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:267)
app//org.elasticsearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:157)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:202)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:114)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:81)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:895)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:109)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:374)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:297)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$4896/0x0000000801968040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.index.shard.IndexShard.lambda$wrapPrimaryOperationPermitListener$24(IndexShard.java:2791)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$4882/0x000000080195d840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$3.onResponse(ActionListener.java:113)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:285)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:237)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2765)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:836)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:293)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.handlePrimaryRequest(TransportReplicationAction.java:256)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$$Lambda$2981/0x0000000801502440.messageReceived(Unknown Source)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:257)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.lambda$messageReceived$0(SecurityServerTransportInterceptor.java:306)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$$Lambda$4150/0x00000008017a6440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:344)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4319/0x000000080181ec40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:71)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:102)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:82)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23)
org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:345)
org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:322)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:263)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4304/0x000000080181ac40.accept(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:591)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:507)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$3(RBACEngine.java:298)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4308/0x000000080181c040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4310/0x000000080181c840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:554)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:251)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4312/0x000000080181d040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4310/0x000000080181c840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:329)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:247)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4302/0x0000000801819840.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:250)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4303/0x000000080181a040.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:290)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4306/0x000000080181b840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:314)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:287)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:261)
org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:227)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:193)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4273/0x0000000801811840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:117)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4275/0x0000000801812040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:155)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:246)
org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:123)
org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:111)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:195)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.lambda$inbound$1(ServerTransportFilter.java:130)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile$$Lambda$4152/0x00000008017a5c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:248)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4154/0x00000008017a5440.accept(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:310)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4155/0x00000008017a4840.run(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:321)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:245)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:196)
org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:139)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.inbound(ServerTransportFilter.java:121)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:313)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:762)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:692)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
17.7% (88.7ms out of 500ms) cpu usage by thread 'elasticsearch[ node-3][write][T#11]'
2/10 snapshots sharing following 188 elements
app//org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:250)
app//org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:495)
app//org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594)
app//org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1213)
app//org.elasticsearch.index.engine.InternalEngine.addDocs(InternalEngine.java:1157)
app//org.elasticsearch.index.engine.InternalEngine.indexIntoLucene(InternalEngine.java:1094)
app//org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:934)
app//org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:813)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:785)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:742)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:267)
app//org.elasticsearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:157)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:202)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:114)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:81)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:895)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:109)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:374)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:297)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$4896/0x0000000801968040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.index.shard.IndexShard.lambda$wrapPrimaryOperationPermitListener$24(IndexShard.java:2791)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$4882/0x000000080195d840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$3.onResponse(ActionListener.java:113)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:285)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:237)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2765)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:836)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:293)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.handlePrimaryRequest(TransportReplicationAction.java:256)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$$Lambda$2981/0x0000000801502440.messageReceived(Unknown Source)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:257)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.lambda$messageReceived$0(SecurityServerTransportInterceptor.java:306)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$$Lambda$4150/0x00000008017a6440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$15(AuthorizationService.java:344)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4319/0x000000080181ec40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.BulkShardRequestInterceptor.intercept(BulkShardRequestInterceptor.java:71)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.SearchRequestInterceptor.intercept(SearchRequestInterceptor.java:19)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.IndicesAliasesRequestInterceptor.intercept(IndicesAliasesRequestInterceptor.java:102)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.ResizeRequestInterceptor.intercept(ResizeRequestInterceptor.java:82)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$runRequestInterceptors$14(AuthorizationService.java:339)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4317/0x000000080181e440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$1.doRun(ListenableFuture.java:112)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:225)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:106)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.lambda$done$0(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.ListenableFuture$$Lambda$4127/0x000000080179c440.accept(Unknown Source)
java.base@13.0.2/java.util.ArrayList.forEach(ArrayList.java:1507)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.done(ListenableFuture.java:98)
app//org.elasticsearch.common.util.concurrent.BaseFuture.set(BaseFuture.java:144)
app//org.elasticsearch.common.util.concurrent.ListenableFuture.onResponse(ListenableFuture.java:127)
app//org.elasticsearch.action.StepListener.innerOnResponse(StepListener.java:62)
app//org.elasticsearch.action.NotifyOnceListener.onResponse(NotifyOnceListener.java:40)
org.elasticsearch.xpack.security.authz.interceptor.FieldAndDocumentLevelSecurityRequestInterceptor.intercept(FieldAndDocumentLevelSecurityRequestInterceptor.java:61)
org.elasticsearch.xpack.security.authz.interceptor.UpdateRequestInterceptor.intercept(UpdateRequestInterceptor.java:23)
org.elasticsearch.xpack.security.authz.AuthorizationService.runRequestInterceptors(AuthorizationService.java:345)
org.elasticsearch.xpack.security.authz.AuthorizationService.handleIndexActionAuthorizationResult(AuthorizationService.java:322)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$9(AuthorizationService.java:263)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4304/0x000000080181ac40.accept(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:616)
org.elasticsearch.xpack.security.authz.AuthorizationService$AuthorizationResultListener.onResponse(AuthorizationService.java:591)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.buildIndicesAccessControl(RBACEngine.java:507)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$3(RBACEngine.java:298)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4308/0x000000080181c040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4310/0x000000080181c840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService.resolveIndexNames(AuthorizationService.java:554)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$6(AuthorizationService.java:251)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4312/0x000000080181d040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.lambda$getAsync$0(AuthorizationService.java:653)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier$$Lambda$4310/0x000000080181c840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.loadAuthorizedIndices(RBACEngine.java:329)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$5(AuthorizationService.java:247)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4302/0x0000000801819840.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorizeAction$8(AuthorizationService.java:250)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4303/0x000000080181a040.getAsync(Unknown Source)
org.elasticsearch.xpack.security.authz.AuthorizationService$CachingAsyncSupplier.getAsync(AuthorizationService.java:651)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$authorizeIndexAction$4(RBACEngine.java:290)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4306/0x000000080181b840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexActionName(RBACEngine.java:314)
org.elasticsearch.xpack.security.authz.RBACEngine.authorizeIndexAction(RBACEngine.java:287)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorizeAction(AuthorizationService.java:261)
org.elasticsearch.xpack.security.authz.AuthorizationService.maybeAuthorizeRunAs(AuthorizationService.java:227)
org.elasticsearch.xpack.security.authz.AuthorizationService.lambda$authorize$1(AuthorizationService.java:193)
org.elasticsearch.xpack.security.authz.AuthorizationService$$Lambda$4273/0x0000000801811840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
app//org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43)
org.elasticsearch.xpack.security.authz.RBACEngine.lambda$resolveAuthorizationInfo$1(RBACEngine.java:117)
org.elasticsearch.xpack.security.authz.RBACEngine$$Lambda$4275/0x0000000801812040.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.roles(CompositeRolesStore.java:155)
org.elasticsearch.xpack.security.authz.store.CompositeRolesStore.getRoles(CompositeRolesStore.java:246)
org.elasticsearch.xpack.security.authz.RBACEngine.getRoles(RBACEngine.java:123)
org.elasticsearch.xpack.security.authz.RBACEngine.resolveAuthorizationInfo(RBACEngine.java:111)
org.elasticsearch.xpack.security.authz.AuthorizationService.authorize(AuthorizationService.java:195)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.lambda$inbound$1(ServerTransportFilter.java:130)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile$$Lambda$4152/0x00000008017a5c40.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$authenticateAsync$2(AuthenticationService.java:248)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4154/0x00000008017a5440.accept(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lambda$lookForExistingAuthentication$6(AuthenticationService.java:310)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator$$Lambda$4155/0x00000008017a4840.run(Unknown Source)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.lookForExistingAuthentication(AuthenticationService.java:321)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.authenticateAsync(AuthenticationService.java:245)
org.elasticsearch.xpack.security.authc.AuthenticationService$Authenticator.access$000(AuthenticationService.java:196)
org.elasticsearch.xpack.security.authc.AuthenticationService.authenticate(AuthenticationService.java:139)
org.elasticsearch.xpack.security.transport.ServerTransportFilter$NodeProfile.inbound(ServerTransportFilter.java:121)
org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:313)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:762)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:692)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
::: { node-2}{WGKaMavTT6CzYVlvESbwuw}{qFsLcku4SUak_IEjt1W3Zg}{ x.x.x.220}{ x.x.x.220:9300}{di}{xpack.installed=true}
Hot threads at 2021-03-01T02:27:36.545Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
[2021-03-01T00:00:23,210][DEBUG][o.e.a.b.TransportShardBulkAction] [node-2] [index-ability-hz-2021.03.01][0] failed to execute bulk item (index) index {[index-ability-hz-2021.03.01][_doc][0uwV63cBclN6oM9f0bDv], source[{"@timestamp":"2021-03-01T00:00:11.755Z","name":"caching_location_tombstone_counter","type":"counter","host":"eastavailability-hz-6","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) ~[elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:23,210][DEBUG][o.e.a.b.TransportShardBulkAction] [node-2] [index-ability-hz-2021.03.01][0] failed to execute bulk item (index) index {[index-ability-hz-2021.03.01][_doc][Hu0V63cBclN6oM9f1ASj], source[{"@timestamp":"2021-03-01T00:00:12.447Z","name":"caching_location_tombstone_counter","type":"counter","host":"eastavailability-hz-5","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) ~[elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:23,210][DEBUG][o.e.a.b.TransportShardBulkAction] [node-2] [index-ability-hz-2021.03.01][0] failed to execute bulk item (index) index {[index-ability-hz-2021.03.01][_doc][0uwV63cBclN6oM9f0bDv], source[{"@timestamp":"2021-03-01T00:00:11.755Z","name":"caching_location_tombstone_counter","type":"counter","host":"eastavailability-hz-6","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) ~[elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:23,210][DEBUG][o.e.a.b.TransportShardBulkAction] [node-2] [index-ability-hz-2021.03.01][0] failed to execute bulk item (index) index {[index-ability-hz-2021.03.01][_doc][Hu0V63cBclN6oM9f1ASj], source[{"@timestamp":"2021-03-01T00:00:12.447Z","name":"caching_location_tombstone_counter","type":"counter","host":"eastavailability-hz-5","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) ~[elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T02:47:21,575][INFO ][o.e.m.j.JvmGcMonitorService] [node-2] [gc][11949353] overhead, spent [351ms] collecting in the last [1s]
[2021-03-01T00:00:00,130][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-system-elasticsearch-2021.03.01] creating index, cause [auto(bulk api)], templates [], shards [1]/[1], mappings []
[2021-03-01T00:00:01,134][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-vendor-supply-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:01,872][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [index-ability-api-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, index-ability-api], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:02,549][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.03.01] creating index, cause [auto(bulk api)], templates [cc_topic], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:03,399][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-sourcing-optimizer-api], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:04,084][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-warehouse-supply-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:04,788][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [index--common-cc-consumer-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, index--common-cc-consumer], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:05,364][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-store-delta-sync-supply-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:06,005][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [index-ability-hz-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, index-ability-hz], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:06,649][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-safetystock-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:07,262][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-inventory], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:07,809][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-microservice-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:08,476][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-product-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:09,073][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-capacity-hz], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:09,957][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-onesie-updates-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:10,859][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [.monitoring-kibana-7-2021.03.01] creating index, cause [auto(bulk api)], templates [.monitoring-kibana], shards [1]/[0], mappings [_doc]
[2021-03-01T00:00:10,872][INFO ][o.e.c.r.a.AllocationService] [node-0] updating number_of_replicas to [1] for indices [.monitoring-kibana-7-2021.03.01]
[2021-03-01T00:00:11,520][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-common-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-common], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:12,084][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-store-pps-kill-supply-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:12,702][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-capacity-scheduler], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:13,331][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-sourcing-configurator], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:13,990][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-ml-stock-out-updates-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:14,587][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-capacity-api], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:15,201][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01] creating index, cause [auto(bulk api)], templates [], shards [1]/[1], mappings []
[2021-03-01T00:00:15,855][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_jmx], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:16,615][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-aggnode-supply-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:17,339][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-sourcing-auditor], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:17,942][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:18,574][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-sourcing-optimizer-hz, large_index_2_shards_policy], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:19,449][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [index--capacity-change-events-consumer-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, index--capacity-change-events-consumer], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:20,067][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.03.01/HxdB953iSHCmIQhE4vvEYA] update_mapping [_doc]
[2021-03-01T00:00:20,169][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:20,173][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:20,275][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] create_mapping [_doc]
[2021-03-01T00:00:20,375][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-api-2021.03.01/mL65VU-OTp6AJIyURqxRmw] update_mapping [_doc]
[2021-03-01T00:00:20,397][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-api-2021.03.01/mL65VU-OTp6AJIyURqxRmw] update_mapping [_doc]
[2021-03-01T00:00:20,410][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:20,510][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--common-cc-consumer-2021.03.01/JA4ZYFvTTxyAHxstmdWZUw] update_mapping [_doc]
[2021-03-01T00:00:20,605][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:20,700][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-hz-2021.03.01/hZB8mfupQgejPNXoOrBMmg] update_mapping [_doc]
[2021-03-01T00:00:20,705][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:20,847][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:20,853][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:20,953][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:00:21,055][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:21,061][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-hz-2021.03.01/hZB8mfupQgejPNXoOrBMmg] update_mapping [_doc]
[2021-03-01T00:00:21,162][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01/_ICNxtjjSQGeBjzmV5ewSg] update_mapping [_doc]
[2021-03-01T00:00:21,167][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--common-cc-consumer-2021.03.01/JA4ZYFvTTxyAHxstmdWZUw] update_mapping [_doc]
[2021-03-01T00:00:21,265][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:00:21,366][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:21,371][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:21,469][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:21,475][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:21,481][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.03.01/HxdB953iSHCmIQhE4vvEYA] update_mapping [_doc]
[2021-03-01T00:00:21,486][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01/_ICNxtjjSQGeBjzmV5ewSg] update_mapping [_doc]
[2021-03-01T00:00:21,491][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:21,496][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:21,607][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:00:21,715][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01/Sbj7RZnkTES9Kjyni-OmGg] update_mapping [_doc]
[2021-03-01T00:00:21,817][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-common-2021.03.01/WFiqh_wLTm2S_aaBNoxlAA] update_mapping [_doc]
[2021-03-01T00:00:21,925][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:22,028][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] create_mapping [_doc]
[2021-03-01T00:00:22,034][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:22,173][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:22,304][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:00:22,311][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01/Sbj7RZnkTES9Kjyni-OmGg] update_mapping [_doc]
[2021-03-01T00:00:22,447][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:00:22,584][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01/KQu4xQEpT8yhFq22roGUrQ] update_mapping [_doc]
[2021-03-01T00:00:22,718][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:22,723][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:22,858][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01/2NYm6t5sR4WoiO6k_uqbuw] update_mapping [_doc]
[2021-03-01T00:00:22,865][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:23,006][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01/YV-MqjhmRDuExbcze-TIrw] update_mapping [_doc]
[2021-03-01T00:00:23,013][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01/YV-MqjhmRDuExbcze-TIrw] update_mapping [_doc]
[2021-03-01T00:00:23,195][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:00:23,206][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:23,208][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[index-ability-hz-2021.03.01/hZB8mfupQgejPNXoOrBMmg]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:23,209][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[index-ability-hz-2021.03.01/hZB8mfupQgejPNXoOrBMmg]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:23,786][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[index--capacity-change-events-consumer-2021.03.01][0]]]).
[2021-03-01T00:00:24,009][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:00:24,248][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:24,648][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:25,022][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01/2NYm6t5sR4WoiO6k_uqbuw] update_mapping [_doc]
[2021-03-01T00:00:26,696][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01/YV-MqjhmRDuExbcze-TIrw] update_mapping [_doc]
[2021-03-01T00:00:27,409][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [index-ability-integrator-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, index-ability-integrator], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:28,098][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [index--availability-cc-consumer-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, index--availability-cc-consumer], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:28,835][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:29,533][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-price-cost-updates-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:30,282][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metricbeat-old-mirrormaker-2021.03.01] creating index, cause [auto(bulk api)], templates [], shards [1]/[1], mappings []
[2021-03-01T00:00:30,964][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01] creating index, cause [auto(bulk api)], templates [platform_metrics_micrometer, metrics-micrometer-sbk-location-bb], shards [1]/[1], mappings [_doc]
[2021-03-01T00:00:31,526][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:31,835][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:31,960][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:00:31,965][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:00:31,969][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:32,080][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:32,203][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:32,318][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] update_mapping [_doc]
[2021-03-01T00:00:32,419][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:00:32,424][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:32,428][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:32,433][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:00:32,437][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:32,442][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:32,641][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:00:32,753][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01/_ICNxtjjSQGeBjzmV5ewSg] update_mapping [_doc]
[2021-03-01T00:00:32,865][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:32,970][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01/_ICNxtjjSQGeBjzmV5ewSg] update_mapping [_doc]
[2021-03-01T00:00:32,975][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:33,079][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01/Sbj7RZnkTES9Kjyni-OmGg] update_mapping [_doc]
[2021-03-01T00:00:33,184][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:00:33,288][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:00:33,295][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:33,302][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01/Sbj7RZnkTES9Kjyni-OmGg] update_mapping [_doc]
[2021-03-01T00:00:33,442][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:33,448][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:33,549][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-common-2021.03.01/WFiqh_wLTm2S_aaBNoxlAA] update_mapping [_doc]
[2021-03-01T00:00:33,651][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:33,656][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:33,760][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01/KQu4xQEpT8yhFq22roGUrQ] update_mapping [_doc]
[2021-03-01T00:00:33,865][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:33,872][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:33,972][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--common-cc-consumer-2021.03.01/JA4ZYFvTTxyAHxstmdWZUw] update_mapping [_doc]
[2021-03-01T00:00:33,979][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:33,983][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--common-cc-consumer-2021.03.01/JA4ZYFvTTxyAHxstmdWZUw] update_mapping [_doc]
[2021-03-01T00:00:33,987][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:33,990][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:34,235][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-hz-2021.03.01/hZB8mfupQgejPNXoOrBMmg] update_mapping [_doc]
[2021-03-01T00:00:34,240][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-hz-2021.03.01/hZB8mfupQgejPNXoOrBMmg] update_mapping [_doc]
[2021-03-01T00:00:34,347][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-api-2021.03.01/mL65VU-OTp6AJIyURqxRmw] update_mapping [_doc]
[2021-03-01T00:00:34,460][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:00:34,580][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:34,691][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:34,697][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01/YV-MqjhmRDuExbcze-TIrw] update_mapping [_doc]
[2021-03-01T00:00:34,813][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [logging-sbk-availability-hz-app-000050/ROnrOYq5SOm03riv-ivjLQ] update_mapping [_doc]
[2021-03-01T00:00:34,825][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:34,832][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:00:34,944][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--availability-cc-consumer-2021.03.01/B4StDINZTSu-g9kpW36KGA] update_mapping [_doc]
[2021-03-01T00:00:34,949][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--availability-cc-consumer-2021.03.01/B4StDINZTSu-g9kpW36KGA] update_mapping [_doc]
[2021-03-01T00:00:35,099][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-integrator-2021.03.01/_dx58zn4ReOR9VJ7H_aufQ] update_mapping [_doc]
[2021-03-01T00:00:35,105][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-integrator-2021.03.01/_dx58zn4ReOR9VJ7H_aufQ] update_mapping [_doc]
[2021-03-01T00:00:35,211][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] create_mapping [_doc]
[2021-03-01T00:00:35,218][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:35,226][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,227][DEBUG][o.e.a.b.TransportShardBulkAction] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][0] failed to execute bulk item (index) index {[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][_doc][iOkV63cBclN6oM9fr13H], source[{"@timestamp":"2021-03-01T00:00:00.379Z","name":"jvm_gc_memory_promoted","type":"counter","host":"eastsbk-vendor-supply-bb-1","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,227][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,228][DEBUG][o.e.a.b.TransportShardBulkAction] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][0] failed to execute bulk item (index) index {[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][_doc][Y-kV63cBclN6oM9fr1_I], source[{"@timestamp":"2021-03-01T00:00:00.704Z","name":"jvm_gc_memory_promoted","type":"counter","host":"eastsbk-vendor-supply-bb-2","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,228][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,229][DEBUG][o.e.a.b.TransportShardBulkAction] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][0] failed to execute bulk item (index) index {[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][_doc][u_EW63cBclN6oM9fGs6w], source[{"@timestamp":"2021-03-01T00:00:30.378Z","name":"jvm_gc_memory_promoted","type":"counter","host":"eastsbk-vendor-supply-bb-1","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,229][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,230][DEBUG][o.e.a.b.TransportShardBulkAction] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][0] failed to execute bulk item (index) index {[metrics-micrometer-sbk-vendor-supply-bb-2021.03.01][_doc][U_IW63cBclN6oM9fGxX1], source[{"@timestamp":"2021-03-01T00:00:30.704Z","name":"jvm_gc_memory_promoted","type":"counter","host":"eastsbk-vendor-supply-bb-2","count":0.0}]}
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:35,509][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:00:35,618][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01/2m6qGbc5RIOnZTzRitFLUw] update_mapping [_doc]
[2021-03-01T00:00:35,967][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:00:35,975][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:00:36,934][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:37,543][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01/2NYm6t5sR4WoiO6k_uqbuw] update_mapping [_doc]
[2021-03-01T00:00:37,548][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01/2NYm6t5sR4WoiO6k_uqbuw] update_mapping [_doc]
[2021-03-01T00:00:39,117][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--availability-cc-consumer-2021.03.01/B4StDINZTSu-g9kpW36KGA] update_mapping [_doc]
[2021-03-01T00:00:39,122][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--availability-cc-consumer-2021.03.01/B4StDINZTSu-g9kpW36KGA] update_mapping [_doc]
[2021-03-01T00:00:39,126][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-integrator-2021.03.01/_dx58zn4ReOR9VJ7H_aufQ] update_mapping [_doc]
[2021-03-01T00:00:39,130][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:39,135][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:39,483][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:00:39,617][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01/_ICNxtjjSQGeBjzmV5ewSg] update_mapping [_doc]
[2021-03-01T00:00:39,755][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:00:39,897][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:40,013][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01/Sbj7RZnkTES9Kjyni-OmGg] update_mapping [_doc]
[2021-03-01T00:00:40,020][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:00:40,137][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:40,242][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01/KQu4xQEpT8yhFq22roGUrQ] update_mapping [_doc]
[2021-03-01T00:00:40,386][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:40,391][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:40,395][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:40,496][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:40,593][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:00:40,693][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:00:40,697][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:00:40,802][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:41,253][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:41,365][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:00:41,475][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] update_mapping [_doc]
[2021-03-01T00:00:41,587][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:41,594][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:41,698][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--availability-cc-consumer-2021.03.01/B4StDINZTSu-g9kpW36KGA] update_mapping [_doc]
[2021-03-01T00:00:41,904][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:41,909][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01/_ICNxtjjSQGeBjzmV5ewSg] update_mapping [_doc]
[2021-03-01T00:00:42,014][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01/YV-MqjhmRDuExbcze-TIrw] update_mapping [_doc]
[2021-03-01T00:00:42,148][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:42,153][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:42,158][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:42,257][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:42,362][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:42,468][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:42,474][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] update_mapping [_doc]
[2021-03-01T00:00:42,477][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:42,578][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-api-2021.03.01/mL65VU-OTp6AJIyURqxRmw] update_mapping [_doc]
[2021-03-01T00:00:42,683][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:00:42,691][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--availability-cc-consumer-2021.03.01/B4StDINZTSu-g9kpW36KGA] update_mapping [_doc]
[2021-03-01T00:00:42,697][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:42,702][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-integrator-2021.03.01/_dx58zn4ReOR9VJ7H_aufQ] update_mapping [_doc]
[2021-03-01T00:00:42,806][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--common-cc-consumer-2021.03.01/JA4ZYFvTTxyAHxstmdWZUw] update_mapping [_doc]
[2021-03-01T00:00:42,814][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:42,819][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--common-cc-consumer-2021.03.01/JA4ZYFvTTxyAHxstmdWZUw] update_mapping [_doc]
[2021-03-01T00:00:42,927][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:00:42,943][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:42,966][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:42,972][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:42,981][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:44,958][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:00:45,276][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01/2NYm6t5sR4WoiO6k_uqbuw] update_mapping [_doc]
[2021-03-01T00:00:45,281][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01/2NYm6t5sR4WoiO6k_uqbuw] update_mapping [_doc]
[2021-03-01T00:00:45,842][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:00:46,539][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:00:46,680][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:46,686][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01/Sbj7RZnkTES9Kjyni-OmGg] update_mapping [_doc]
[2021-03-01T00:00:46,693][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--availability-cc-consumer-2021.03.01/B4StDINZTSu-g9kpW36KGA] update_mapping [_doc]
[2021-03-01T00:00:46,700][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:46,704][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:00:46,707][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01/KQu4xQEpT8yhFq22roGUrQ] update_mapping [_doc]
[2021-03-01T00:00:46,712][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:46,817][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01/2m6qGbc5RIOnZTzRitFLUw] update_mapping [_doc]
[2021-03-01T00:00:46,827][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:00:46,832][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:46,838][DEBUG][o.e.a.a.i.m.p.TransportPutMappingAction] [node-0] failed to put mappings on indices [[[metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw]]], type [_doc]
java.lang.IllegalArgumentException: mapper [count] cannot be changed from type [long] to [float]
at org.elasticsearch.index.mapper.MappedFieldType.checkTypeName(MappedFieldType.java:154) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MappedFieldType.checkCompatibility(MappedFieldType.java:167) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateFieldMapper(MapperMergeValidator.java:93) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperMergeValidator.validateNewMappers(MapperMergeValidator.java:65) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:483) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:347) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.applyRequest(MetaDataMappingService.java:315) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.metadata.MetaDataMappingService$PutMappingExecutor.execute(MetaDataMappingService.java:238) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:702) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:324) ~[elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:219) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:633) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.6.2.jar:7.6.2]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.6.2.jar:7.6.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:830) [?:?]
[2021-03-01T00:00:47,145][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:47,398][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index-ability-api-2021.03.01/mL65VU-OTp6AJIyURqxRmw] update_mapping [_doc]
[2021-03-01T00:00:47,650][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:00:47,782][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:47,906][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:48,058][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:48,237][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:00:48,248][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:00:48,426][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:00:49,051][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:49,233][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] update_mapping [_doc]
[2021-03-01T00:00:49,429][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--common-cc-consumer-2021.03.01/JA4ZYFvTTxyAHxstmdWZUw] update_mapping [_doc]
[2021-03-01T00:00:49,651][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:00:49,834][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-inventory-2021.03.01/_ICNxtjjSQGeBjzmV5ewSg] update_mapping [_doc]
[2021-03-01T00:00:50,298][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:50,478][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:00:50,803][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01/-TCTbCiFTYqj2Q1qalduRg] update_mapping [_doc]
[2021-03-01T00:00:50,811][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-sbk-celectfeed-2021.03.01/jIJI13ftRKShIsd_geVUew] update_mapping [_doc]
[2021-03-01T00:00:51,322][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:51,331][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:51,614][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:51,943][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:51,949][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:00:51,954][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:00:52,104][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01/KQu4xQEpT8yhFq22roGUrQ] update_mapping [_doc]
[2021-03-01T00:00:52,111][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:52,123][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:52,127][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:00:52,133][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:00:52,141][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:00:52,154][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01/Sbj7RZnkTES9Kjyni-OmGg] update_mapping [_doc]
[2021-03-01T00:00:52,158][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:00:52,162][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:52,166][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:52,171][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:52,607][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:00:54,097][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:00:54,626][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:00:55,319][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:00:55,632][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01/2NYm6t5sR4WoiO6k_uqbuw] update_mapping [_doc]
[2021-03-01T00:00:56,319][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:56,802][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:00:56,933][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:00:56,953][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:00:56,961][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:00:57,106][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01/2m6qGbc5RIOnZTzRitFLUw] update_mapping [_doc]
[2021-03-01T00:00:57,147][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01/KQu4xQEpT8yhFq22roGUrQ] update_mapping [_doc]
[2021-03-01T00:00:57,152][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-safetystock-bb-2021.03.01/OnrreTAQQaaKF5vRWZARsg] update_mapping [_doc]
[2021-03-01T00:00:57,158][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:00:57,162][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:00:57,170][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-elasticsearch-2021.03.01/KkV9cUYoSRaFrwmBITSqlQ] update_mapping [_doc]
[2021-03-01T00:00:57,825][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [.watcher-history-10-2021.03.01] creating index, cause [auto(bulk api)], templates [.watch-history-10], shards [1]/[0], mappings [_doc]
[2021-03-01T00:00:57,843][INFO ][o.e.c.r.a.AllocationService] [node-0] updating number_of_replicas to [1] for indices [.watcher-history-10-2021.03.01]
[2021-03-01T00:00:59,225][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01/SDpyd6PdR6-helmQb_Pqcw] update_mapping [_doc]
[2021-03-01T00:00:59,337][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-microservice-bb-2021.03.01/hEEjKrtXRTKO6qqWJkoeLw] update_mapping [_doc]
[2021-03-01T00:01:00,103][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01/6MEPVrG1RuWO3VHQ0gQPlQ] update_mapping [_doc]
[2021-03-01T00:01:00,269][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:01:00,497][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] update_mapping [_doc]
[2021-03-01T00:01:00,501][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:01:00,606][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01/QF_KhTgrQ36K4nLKaMHECg] update_mapping [_doc]
[2021-03-01T00:01:00,713][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:01:01,084][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:01:01,195][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:01:01,537][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01/7ZI5XmV9TUi9Gb0SoXxiqw] update_mapping [_doc]
[2021-03-01T00:01:01,544][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] update_mapping [_doc]
[2021-03-01T00:01:01,553][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-system-sbk-celectfeed-2021.03.01/tLUULhVyROGVBRXnKLkAlw] update_mapping [_doc]
[2021-03-01T00:01:01,573][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01/2m6qGbc5RIOnZTzRitFLUw] update_mapping [_doc]
[2021-03-01T00:01:01,687][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:01:01,781][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-product-bb-2021.03.01/4qhkzZX4TuCDU6wFnv4HdA] update_mapping [_doc]
[2021-03-01T00:01:01,796][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-configurator-2021.03.01/KQu4xQEpT8yhFq22roGUrQ] update_mapping [_doc]
[2021-03-01T00:01:01,801][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:01:01,807][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:01:01,811][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:01:01,932][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [.watcher-history-10-2021.03.01/utDh6TUNTNGeKCYiTwuxhg] update_mapping [_doc]
[2021-03-01T00:01:01,937][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:01:02,372][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:01:02,512][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:01:02,634][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [.watcher-history-10-2021.03.01/utDh6TUNTNGeKCYiTwuxhg] update_mapping [_doc]
[2021-03-01T00:01:02,640][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:01:04,298][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:01:04,457][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-sourcing-auditor-2021.03.01/Vls2m-w7QaGZXQADJpQcKQ] update_mapping [_doc]
[2021-03-01T00:01:04,865][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01/XBaNzuqLT-6VkE6aF78v_Q] update_mapping [_doc]
[2021-03-01T00:01:04,970][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:01:05,267][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01/B3dG4n4YRj-EHrWzKI230A] update_mapping [_doc]
[2021-03-01T00:01:05,471][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:01:05,579][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:01:05,720][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01/2m6qGbc5RIOnZTzRitFLUw] update_mapping [_doc]
[2021-03-01T00:01:05,928][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:01:06,538][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:01:07,102][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:01:07,679][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01/2m6qGbc5RIOnZTzRitFLUw] update_mapping [_doc]
[2021-03-01T00:01:07,908][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:01:08,012][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:01:08,020][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:01:08,131][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:01:08,282][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [index--capacity-change-events-consumer-2021.03.01/329roaLHSleZijp-pAKVcQ] update_mapping [_doc]
[2021-03-01T00:01:08,542][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:01:09,234][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:01:09,241][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-location-bb-2021.03.01/4Q4pIUuJSnGqShzetvgiQA] update_mapping [_doc]
[2021-03-01T00:01:09,500][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-api-2021.03.01/5eZL8HWYSmOSliaFbS3nxg] update_mapping [_doc]
[2021-03-01T00:01:09,740][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-demand-bb-2021.03.01/2m6qGbc5RIOnZTzRitFLUw] update_mapping [_doc]
[2021-03-01T00:01:09,847][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:01:10,109][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-scheduler-2021.03.01/B5Qh3t0_ROyLnh_zUZNnow] update_mapping [_doc]
[2021-03-01T00:01:10,807][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:01:11,366][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-capacity-hz-2021.03.01/J3V79K1vRLKNopC2Myf9Iw] update_mapping [_doc]
[2021-03-01T00:01:11,602][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01/d3u7kpwDT_OyJJgZMVSxcw] update_mapping [_doc]
[2021-03-01T00:01:11,973][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.27] from [{"phase":"hot","action":"complete","name":"complete"}] to [{"phase":"warm","action":"set_priority","name":"set_priority"}] in policy [cc_topic_policy]
[2021-03-01T00:01:12,655][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:12,815][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.watcher-history-10-2021.03.01][0]]]).
[2021-03-01T00:01:12,947][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-api-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:13,117][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:01:13,290][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:13,430][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:13,606][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--common-cc-consumer-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:13,736][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:13,865][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24] from [{"phase":"warm","action":"complete","name":"complete"}] to [{"phase":"cold","action":"set_priority","name":"set_priority"}] in policy [cc_topic_policy]
[2021-03-01T00:01:14,319][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-hz-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:14,485][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-safetystock-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:14,621][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-inventory-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:14,760][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-microservice-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:14,891][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-product-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:15,020][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-hz-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:15,150][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:15,321][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-common-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:15,457][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:15,624][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-scheduler-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:15,767][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-configurator-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:15,912][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:16,046][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-api-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:16,180][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-jmx-sbk-celectfeed-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_jmx_policy]
[2021-03-01T00:01:16,366][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:16,504][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-auditor-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:16,656][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:16,802][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:16,963][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--capacity-change-events-consumer-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:17,179][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-integrator-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:17,318][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--availability-cc-consumer-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:17,471][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-demand-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:17,600][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:17,736][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-location-bb-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:17,872][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [.watcher-history-10-2021.02.22] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"delete","action":"delete","name":"wait-for-shard-history-leases"}] in policy [watch-history-ilm-policy]
[2021-03-01T00:01:18,004][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [.watcher-history-10-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [watch-history-ilm-policy]
[2021-03-01T00:01:18,144][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.27] from [{"phase":"warm","action":"set_priority","name":"set_priority"}] to [{"phase":"warm","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:01:18,310][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:18,768][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-api-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:19,205][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [cc_topic_policy]
[2021-03-01T00:01:19,665][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:20,100][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:20,563][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--common-cc-consumer-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:21,013][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:21,488][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24] from [{"phase":"cold","action":"set_priority","name":"set_priority"}] to [{"phase":"cold","action":"freeze","name":"freeze"}] in policy [cc_topic_policy]
[2021-03-01T00:01:21,661][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] closing indices [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24/6b7lAaXFQBK-3qLXczoV1Q]
[2021-03-01T00:01:21,819][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-hz-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:22,243][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] completed closing of indices [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24]
[2021-03-01T00:01:22,600][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-safetystock-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:23,044][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24][0]]]).
[2021-03-01T00:01:23,348][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] opening indices [[cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24/6b7lAaXFQBK-3qLXczoV1Q]]
[2021-03-01T00:01:23,855][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24][0]]]).
[2021-03-01T00:01:24,084][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-inventory-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:24,770][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-microservice-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:25,220][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24][0]]]).
[2021-03-01T00:01:25,376][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-product-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:25,774][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-hz-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:26,256][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:26,650][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-common-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:27,046][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:27,456][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-scheduler-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:27,878][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-configurator-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:28,282][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:28,686][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-api-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:29,102][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-jmx-sbk-celectfeed-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_jmx_policy]
[2021-03-01T00:01:29,537][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:30,157][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-auditor-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:30,565][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:30,993][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:31,431][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--capacity-change-events-consumer-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:31,874][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-integrator-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:32,273][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--availability-cc-consumer-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:32,752][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-demand-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:33,142][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:33,578][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-location-bb-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:34,082][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-vendor-supply-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:34,212][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-api-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:34,343][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:01:34,479][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-optimizer-api-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:34,604][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-warehouse-supply-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:34,735][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--common-cc-consumer-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:34,891][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-store-delta-sync-supply-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:35,024][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-hz-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:35,253][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-safetystock-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:35,380][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-inventory-update-audit-events-us-east1-2021.02.24] from [{"phase":"cold","action":"freeze","name":"freeze"}] to [{"phase":"cold","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:01:35,512][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-inventory-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:35,642][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-microservice-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:35,857][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-product-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:35,984][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-hz-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:36,108][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-onesie-updates-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:36,236][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-common-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:36,364][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-store-pps-kill-supply-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:36,544][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-scheduler-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:36,689][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-configurator-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:36,815][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-ml-stock-out-updates-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:36,941][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-capacity-api-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:37,068][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-jmx-sbk-celectfeed-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_jmx_policy]
[2021-03-01T00:01:37,228][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-aggnode-supply-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:37,354][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-auditor-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:37,514][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sourcing-optimizer-cc-consumer-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:37,642][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-sourcing-optimizer-hz-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:37,777][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--capacity-change-events-consumer-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:37,901][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index-ability-integrator-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:38,027][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [index--availability-cc-consumer-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:38,159][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-demand-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:38,285][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-price-cost-updates-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:01:38,419][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [metrics-micrometer-sbk-location-bb-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [metrics_micrometer_policy]
[2021-03-01T00:02:32,165][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [.watcher-history-10-2021.03.01/utDh6TUNTNGeKCYiTwuxhg] update_mapping [_doc]
[2021-03-01T00:04:53,824][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24] from [{"phase":"warm","action":"complete","name":"complete"}] to [{"phase":"cold","action":"set_priority","name":"set_priority"}] in policy [cc_topic_policy]
[2021-03-01T00:04:54,298][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [.watcher-history-10-2021.02.22] from [{"phase":"delete","action":"delete","name":"wait-for-shard-history-leases"}] to [{"phase":"delete","action":"delete","name":"delete"}] in policy [watch-history-ilm-policy]
[2021-03-01T00:04:54,468][INFO ][o.e.c.m.MetaDataDeleteIndexService] [node-0] [.watcher-history-10-2021.02.22/oorTEMIURGiSCvg4jYYs3A] deleting index
[2021-03-01T00:04:54,785][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24] from [{"phase":"cold","action":"set_priority","name":"set_priority"}] to [{"phase":"cold","action":"freeze","name":"freeze"}] in policy [cc_topic_policy]
[2021-03-01T00:04:54,922][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] closing indices [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24/AaAUH5r1RzelQwhg9zLM7A]
[2021-03-01T00:04:55,138][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] completed closing of indices [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24]
[2021-03-01T00:04:55,596][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24][0]]]).
[2021-03-01T00:04:55,887][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] opening indices [[cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24/AaAUH5r1RzelQwhg9zLM7A]]
[2021-03-01T00:04:56,374][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24][0]]]).
[2021-03-01T00:04:56,516][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24] from [{"phase":"cold","action":"freeze","name":"freeze"}] to [{"phase":"cold","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:04:56,980][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.24][0]]]).
[2021-03-01T00:10:50,116][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metricbeat-old-mirrormaker-2021.03.01/IpC_mBo0QjKMVu2woGoi1g] update_mapping [_doc]
[2021-03-01T00:13:10,590][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15450601] overhead, spent [283ms] collecting in the last [1s]
[2021-03-01T00:17:40,920][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15450871] overhead, spent [255ms] collecting in the last [1s]
[2021-03-01T00:30:40,407][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15451649] overhead, spent [305ms] collecting in the last [1s]
[2021-03-01T00:34:54,292][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.27] from [{"phase":"hot","action":"complete","name":"complete"}] to [{"phase":"warm","action":"set_priority","name":"set_priority"}] in policy [cc_topic_policy]
[2021-03-01T00:34:54,997][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.02.27] from [{"phase":"warm","action":"set_priority","name":"set_priority"}] to [{"phase":"warm","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:37:10,846][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15452039] overhead, spent [323ms] collecting in the last [1s]
[2021-03-01T00:38:23,329][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.03.01] creating index, cause [auto(bulk api)], templates [cc-topic-sbk-impl-warehouse-supply-us-dlq, sbk-dlq, cc_topic], shards [1]/[1], mappings [_doc]
[2021-03-01T00:38:23,820][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.03.01] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:38:24,099][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.03.01/2jgBPXkDRNe5xpZ1mwpHDg] update_mapping [_doc]
[2021-03-01T00:38:24,786][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.03.01] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [cc_topic_policy]
[2021-03-01T00:38:24,973][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.03.01][0]]]).
[2021-03-01T00:38:25,520][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.03.01] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T00:45:41,505][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15452549] overhead, spent [337ms] collecting in the last [1s]
[2021-03-01T00:51:42,996][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [cc-topic-sbk-impl-warehouse-supply-us-dlq-2021.03.01/2jgBPXkDRNe5xpZ1mwpHDg] update_mapping [_doc]
[2021-03-01T00:55:10,432][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15453117] overhead, spent [404ms] collecting in the last [1.1s]
[2021-03-01T01:00:00,002][INFO ][o.e.x.m.e.l.LocalExporter] [node-0] cleaning up [1] old indices
[2021-03-01T01:00:00,006][INFO ][o.e.c.m.MetaDataDeleteIndexService] [node-0] [.monitoring-kibana-7-2021.02.22/x1DA8PiARCW8VSvpPA7c7A] deleting index
[2021-03-01T01:07:50,607][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15453876] overhead, spent [273ms] collecting in the last [1s]
[2021-03-01T01:24:54,247][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-master-product-us-dlq-2021.02.24] from [{"phase":"warm","action":"complete","name":"complete"}] to [{"phase":"cold","action":"set_priority","name":"set_priority"}] in policy [cc_topic_policy]
[2021-03-01T01:24:54,884][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-master-product-us-dlq-2021.02.24] from [{"phase":"cold","action":"set_priority","name":"set_priority"}] to [{"phase":"cold","action":"freeze","name":"freeze"}] in policy [cc_topic_policy]
[2021-03-01T01:24:55,055][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] closing indices [cc-topic-sbk-master-product-us-dlq-2021.02.24/ypPnsNu_SMO2PGOxWl6MKA]
[2021-03-01T01:24:55,265][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] completed closing of indices [cc-topic-sbk-master-product-us-dlq-2021.02.24]
[2021-03-01T01:24:55,730][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[cc-topic-sbk-master-product-us-dlq-2021.02.24][0]]]).
[2021-03-01T01:24:56,037][INFO ][o.e.c.m.MetaDataIndexStateService] [node-0] opening indices [[cc-topic-sbk-master-product-us-dlq-2021.02.24/ypPnsNu_SMO2PGOxWl6MKA]]
[2021-03-01T01:24:56,852][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[cc-topic-sbk-master-product-us-dlq-2021.02.24][0]]]).
[2021-03-01T01:24:57,082][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [cc-topic-sbk-master-product-us-dlq-2021.02.24] from [{"phase":"cold","action":"freeze","name":"freeze"}] to [{"phase":"cold","action":"complete","name":"complete"}] in policy [cc_topic_policy]
[2021-03-01T01:24:57,549][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[cc-topic-sbk-master-product-us-dlq-2021.02.24][0]]]).
[2021-03-01T01:25:50,489][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-cassandra-000023/7WcortvsQ12O5xo9N3oR7Q] update_mapping [_doc]
[2021-03-01T01:28:40,308][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15455124] overhead, spent [442ms] collecting in the last [1.1s]
[2021-03-01T01:30:00,001][INFO ][o.e.x.s.SnapshotRetentionTask] [node-0] starting SLM retention snapshot cleanup task
[2021-03-01T01:40:40,990][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15455844] overhead, spent [274ms] collecting in the last [1s]
[2021-03-01T01:51:50,884][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15456513] overhead, spent [264ms] collecting in the last [1s]
[2021-03-01T01:52:00,001][INFO ][o.e.x.m.MlDailyMaintenanceService] [node-0] triggering scheduled [ML] maintenance tasks
[2021-03-01T01:52:00,001][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] [node-0] Deleting expired data
[2021-03-01T01:52:00,086][INFO ][o.e.x.m.a.TransportDeleteExpiredDataAction] [node-0] Completed deletion of expired ML data
[2021-03-01T01:52:00,087][INFO ][o.e.x.m.MlDailyMaintenanceService] [node-0] Successfully completed [ML] maintenance tasks
[2021-03-01T02:04:51,295][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15457292] overhead, spent [276ms] collecting in the last [1s]
[2021-03-01T02:11:50,807][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15457711] overhead, spent [265ms] collecting in the last [1s]
[2021-03-01T02:13:20,954][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15457801] overhead, spent [297ms] collecting in the last [1s]
[2021-03-01T02:24:40,876][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15458480] overhead, spent [260ms] collecting in the last [1s]
[2021-03-01T02:34:54,197][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000046] from [{"phase":"hot","action":"complete","name":"complete"}] to [{"phase":"warm","action":"set_priority","name":"set_priority"}] in policy [logging_small_size]
[2021-03-01T02:34:54,816][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000046] from [{"phase":"warm","action":"set_priority","name":"set_priority"}] to [{"phase":"warm","action":"allocate","name":"allocate"}] in policy [logging_small_size]
[2021-03-01T02:34:54,956][INFO ][o.e.c.m.MetaDataUpdateSettingsService] [node-0] updating number_of_replicas to [1] for indices [logging-sbk-availability-hz-app-000046]
[2021-03-01T02:34:55,291][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000046] from [{"phase":"warm","action":"allocate","name":"allocate"}] to [{"phase":"warm","action":"allocate","name":"check-allocation"}] in policy [logging_small_size]
[2021-03-01T02:34:55,435][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000046] from [{"phase":"warm","action":"allocate","name":"check-allocation"}] to [{"phase":"warm","action":"complete","name":"complete"}] in policy [logging_small_size]
[2021-03-01T02:41:40,436][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15459498] overhead, spent [284ms] collecting in the last [1s]
[2021-03-01T02:45:20,677][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15459718] overhead, spent [390ms] collecting in the last [1s]
[2021-03-01T02:49:42,971][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15459980] overhead, spent [250ms] collecting in the last [1s]
[2021-03-01T02:54:54,621][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000005] from [{"phase":"cold","action":"complete","name":"complete"}] to [{"phase":"delete","action":"delete","name":"wait-for-shard-history-leases"}] in policy [logging_small_size]
[2021-03-01T02:57:50,505][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15460467] overhead, spent [271ms] collecting in the last [1s]
[2021-03-01T03:01:05,105][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-cassandra-000023/7WcortvsQ12O5xo9N3oR7Q] update_mapping [_doc]
[2021-03-01T03:01:34,960][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-cassandra-000023/7WcortvsQ12O5xo9N3oR7Q] update_mapping [_doc]
[2021-03-01T03:02:20,130][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-cassandra-000023/7WcortvsQ12O5xo9N3oR7Q] update_mapping [_doc]
[2021-03-01T03:02:34,897][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-cassandra-000023/7WcortvsQ12O5xo9N3oR7Q] update_mapping [_doc]
[2021-03-01T03:04:54,517][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000005] from [{"phase":"delete","action":"delete","name":"wait-for-shard-history-leases"}] to [{"phase":"delete","action":"delete","name":"delete"}] in policy [logging_small_size]
[2021-03-01T03:04:54,783][INFO ][o.e.c.m.MetaDataDeleteIndexService] [node-0] [logging-sbk-availability-hz-app-000005/373GBlJJSaelTpl01LyO_g] deleting index
[2021-03-01T03:07:05,716][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-cassandra-000023/7WcortvsQ12O5xo9N3oR7Q] update_mapping [_doc]
[2021-03-01T03:08:19,901][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [metrics-jmx-cassandra-000023/7WcortvsQ12O5xo9N3oR7Q] update_mapping [_doc]
[2021-03-01T03:20:20,910][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15461816] overhead, spent [349ms] collecting in the last [1s]
[2021-03-01T03:26:20,846][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15462175] overhead, spent [252ms] collecting in the last [1s]
[2021-03-01T03:30:41,004][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15462435] overhead, spent [260ms] collecting in the last [1s]
[2021-03-01T03:34:20,257][INFO ][o.e.m.j.JvmGcMonitorService] [node-0] [gc][15462654] overhead, spent [274ms] collecting in the last [1s]
[2021-03-01T03:54:54,091][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000050] from [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] to [{"phase":"hot","action":"rollover","name":"attempt-rollover"}] in policy [logging_small_size]
[2021-03-01T03:54:54,766][INFO ][o.e.c.m.MetaDataCreateIndexService] [node-0] [logging-sbk-availability-hz-app-000051] creating index, cause [rollover_index], templates [logging-sbk-availability-hz-app], shards [1]/[1], mappings [_doc]
[2021-03-01T03:54:55,314][INFO ][o.e.c.m.MetaDataMappingService] [node-0] [logging-sbk-availability-hz-app-000051/53G11MYZTXmM5cfNCuhbjw] update_mapping [_doc]
[2021-03-01T03:54:55,570][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [logging_small_size]
[2021-03-01T03:54:55,696][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000050] from [{"phase":"hot","action":"rollover","name":"attempt-rollover"}] to [{"phase":"hot","action":"rollover","name":"update-rollover-lifecycle-date"}] in policy [logging_small_size]
[2021-03-01T03:54:56,092][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"set_priority","name":"set_priority"}] in policy [logging_small_size]
[2021-03-01T03:54:56,520][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000050] from [{"phase":"hot","action":"rollover","name":"update-rollover-lifecycle-date"}] to [{"phase":"hot","action":"rollover","name":"set-indexing-complete"}] in policy [logging_small_size]
[2021-03-01T03:54:56,705][INFO ][o.e.c.r.a.AllocationService] [node-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logging-sbk-availability-hz-app-000051][0]]]).
[2021-03-01T03:54:57,109][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"set_priority","name":"set_priority"}] to [{"phase":"hot","action":"unfollow","name":"wait-for-indexing-complete"}] in policy [logging_small_size]
[2021-03-01T03:54:57,313][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000050] from [{"phase":"hot","action":"rollover","name":"set-indexing-complete"}] to [{"phase":"hot","action":"complete","name":"complete"}] in policy [logging_small_size]
[2021-03-01T03:54:57,467][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"unfollow","name":"wait-for-indexing-complete"}] to [{"phase":"hot","action":"unfollow","name":"wait-for-follow-shard-tasks"}] in policy [logging_small_size]
[2021-03-01T04:04:54,001][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"unfollow","name":"wait-for-follow-shard-tasks"}] to [{"phase":"hot","action":"unfollow","name":"pause-follower-index"}] in policy [logging_small_size]
[2021-03-01T04:04:54,144][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"unfollow","name":"pause-follower-index"}] to [{"phase":"hot","action":"unfollow","name":"close-follower-index"}] in policy [logging_small_size]
[2021-03-01T04:04:54,277][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"unfollow","name":"close-follower-index"}] to [{"phase":"hot","action":"unfollow","name":"unfollow-follower-index"}] in policy [logging_small_size]
[2021-03-01T04:04:54,404][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"unfollow","name":"unfollow-follower-index"}] to [{"phase":"hot","action":"unfollow","name":"open-follower-index"}] in policy [logging_small_size]
[2021-03-01T04:04:54,575][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"unfollow","name":"open-follower-index"}] to [{"phase":"hot","action":"unfollow","name":"wait-for-yellow-step"}] in policy [logging_small_size]
[2021-03-01T04:04:54,704][INFO ][o.e.x.i.IndexLifecycleTransition] [node-0] moving index [logging-sbk-availability-hz-app-000051] from [{"phase":"hot","action":"unfollow","name":"wait-for-yellow-step"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [logging_small_size]
@sushanth45
Copy link
Author

Cluster Info:

10 Node cluster with 5 master/data and 5 only data nodes.
Size of each node: 16vCPU, 60GB MEM, 500GB SSD
{
"cluster_name" : "xxxx",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 10,
"number_of_data_nodes" : 10,
"active_primary_shards" : 1585,
"active_shards" : 3170,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : 100.0
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment