Skip to content

Instantly share code, notes, and snippets.

@aggarwalShivani
Last active January 27, 2020 13:11
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save aggarwalShivani/e49e3d359f06f6ec5e9a9e10067819db to your computer and use it in GitHub Desktop.
Save aggarwalShivani/e49e3d359f06f6ec5e9a9e10067819db to your computer and use it in GitHub Desktop.
GET _nodes/hot_threads?threads=9999
::: {elk-efkc-elk-elasticsearch-client-bb4d97bb6-jwc5w}{-8XzX0otTyCG_FYvVAz4RA}{5hipEe5VQjKMQkHL3Pxvzw}{192.168.1.236}{192.168.1.236:9300}
Hot threads at 2020-01-27T12:05:02.995Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
::: {elk-efkc-elk-elasticsearch-master-1}{8f3-acKSToaGASYhUNiGPQ}{ceuMSvw9RXGF3ErPooJmvA}{192.168.1.240}{192.168.1.240:9300}
Hot threads at 2020-01-27T12:05:03.020Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-1][generic][T#2]'
10/10 snapshots sharing following 20 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
app//org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:252)
app//org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:87)
app//org.elasticsearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:57)
app//org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:34)
app//org.elasticsearch.transport.ConnectionManager.internalOpenConnection(ConnectionManager.java:209)
app//org.elasticsearch.transport.ConnectionManager.connectToNode(ConnectionManager.java:104)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:344)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:331)
app//org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:153)
app//org.elasticsearch.cluster.NodeConnectionsService$ConnectionChecker.doRun(NodeConnectionsService.java:180)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-1][generic][T#5]'
10/10 snapshots sharing following 32 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:209)
app//org.elasticsearch.gateway.MetaStateService.writeIndex(MetaStateService.java:224)
app//org.elasticsearch.gateway.GatewayMetaState$AtomicClusterStateWriter.writeIndex(GatewayMetaState.java:306)
app//org.elasticsearch.gateway.GatewayMetaState$WriteChangedIndexMetaData.execute(GatewayMetaState.java:619)
app//org.elasticsearch.gateway.GatewayMetaState.writeIndicesMetadata(GatewayMetaState.java:381)
app//org.elasticsearch.gateway.GatewayMetaState.updateClusterState(GatewayMetaState.java:355)
app//org.elasticsearch.gateway.GatewayMetaState.setLastAcceptedState(GatewayMetaState.java:253)
app//org.elasticsearch.cluster.coordination.CoordinationState.handlePublishRequest(CoordinationState.java:349)
app//org.elasticsearch.cluster.coordination.Coordinator.handlePublishRequest(Coordinator.java:317)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1598/0x00000001007c5440.apply(Unknown Source)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler.handleIncomingPublishRequest(PublicationTransportHandler.java:430)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler.lambda$new$0(PublicationTransportHandler.java:94)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$$Lambda$1601/0x00000001007c7040.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
::: {elk-efkc-elk-elasticsearch-client-bb4d97bb6-sqv9p}{CuZhnVzBReanmYP4xb4J1g}{0Uf2NpwLThixvcRh3T2cpw}{192.168.1.161}{192.168.1.161:9300}
Hot threads at 2020-01-27T12:05:02.952Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.2% (1ms out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-client-bb4d97bb6-sqv9p][generic][T#1]'
10/10 snapshots sharing following 20 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
app//org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:252)
app//org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:87)
app//org.elasticsearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:57)
app//org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:34)
app//org.elasticsearch.transport.ConnectionManager.internalOpenConnection(ConnectionManager.java:209)
app//org.elasticsearch.transport.ConnectionManager.connectToNode(ConnectionManager.java:104)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:344)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:331)
app//org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:153)
app//org.elasticsearch.cluster.NodeConnectionsService$ConnectionChecker.doRun(NodeConnectionsService.java:180)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
::: {elk-efkc-elk-elasticsearch-data-2}{v92yWY-KSSmEGxWNvAQxZw}{lNOHSUogTZqwlLTz4ufURw}{192.168.1.245}{192.168.1.245:9300}
Hot threads at 2020-01-27T12:05:03.016Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.0% (123.2micros out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][[paas-log-2020.01.27][0]: Lucene Merge Thread #183]'
10/10 snapshots sharing following 24 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
app//org.apache.lucene.index.MergePolicy$OneMergeProgress.pauseNanos(MergePolicy.java:156)
app//org.apache.lucene.index.MergeRateLimiter.maybePause(MergeRateLimiter.java:148)
app//org.apache.lucene.index.MergeRateLimiter.pause(MergeRateLimiter.java:93)
app//org.apache.lucene.store.RateLimitedIndexOutput.checkRate(RateLimitedIndexOutput.java:78)
app//org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:72)
app//org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
app//org.apache.lucene.store.ByteBuffersDataOutput.copyTo(ByteBuffersDataOutput.java:286)
app//org.apache.lucene.codecs.lucene80.Lucene80DocValuesConsumer.writeBlock(Lucene80DocValuesConsumer.java:352)
app//org.apache.lucene.codecs.lucene80.Lucene80DocValuesConsumer.writeValuesMultipleBlocks(Lucene80DocValuesConsumer.java:307)
app//org.apache.lucene.codecs.lucene80.Lucene80DocValuesConsumer.writeValues(Lucene80DocValuesConsumer.java:269)
app//org.apache.lucene.codecs.lucene80.Lucene80DocValuesConsumer.addNumericField(Lucene80DocValuesConsumer.java:111)
app//org.apache.lucene.codecs.DocValuesConsumer.mergeNumericField(DocValuesConsumer.java:175)
app//org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:135)
app//org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsWriter.merge(PerFieldDocValuesFormat.java:152)
app//org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:195)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:150)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4459)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#15]'
10/10 snapshots sharing following 20 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
app//org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:252)
app//org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:87)
app//org.elasticsearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:57)
app//org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:34)
app//org.elasticsearch.transport.ConnectionManager.internalOpenConnection(ConnectionManager.java:209)
app//org.elasticsearch.transport.ConnectionManager.connectToNode(ConnectionManager.java:104)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:344)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:331)
app//org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:153)
app//org.elasticsearch.cluster.NodeConnectionsService$ConnectionChecker.doRun(NodeConnectionsService.java:180)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][[son-edennet-log-2020.01.27][0]: Lucene Merge Thread #213]'
10/10 snapshots sharing following 31 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
java.base@11.0.4/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
java.base@11.0.4/sun.nio.ch.IOUtil.write(IOUtil.java:79)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
java.base@11.0.4/java.nio.channels.Channels.writeFullyImpl(Channels.java:74)
java.base@11.0.4/java.nio.channels.Channels.writeFully(Channels.java:97)
java.base@11.0.4/java.nio.channels.Channels$1.write(Channels.java:172)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:417)
java.base@11.0.4/java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:74)
java.base@11.0.4/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
java.base@11.0.4/java.io.BufferedOutputStream.write(BufferedOutputStream.java:95)
app//org.apache.lucene.store.OutputStreamIndexOutput.writeByte(OutputStreamIndexOutput.java:47)
app//org.elasticsearch.common.lucene.store.FilterIndexOutput.writeByte(FilterIndexOutput.java:54)
app//org.elasticsearch.index.store.ByteSizeCachingDirectory$2.writeByte(ByteSizeCachingDirectory.java:154)
app//org.apache.lucene.store.RateLimitedIndexOutput.writeByte(RateLimitedIndexOutput.java:66)
app//org.apache.lucene.store.DataOutput.writeVInt(DataOutput.java:191)
app//org.apache.lucene.codecs.lucene50.ForUtil.writeBlock(ForUtil.java:160)
app//org.apache.lucene.codecs.lucene50.Lucene50PostingsWriter.addPosition(Lucene50PostingsWriter.java:315)
app//org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:163)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865)
app//org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344)
app//org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
app//org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:169)
app//org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:244)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:139)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4459)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#4]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:233)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][[paas-log-2020.01.27][0]: Lucene Merge Thread #188]'
10/10 snapshots sharing following 24 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
java.base@11.0.4/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
java.base@11.0.4/sun.nio.ch.IOUtil.write(IOUtil.java:79)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
java.base@11.0.4/java.nio.channels.Channels.writeFullyImpl(Channels.java:74)
java.base@11.0.4/java.nio.channels.Channels.writeFully(Channels.java:97)
java.base@11.0.4/java.nio.channels.Channels$1.write(Channels.java:172)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:417)
java.base@11.0.4/java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:74)
java.base@11.0.4/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
java.base@11.0.4/java.io.BufferedOutputStream.write(BufferedOutputStream.java:127)
app//org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(OutputStreamIndexOutput.java:53)
app//org.elasticsearch.common.lucene.store.FilterIndexOutput.writeBytes(FilterIndexOutput.java:59)
app//org.apache.lucene.store.RateLimitedIndexOutput.writeBytes(RateLimitedIndexOutput.java:73)
app//org.apache.lucene.store.DataOutput.copyBytes(DataOutput.java:278)
app//org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.merge(CompressingStoredFieldsWriter.java:619)
app//org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:228)
app//org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105)
app//org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4459)
app//org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4054)
app//org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:625)
app//org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:101)
app//org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:662)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#10]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#20]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#21]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][flush][T#1]'
10/10 snapshots sharing following 17 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.flush(InternalEngine.java:1715)
app//org.elasticsearch.index.shard.IndexShard.flush(IndexShard.java:1070)
app//org.elasticsearch.index.shard.IndexShard$6.doRun(IndexShard.java:2856)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][management][T#1]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2432/0x0000000800af7840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][management][T#3]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2432/0x0000000800af7840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#5]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#2]'
10/10 snapshots sharing following 16 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#7]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:959)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1675)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][refresh][T#1]'
10/10 snapshots sharing following 34 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
app//org.apache.lucene.index.DocumentsWriterFlushControl.markForFullFlush(DocumentsWriterFlushControl.java:508)
app//org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:708)
app//org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:494)
app//org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:294)
app//org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:269)
app//org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:259)
app//org.apache.lucene.index.FilterDirectoryReader.doOpenIfChanged(FilterDirectoryReader.java:112)
app//org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:140)
app//org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:156)
app//org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:58)
app//org.apache.lucene.search.ReferenceManager.doMaybeRefresh(ReferenceManager.java:176)
app//org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:253)
app//org.elasticsearch.index.engine.InternalEngine$ExternalSearcherManager.refreshIfNeeded(InternalEngine.java:322)
app//org.elasticsearch.index.engine.InternalEngine$ExternalSearcherManager.refreshIfNeeded(InternalEngine.java:297)
app//org.apache.lucene.search.ReferenceManager.doMaybeRefresh(ReferenceManager.java:176)
app//org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:253)
app//org.elasticsearch.index.engine.InternalEngine.refresh(InternalEngine.java:1553)
app//org.elasticsearch.index.engine.InternalEngine.refresh(InternalEngine.java:1534)
app//org.elasticsearch.index.shard.IndexShard.refresh(IndexShard.java:919)
app//org.elasticsearch.index.shard.IndexShard.scheduledRefresh(IndexShard.java:2954)
app//org.elasticsearch.index.IndexService.maybeRefreshEngine(IndexService.java:759)
app//org.elasticsearch.index.IndexService.access$200(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncRefreshTask.runInternal(IndexService.java:886)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][write][T#1]'
10/10 snapshots sharing following 75 elements
java.base@11.0.4/java.io.UnixFileSystem.canonicalize0(Native Method)
java.base@11.0.4/java.io.UnixFileSystem.canonicalize(UnixFileSystem.java:178)
java.base@11.0.4/java.io.File.getCanonicalPath(File.java:618)
java.base@11.0.4/java.io.FilePermission$2.run(FilePermission.java:390)
java.base@11.0.4/java.io.FilePermission$2.run(FilePermission.java:378)
java.base@11.0.4/java.security.AccessController.doPrivileged(Native Method)
java.base@11.0.4/java.io.FilePermission.init(FilePermission.java:378)
java.base@11.0.4/java.io.FilePermission.<init>(FilePermission.java:477)
java.base@11.0.4/java.lang.SecurityManager.checkWrite(SecurityManager.java:752)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:257)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:74)
app//org.elasticsearch.index.store.ByteSizeCachingDirectory.createOutput(ByteSizeCachingDirectory.java:130)
app//org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:74)
app//org.apache.lucene.store.LockValidatingDirectoryWrapper.createOutput(LockValidatingDirectoryWrapper.java:44)
app//org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
app//org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:112)
app//org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128)
app//org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183)
app//org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39)
app//org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46)
app//org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:366)
app//org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:402)
app//org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:251)
app//org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:494)
app//org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594)
app//org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1213)
app//org.elasticsearch.index.engine.InternalEngine.addDocs(InternalEngine.java:1092)
app//org.elasticsearch.index.engine.InternalEngine.indexIntoLucene(InternalEngine.java:1037)
app//org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:864)
app//org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:789)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:762)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:719)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.lambda$executeIndexRequestOnPrimary$3(TransportShardBulkAction.java:452)
app//org.elasticsearch.action.bulk.TransportShardBulkAction$$Lambda$2438/0x0000000800af6040.get(Unknown Source)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeOnPrimaryWhileHandlingMappingUpdates(TransportShardBulkAction.java:475)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeIndexRequestOnPrimary(TransportShardBulkAction.java:450)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:218)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:161)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:153)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:141)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:79)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2432/0x0000000800af7840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][write][T#2]'
10/10 snapshots sharing following 42 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.add(Translog.java:534)
app//org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:872)
app//org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:789)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:762)
app//org.elasticsearch.index.shard.IndexShard.applyIndexOperationOnReplica(IndexShard.java:726)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOpOnReplica(TransportShardBulkAction.java:416)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnReplica(TransportShardBulkAction.java:386)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnReplica(TransportShardBulkAction.java:373)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnReplica(TransportShardBulkAction.java:79)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncReplicaAction.onResponse(TransportReplicationAction.java:619)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncReplicaAction.onResponse(TransportReplicationAction.java:579)
app//org.elasticsearch.index.shard.IndexShard$4.onResponse(IndexShard.java:2713)
app//org.elasticsearch.index.shard.IndexShard$4.onResponse(IndexShard.java:2691)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.lambda$acquireReplicaOperationPermit$17(IndexShard.java:2651)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$2232/0x0000000800a2a440.accept(Unknown Source)
app//org.elasticsearch.index.shard.IndexShard.innerAcquireReplicaOperationPermit(IndexShard.java:2758)
app//org.elasticsearch.index.shard.IndexShard.acquireReplicaOperationPermit(IndexShard.java:2650)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquireReplicaOperationPermit(TransportReplicationAction.java:983)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncReplicaAction.doRun(TransportReplicationAction.java:689)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicaOperationTransportHandler.messageReceived(TransportReplicationAction.java:562)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicaOperationTransportHandler.messageReceived(TransportReplicationAction.java:547)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][management][T#4]'
10/10 snapshots sharing following 39 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2432/0x0000000800af7840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][management][T#5]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2432/0x0000000800af7840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#16]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:233)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#11]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][clusterApplierService#updateTask][T#1]'
10/10 snapshots sharing following 27 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.gateway.MetaStateService.writeManifestAndCleanup(MetaStateService.java:204)
app//org.elasticsearch.gateway.GatewayMetaState$AtomicClusterStateWriter.writeManifestAndCleanup(GatewayMetaState.java:318)
app//org.elasticsearch.gateway.GatewayMetaState.writeManifest(GatewayMetaState.java:365)
app//org.elasticsearch.gateway.GatewayMetaState.updateClusterState(GatewayMetaState.java:357)
app//org.elasticsearch.gateway.GatewayMetaState.applyClusterState(GatewayMetaState.java:214)
app//org.elasticsearch.cluster.service.ClusterApplierService.lambda$callClusterStateAppliers$5(ClusterApplierService.java:478)
app//org.elasticsearch.cluster.service.ClusterApplierService$$Lambda$2041/0x00000008009b1840.accept(Unknown Source)
java.base@11.0.4/java.lang.Iterable.forEach(Iterable.java:75)
app//org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateAppliers(ClusterApplierService.java:476)
app//org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:459)
app//org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:413)
app//org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:164)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#22]'
10/10 snapshots sharing following 22 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
java.base@11.0.4/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
java.base@11.0.4/sun.nio.ch.IOUtil.write(IOUtil.java:79)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:187)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:172)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:230)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][management][T#2]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2432/0x0000000800af7840.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-2][generic][T#8]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
::: {elk-efkc-elk-elasticsearch-master-0}{h_e92FXAQ_CGpcJ5NlMxYw}{UCYWyiwgS169NoNCCuXEGw}{192.168.1.176}{192.168.1.176:9300}
Hot threads at 2020-01-27T12:05:02.954Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.0% (42.3micros out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#639]'
10/10 snapshots sharing following 11 elements
app//org.elasticsearch.cluster.coordination.Coordinator$6.onResponse(Coordinator.java:1069)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:280)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:271)
com.floragunn.searchguard.transport.SearchGuardInterceptor$RestoringTransportResponseHandler.handleResponse(SearchGuardInterceptor.java:259)
app//org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1114)
app//org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:975)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#657]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#662]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#663]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#664]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#661]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#660]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#667]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#668]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][masterService#updateTask][T#1]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
app//org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:252)
app//org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:87)
app//org.elasticsearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:57)
app//org.elasticsearch.cluster.service.MasterService.publish(MasterService.java:256)
app//org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:238)
app//org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:142)
app//org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150)
app//org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#669]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#685]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#670]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#671]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#672]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#692]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#673]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#674]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#675]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#666]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#659]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#678]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#706]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#679]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#680]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#681]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#682]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#722]'
10/10 snapshots sharing following 7 elements
app//org.elasticsearch.cluster.coordination.Coordinator.removeNode(Coordinator.java:212)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1613/0x00000001007d8c40.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.FollowersChecker$FollowerChecker$2.run(FollowersChecker.java:384)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#683]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][management][T#1]'
10/10 snapshots sharing following 14 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1079)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1369)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:278)
app//org.elasticsearch.cluster.InternalClusterInfoService.refresh(InternalClusterInfoService.java:344)
app//org.elasticsearch.cluster.InternalClusterInfoService.maybeRefresh(InternalClusterInfoService.java:269)
app//org.elasticsearch.cluster.InternalClusterInfoService.access$200(InternalClusterInfoService.java:65)
app//org.elasticsearch.cluster.InternalClusterInfoService$SubmitReschedulingClusterInfoUpdatedJob.lambda$run$0(InternalClusterInfoService.java:220)
app//org.elasticsearch.cluster.InternalClusterInfoService$SubmitReschedulingClusterInfoUpdatedJob$$Lambda$2360/0x0000000100a73c40.run(Unknown Source)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#684]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#731]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#686]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#687]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#688]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#689]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#690]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#691]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#665]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#693]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#694]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#695]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#696]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#697]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#698]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#699]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#700]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#701]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#705]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#704]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#677]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#703]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#702]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#707]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#708]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#709]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#710]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#711]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#712]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#713]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#714]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#715]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#716]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#717]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#718]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#720]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#719]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#721]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#676]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#723]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#724]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#725]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#726]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#727]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#728]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#658]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#732]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#656]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#734]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][management][T#3]'
10/10 snapshots sharing following 14 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1079)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1369)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:278)
app//org.elasticsearch.cluster.InternalClusterInfoService.refresh(InternalClusterInfoService.java:344)
app//org.elasticsearch.cluster.InternalClusterInfoService.maybeRefresh(InternalClusterInfoService.java:269)
app//org.elasticsearch.cluster.InternalClusterInfoService.access$200(InternalClusterInfoService.java:65)
app//org.elasticsearch.cluster.InternalClusterInfoService$SubmitReschedulingClusterInfoUpdatedJob.lambda$run$0(InternalClusterInfoService.java:220)
app//org.elasticsearch.cluster.InternalClusterInfoService$SubmitReschedulingClusterInfoUpdatedJob$$Lambda$2360/0x0000000100a73c40.run(Unknown Source)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#636]'
10/10 snapshots sharing following 11 elements
app//org.elasticsearch.cluster.coordination.Coordinator$6.onResponse(Coordinator.java:1069)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:280)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:271)
com.floragunn.searchguard.transport.SearchGuardInterceptor$RestoringTransportResponseHandler.handleResponse(SearchGuardInterceptor.java:259)
app//org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1114)
app//org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:975)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#638]'
10/10 snapshots sharing following 24 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:209)
app//org.elasticsearch.gateway.MetaStateService.writeIndex(MetaStateService.java:224)
app//org.elasticsearch.gateway.GatewayMetaState$AtomicClusterStateWriter.writeIndex(GatewayMetaState.java:306)
app//org.elasticsearch.gateway.GatewayMetaState$WriteChangedIndexMetaData.execute(GatewayMetaState.java:619)
app//org.elasticsearch.gateway.GatewayMetaState.writeIndicesMetadata(GatewayMetaState.java:381)
app//org.elasticsearch.gateway.GatewayMetaState.updateClusterState(GatewayMetaState.java:355)
app//org.elasticsearch.gateway.GatewayMetaState.setLastAcceptedState(GatewayMetaState.java:253)
app//org.elasticsearch.cluster.coordination.CoordinationState.handlePublishRequest(CoordinationState.java:349)
app//org.elasticsearch.cluster.coordination.Coordinator.handlePublishRequest(Coordinator.java:317)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1598/0x00000001007cf840.apply(Unknown Source)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$2$1.doRun(PublicationTransportHandler.java:199)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#655]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#641]'
10/10 snapshots sharing following 11 elements
app//org.elasticsearch.cluster.coordination.Coordinator$6.onResponse(Coordinator.java:1069)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:280)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:271)
com.floragunn.searchguard.transport.SearchGuardInterceptor$RestoringTransportResponseHandler.handleResponse(SearchGuardInterceptor.java:259)
app//org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1114)
app//org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:975)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#654]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#642]'
10/10 snapshots sharing following 11 elements
app//org.elasticsearch.cluster.coordination.Coordinator$6.onResponse(Coordinator.java:1069)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:280)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$3.handleResponse(PublicationTransportHandler.java:271)
com.floragunn.searchguard.transport.SearchGuardInterceptor$RestoringTransportResponseHandler.handleResponse(SearchGuardInterceptor.java:259)
app//org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1114)
app//org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:975)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#643]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#644]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#645]'
10/10 snapshots sharing following 5 elements
app//org.elasticsearch.cluster.coordination.Coordinator$CoordinatorPublication$2.run(Coordinator.java:1257)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#646]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#647]'
10/10 snapshots sharing following 12 elements
app//org.elasticsearch.cluster.coordination.Coordinator.removeNode(Coordinator.java:212)
app//org.elasticsearch.cluster.coordination.Coordinator.lambda$new$0(Coordinator.java:183)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1627/0x00000001007dc440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.LagDetector$NodeAppliedStateTracker.checkForLag(LagDetector.java:166)
app//org.elasticsearch.cluster.coordination.LagDetector$1.lambda$run$0(LagDetector.java:104)
app//org.elasticsearch.cluster.coordination.LagDetector$1$$Lambda$2380/0x0000000100a95440.accept(Unknown Source)
java.base@11.0.4/java.util.ArrayList.forEach(ArrayList.java:1540)
app//org.elasticsearch.cluster.coordination.LagDetector$1.run(LagDetector.java:104)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#648]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#649]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#650]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#651]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#652]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-0][generic][T#653]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.getStateForMasterService(Coordinator.java:976)
app//org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:465)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1573/0x00000001007c6440.accept(Unknown Source)
app//org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:124)
app//org.elasticsearch.cluster.coordination.JoinHelper$$Lambda$1576/0x00000001007c7440.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
::: {elk-efkc-elk-elasticsearch-data-1}{Rp37corbT6GfpBU5cjhX5w}{RSKRuwiGTlSkk2VnRtqcEQ}{192.168.1.246}{192.168.1.246:9300}
Hot threads at 2020-01-27T12:05:02.996Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#3]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:959)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1675)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#9]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#2]'
10/10 snapshots sharing following 22 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
java.base@11.0.4/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
java.base@11.0.4/sun.nio.ch.IOUtil.write(IOUtil.java:79)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:187)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:172)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:230)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][management][T#1]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2387/0x0000000800adb440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][management][T#3]'
10/10 snapshots sharing following 39 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2387/0x0000000800adb440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][management][T#4]'
10/10 snapshots sharing following 39 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2387/0x0000000800adb440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#8]'
10/10 snapshots sharing following 16 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][management][T#5]'
10/10 snapshots sharing following 39 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2387/0x0000000800adb440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#13]'
10/10 snapshots sharing following 22 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
java.base@11.0.4/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
java.base@11.0.4/sun.nio.ch.IOUtil.write(IOUtil.java:79)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:187)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:172)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:230)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][clusterApplierService#updateTask][T#1]'
10/10 snapshots sharing following 27 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.gateway.MetaStateService.writeManifestAndCleanup(MetaStateService.java:204)
app//org.elasticsearch.gateway.GatewayMetaState$AtomicClusterStateWriter.writeManifestAndCleanup(GatewayMetaState.java:318)
app//org.elasticsearch.gateway.GatewayMetaState.writeManifest(GatewayMetaState.java:365)
app//org.elasticsearch.gateway.GatewayMetaState.updateClusterState(GatewayMetaState.java:357)
app//org.elasticsearch.gateway.GatewayMetaState.applyClusterState(GatewayMetaState.java:214)
app//org.elasticsearch.cluster.service.ClusterApplierService.lambda$callClusterStateAppliers$5(ClusterApplierService.java:478)
app//org.elasticsearch.cluster.service.ClusterApplierService$$Lambda$2051/0x00000008009ac840.accept(Unknown Source)
java.base@11.0.4/java.lang.Iterable.forEach(Iterable.java:75)
app//org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateAppliers(ClusterApplierService.java:476)
app//org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:459)
app//org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:413)
app//org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:164)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#10]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:959)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1675)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#4]'
10/10 snapshots sharing following 22 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
java.base@11.0.4/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
java.base@11.0.4/sun.nio.ch.IOUtil.write(IOUtil.java:79)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:187)
app//org.elasticsearch.common.io.Channels.writeToChannel(Channels.java:172)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:230)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#1]'
10/10 snapshots sharing following 16 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][write][T#1]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:797)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:818)
app//org.elasticsearch.index.engine.InternalEngine.ensureTranslogSynced(InternalEngine.java:489)
app//org.elasticsearch.index.shard.IndexShard$5.write(IndexShard.java:2782)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.processList(AsyncIOProcessor.java:107)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.drainAndProcess(AsyncIOProcessor.java:99)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.put(AsyncIOProcessor.java:82)
app//org.elasticsearch.index.shard.IndexShard.sync(IndexShard.java:2804)
app//org.elasticsearch.action.support.replication.TransportWriteAction$AsyncAfterWriteAction.run(TransportWriteAction.java:355)
app//org.elasticsearch.action.support.replication.TransportWriteAction$WritePrimaryResult.<init>(TransportWriteAction.java:151)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:165)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:153)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:141)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:79)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2387/0x0000000800adb440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][write][T#2]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:797)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:818)
app//org.elasticsearch.index.engine.InternalEngine.ensureTranslogSynced(InternalEngine.java:489)
app//org.elasticsearch.index.shard.IndexShard$5.write(IndexShard.java:2782)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.processList(AsyncIOProcessor.java:107)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.drainAndProcess(AsyncIOProcessor.java:99)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.put(AsyncIOProcessor.java:82)
app//org.elasticsearch.index.shard.IndexShard.sync(IndexShard.java:2804)
app//org.elasticsearch.action.support.replication.TransportWriteAction$AsyncAfterWriteAction.run(TransportWriteAction.java:355)
app//org.elasticsearch.action.support.replication.TransportWriteAction$WritePrimaryResult.<init>(TransportWriteAction.java:151)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:165)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:153)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:141)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:79)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2387/0x0000000800adb440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#14]'
10/10 snapshots sharing following 16 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#17]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:233)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][management][T#2]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2387/0x0000000800adb440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][flush][T#1]'
10/10 snapshots sharing following 30 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.Files.newByteChannel(Files.java:370)
java.base@11.0.4/java.nio.file.Files.createFile(Files.java:647)
java.base@11.0.4/java.nio.file.TempFileHelper.create(TempFileHelper.java:137)
java.base@11.0.4/java.nio.file.TempFileHelper.createTempFile(TempFileHelper.java:160)
java.base@11.0.4/java.nio.file.Files.createTempFile(Files.java:867)
app//org.elasticsearch.index.translog.Translog.copyCheckpointTo(Translog.java:276)
app//org.elasticsearch.index.translog.Translog.rollGeneration(Translog.java:1658)
app//org.elasticsearch.index.engine.InternalEngine.flush(InternalEngine.java:1709)
app//org.elasticsearch.index.shard.IndexShard.flush(IndexShard.java:1070)
app//org.elasticsearch.indices.flush.SyncedFlushService.performPreSyncedFlush(SyncedFlushService.java:508)
app//org.elasticsearch.indices.flush.SyncedFlushService.access$500(SyncedFlushService.java:75)
app//org.elasticsearch.indices.flush.SyncedFlushService$PreSyncedFlushTransportHandler.messageReceived(SyncedFlushService.java:815)
app//org.elasticsearch.indices.flush.SyncedFlushService$PreSyncedFlushTransportHandler.messageReceived(SyncedFlushService.java:811)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-1][generic][T#11]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:959)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1675)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
::: {elk-efkc-elk-elasticsearch-data-0}{Jjn_EqfPT2WeoAVIQhgorA}{eL6Z7BCrRNWUP395vxHpEg}{192.168.1.244}{192.168.1.244:9300}
Hot threads at 2020-01-27T12:05:02.951Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#14]'
10/10 snapshots sharing following 31 elements
java.base@11.0.4/java.io.UnixFileSystem.canonicalize0(Native Method)
java.base@11.0.4/java.io.UnixFileSystem.canonicalize(UnixFileSystem.java:178)
java.base@11.0.4/java.io.File.getCanonicalPath(File.java:618)
java.base@11.0.4/java.io.FilePermission$2.run(FilePermission.java:390)
java.base@11.0.4/java.io.FilePermission$2.run(FilePermission.java:378)
java.base@11.0.4/java.security.AccessController.doPrivileged(Native Method)
java.base@11.0.4/java.io.FilePermission.init(FilePermission.java:378)
java.base@11.0.4/java.io.FilePermission.<init>(FilePermission.java:477)
java.base@11.0.4/java.lang.SecurityManager.checkWrite(SecurityManager.java:752)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:257)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
java.base@11.0.4/java.nio.channels.FileChannel.open(FileChannel.java:292)
java.base@11.0.4/java.nio.channels.FileChannel.open(FileChannel.java:345)
app//org.elasticsearch.index.translog.Translog$$Lambda$2163/0x0000000800a0f840.open(Unknown Source)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:229)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#10]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#1]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:233)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][clusterApplierService#updateTask][T#1]'
10/10 snapshots sharing following 16 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.cluster.NodeConnectionsService.connectToNodes(NodeConnectionsService.java:118)
app//org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:449)
app//org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:413)
app//org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:164)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252)
app//org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#4]'
10/10 snapshots sharing following 31 elements
java.base@11.0.4/java.io.UnixFileSystem.canonicalize0(Native Method)
java.base@11.0.4/java.io.UnixFileSystem.canonicalize(UnixFileSystem.java:178)
java.base@11.0.4/java.io.File.getCanonicalPath(File.java:618)
java.base@11.0.4/java.io.FilePermission$2.run(FilePermission.java:390)
java.base@11.0.4/java.io.FilePermission$2.run(FilePermission.java:378)
java.base@11.0.4/java.security.AccessController.doPrivileged(Native Method)
java.base@11.0.4/java.io.FilePermission.init(FilePermission.java:378)
java.base@11.0.4/java.io.FilePermission.<init>(FilePermission.java:477)
java.base@11.0.4/java.lang.SecurityManager.checkWrite(SecurityManager.java:752)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:257)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
java.base@11.0.4/java.nio.channels.FileChannel.open(FileChannel.java:292)
java.base@11.0.4/java.nio.channels.FileChannel.open(FileChannel.java:345)
app//org.elasticsearch.index.translog.Translog$$Lambda$2163/0x0000000800a0f840.open(Unknown Source)
app//org.elasticsearch.index.translog.Checkpoint.write(Checkpoint.java:229)
app//org.elasticsearch.index.translog.TranslogWriter.writeCheckpoint(TranslogWriter.java:403)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:361)
app//org.elasticsearch.index.translog.TranslogWriter.sync(TranslogWriter.java:254)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1702)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][management][T#4]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2223/0x0000000800a34440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][management][T#1]'
10/10 snapshots sharing following 42 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.apache.lucene.store.FSDirectory.privateDeleteFile(FSDirectory.java:371)
app//org.apache.lucene.store.FSDirectory.deleteFile(FSDirectory.java:340)
app//org.elasticsearch.gateway.MetaDataStateFormat.deleteFileIfExists(MetaDataStateFormat.java:88)
app//org.elasticsearch.gateway.MetaDataStateFormat.deleteFileIgnoreExceptions(MetaDataStateFormat.java:97)
app//org.elasticsearch.gateway.MetaDataStateFormat.cleanupOldFiles(MetaDataStateFormat.java:331)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:260)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2223/0x0000000800a34440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][management][T#5]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2223/0x0000000800a34440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][management][T#2]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2223/0x0000000800a34440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][management][T#3]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.open(UnixNativeDispatcher.java:71)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.open(UnixChannelFactory.java:267)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:143)
java.base@11.0.4/sun.nio.fs.UnixChannelFactory.newFileChannel(UnixChannelFactory.java:156)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:213)
java.base@11.0.4/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)
java.base@11.0.4/java.nio.file.Files.newOutputStream(Files.java:219)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411)
app//org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407)
app//org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:107)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.index.seqno.ReplicationTracker.persistRetentionLeases(ReplicationTracker.java:357)
app//org.elasticsearch.index.shard.IndexShard.persistRetentionLeases(IndexShard.java:2035)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:136)
app//org.elasticsearch.index.seqno.RetentionLeaseBackgroundSyncAction.shardOperationOnPrimary(RetentionLeaseBackgroundSyncAction.java:58)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2223/0x0000000800a34440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][refresh][T#1]'
10/10 snapshots sharing following 26 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:1009)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1324)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:738)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.getLastWriteLocation(Translog.java:574)
app//org.elasticsearch.index.engine.InternalEngine.getTranslogLastWriteLocation(InternalEngine.java:532)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$2178/0x0000000800a0c440.get(Unknown Source)
app//org.elasticsearch.index.shard.RefreshListeners.beforeRefresh(RefreshListeners.java:206)
app//org.apache.lucene.search.ReferenceManager.notifyRefreshListenersBefore(ReferenceManager.java:279)
app//org.apache.lucene.search.ReferenceManager.doMaybeRefresh(ReferenceManager.java:175)
app//org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:253)
app//org.elasticsearch.index.engine.InternalEngine.refresh(InternalEngine.java:1553)
app//org.elasticsearch.index.engine.InternalEngine.refresh(InternalEngine.java:1534)
app//org.elasticsearch.index.shard.IndexShard.refresh(IndexShard.java:919)
app//org.elasticsearch.index.shard.IndexShard.scheduledRefresh(IndexShard.java:2954)
app//org.elasticsearch.index.IndexService.maybeRefreshEngine(IndexService.java:759)
app//org.elasticsearch.index.IndexService.access$200(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncRefreshTask.runInternal(IndexService.java:886)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][flush][T#1]'
10/10 snapshots sharing following 17 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:959)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.rollGeneration(Translog.java:1653)
app//org.elasticsearch.index.engine.InternalEngine.rollTranslogGeneration(InternalEngine.java:1771)
app//org.elasticsearch.index.shard.IndexShard.rollTranslogGeneration(IndexShard.java:1090)
app//org.elasticsearch.index.shard.IndexShard.access$700(IndexShard.java:175)
app//org.elasticsearch.index.shard.IndexShard$7.doRun(IndexShard.java:2879)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#6]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:959)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1675)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#7]'
10/10 snapshots sharing following 18 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:917)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1240)
java.base@11.0.4/java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:959)
app//org.elasticsearch.common.util.concurrent.ReleasableLock.acquire(ReleasableLock.java:55)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1675)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][write][T#1]'
10/10 snapshots sharing following 44 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:797)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:818)
app//org.elasticsearch.index.engine.InternalEngine.ensureTranslogSynced(InternalEngine.java:489)
app//org.elasticsearch.index.shard.IndexShard$5.write(IndexShard.java:2782)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.processList(AsyncIOProcessor.java:107)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.drainAndProcess(AsyncIOProcessor.java:99)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.put(AsyncIOProcessor.java:82)
app//org.elasticsearch.index.shard.IndexShard.sync(IndexShard.java:2804)
app//org.elasticsearch.action.support.replication.TransportWriteAction$AsyncAfterWriteAction.run(TransportWriteAction.java:355)
app//org.elasticsearch.action.support.replication.TransportWriteAction$WritePrimaryResult.<init>(TransportWriteAction.java:151)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:165)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:153)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:141)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:79)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1033)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryShardReference.perform(TransportReplicationAction.java:1011)
app//org.elasticsearch.action.support.replication.ReplicationOperation.execute(ReplicationOperation.java:104)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.runWithPrimaryShardReference(TransportReplicationAction.java:413)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$doRun$0(TransportReplicationAction.java:359)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction$$Lambda$2223/0x0000000800a34440.accept(Unknown Source)
app//org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.acquirePrimaryOperationPermit(IndexShard.java:2513)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquirePrimaryOperationPermit(TransportReplicationAction.java:970)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.doRun(TransportReplicationAction.java:358)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:313)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:305)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:139)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:86)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TransportService$7.doRun(TransportService.java:693)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][write][T#2]'
10/10 snapshots sharing following 42 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.elasticsearch.index.translog.TranslogWriter.syncUpTo(TranslogWriter.java:360)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:797)
app//org.elasticsearch.index.translog.Translog.ensureSynced(Translog.java:818)
app//org.elasticsearch.index.engine.InternalEngine.ensureTranslogSynced(InternalEngine.java:489)
app//org.elasticsearch.index.shard.IndexShard$5.write(IndexShard.java:2782)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.processList(AsyncIOProcessor.java:107)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.drainAndProcess(AsyncIOProcessor.java:99)
app//org.elasticsearch.common.util.concurrent.AsyncIOProcessor.put(AsyncIOProcessor.java:82)
app//org.elasticsearch.index.shard.IndexShard.sync(IndexShard.java:2804)
app//org.elasticsearch.action.support.replication.TransportWriteAction$AsyncAfterWriteAction.run(TransportWriteAction.java:355)
app//org.elasticsearch.action.support.replication.TransportWriteAction$WriteReplicaResult.<init>(TransportWriteAction.java:204)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnReplica(TransportShardBulkAction.java:374)
app//org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnReplica(TransportShardBulkAction.java:79)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncReplicaAction.onResponse(TransportReplicationAction.java:619)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncReplicaAction.onResponse(TransportReplicationAction.java:579)
app//org.elasticsearch.index.shard.IndexShard$4.onResponse(IndexShard.java:2713)
app//org.elasticsearch.index.shard.IndexShard$4.onResponse(IndexShard.java:2691)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:269)
app//org.elasticsearch.index.shard.IndexShardOperationPermits.acquire(IndexShardOperationPermits.java:236)
app//org.elasticsearch.index.shard.IndexShard.lambda$acquireReplicaOperationPermit$17(IndexShard.java:2651)
app//org.elasticsearch.index.shard.IndexShard$$Lambda$2476/0x0000000800b05440.accept(Unknown Source)
app//org.elasticsearch.index.shard.IndexShard.innerAcquireReplicaOperationPermit(IndexShard.java:2758)
app//org.elasticsearch.index.shard.IndexShard.acquireReplicaOperationPermit(IndexShard.java:2650)
app//org.elasticsearch.action.support.replication.TransportReplicationAction.acquireReplicaOperationPermit(TransportReplicationAction.java:983)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$AsyncReplicaAction.doRun(TransportReplicationAction.java:689)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicaOperationTransportHandler.messageReceived(TransportReplicationAction.java:562)
app//org.elasticsearch.action.support.replication.TransportReplicationAction$ReplicaOperationTransportHandler.messageReceived(TransportReplicationAction.java:547)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#13]'
10/10 snapshots sharing following 20 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
app//org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:252)
app//org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:87)
app//org.elasticsearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:57)
app//org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:34)
app//org.elasticsearch.transport.ConnectionManager.internalOpenConnection(ConnectionManager.java:209)
app//org.elasticsearch.transport.ConnectionManager.connectToNode(ConnectionManager.java:104)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:344)
app//org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:331)
app//org.elasticsearch.cluster.NodeConnectionsService.validateAndConnectIfNeeded(NodeConnectionsService.java:153)
app//org.elasticsearch.cluster.NodeConnectionsService$ConnectionChecker.doRun(NodeConnectionsService.java:180)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-data-0][generic][T#8]'
10/10 snapshots sharing following 19 elements
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink0(Native Method)
java.base@11.0.4/sun.nio.fs.UnixNativeDispatcher.unlink(UnixNativeDispatcher.java:146)
java.base@11.0.4/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:232)
java.base@11.0.4/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
java.base@11.0.4/java.nio.file.Files.delete(Files.java:1141)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:172)
app//org.elasticsearch.core.internal.io.IOUtils.deleteFilesIgnoringExceptions(IOUtils.java:159)
app//org.elasticsearch.index.translog.Translog.deleteReaderFiles(Translog.java:1718)
app//org.elasticsearch.index.translog.Translog.trimUnreferencedReaders(Translog.java:1703)
app//org.elasticsearch.index.engine.InternalEngine.trimUnreferencedTranslogFiles(InternalEngine.java:1790)
app//org.elasticsearch.index.shard.IndexShard.trimTranslog(IndexShard.java:1082)
app//org.elasticsearch.index.IndexService.maybeTrimTranslog(IndexService.java:777)
app//org.elasticsearch.index.IndexService.access$600(IndexService.java:99)
app//org.elasticsearch.index.IndexService$AsyncTrimTranslogTask.runInternal(IndexService.java:909)
app//org.elasticsearch.common.util.concurrent.AbstractAsyncTask.run(AbstractAsyncTask.java:141)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
::: {elk-efkc-elk-elasticsearch-master-2}{7W9VN4L1Q-aqFPlx9DZ2hw}{XNg4ajakSUKm2fPey23crg}{192.168.1.241}{192.168.1.241:9300}
Hot threads at 2020-01-27T12:05:02.958Z, interval=500ms, busiestThreads=9999, ignoreIdleThreads=true:
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-2][generic][T#5]'
10/10 snapshots sharing following 31 elements
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force0(Native Method)
java.base@11.0.4/sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:82)
java.base@11.0.4/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:461)
app//org.apache.lucene.util.IOUtils.fsync(IOUtils.java:461)
app//org.apache.lucene.store.FSDirectory.fsync(FSDirectory.java:332)
app//org.apache.lucene.store.FSDirectory.sync(FSDirectory.java:287)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeStateToFirstLocation(MetaDataStateFormat.java:124)
app//org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:243)
app//org.elasticsearch.gateway.MetaDataStateFormat.writeAndCleanup(MetaDataStateFormat.java:185)
app//org.elasticsearch.gateway.MetaStateService.writeManifestAndCleanup(MetaStateService.java:204)
app//org.elasticsearch.gateway.GatewayMetaState$AtomicClusterStateWriter.writeManifestAndCleanup(GatewayMetaState.java:318)
app//org.elasticsearch.gateway.GatewayMetaState.writeManifest(GatewayMetaState.java:365)
app//org.elasticsearch.gateway.GatewayMetaState.updateClusterState(GatewayMetaState.java:357)
app//org.elasticsearch.gateway.GatewayMetaState.setLastAcceptedState(GatewayMetaState.java:253)
app//org.elasticsearch.cluster.coordination.CoordinationState.handlePublishRequest(CoordinationState.java:349)
app//org.elasticsearch.cluster.coordination.Coordinator.handlePublishRequest(Coordinator.java:317)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1598/0x00000001007d5440.apply(Unknown Source)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler.handleIncomingPublishRequest(PublicationTransportHandler.java:430)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler.lambda$new$0(PublicationTransportHandler.java:94)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$$Lambda$1601/0x00000001007d7040.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'Common-Cleaner'
10/10 snapshots sharing following 5 elements
java.base@11.0.4/java.lang.Object.wait(Native Method)
java.base@11.0.4/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
java.base@11.0.4/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
java.base@11.0.4/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/7.0.1]'
10/10 snapshots sharing following 8 elements
java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
java.base@11.0.4/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
app//org.elasticsearch.bootstrap.Bootstrap$1.run(Bootstrap.java:80)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-2][generic][T#2]'
10/10 snapshots sharing following 16 elements
app//org.elasticsearch.cluster.coordination.Coordinator.handlePublishRequest(Coordinator.java:282)
app//org.elasticsearch.cluster.coordination.Coordinator$$Lambda$1598/0x00000001007d5440.apply(Unknown Source)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler.handleIncomingPublishRequest(PublicationTransportHandler.java:406)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler.lambda$new$0(PublicationTransportHandler.java:94)
app//org.elasticsearch.cluster.coordination.PublicationTransportHandler$$Lambda$1601/0x00000001007d7040.messageReceived(Unknown Source)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceivedDecorate(SearchGuardSSLRequestHandler.java:164)
com.floragunn.searchguard.transport.SearchGuardRequestHandler.messageReceivedDecorate(SearchGuardRequestHandler.java:260)
com.floragunn.searchguard.ssl.transport.SearchGuardSSLRequestHandler.messageReceived(SearchGuardSSLRequestHandler.java:136)
com.floragunn.searchguard.SearchGuardPlugin$7$1.messageReceived(SearchGuardPlugin.java:619)
app//org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:63)
app//org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1077)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751)
app//org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[elk-efkc-elk-elasticsearch-master-2][generic][T#3]'
10/10 snapshots sharing following 5 elements
app//org.elasticsearch.cluster.coordination.Coordinator$1.run(Coordinator.java:199)
app//org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
unique snapshot
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment