Skip to content

Instantly share code, notes, and snippets.

@SravanTurbo
Created October 14, 2016 12:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save SravanTurbo/fd5222750d733ee0ab88aa90aad80d10 to your computer and use it in GitHub Desktop.
Save SravanTurbo/fd5222750d733ee0ab88aa90aad80d10 to your computer and use it in GitHub Desktop.
snippet of log file for elasticsearch
[2016-10-14 16:14:08,736][WARN ][transport ] [arlmselk02_M!D!] Transport response handler not found of id [392538]
[2016-10-14 16:14:08,740][WARN ][monitor.jvm ] [arlmselk02_M!D!] [gc][old][67284][32] duration [30s], collections [1]/[30.1s], total [30s]/[13.8m], memory [7.9gb]->[7.9gb]/[7.9gb], all_pools {[young] [266.2mb]->[266.2mb]/[266.2mb]}{[survivor] [30.9mb]->[32.6mb]/[33.2mb]}{[old] [7.6gb]->[7.6gb]/[7.6gb]}
[2016-10-14 16:14:51,912][WARN ][transport ] [arlmselk02_M!D!] Transport response handler not found of id [392547]
[2016-10-14 16:15:22,077][WARN ][transport ] [arlmselk02_M!D!] Transport response handler not found of id [392532]
[2016-10-14 16:15:22,077][WARN ][transport ] [arlmselk02_M!D!] Transport response handler not found of id [392539]
[2016-10-14 16:15:51,794][WARN ][transport ] [arlmselk02_M!D!] Received response for a request that has timed out, sent [71197ms] ago, timed out [30355ms] ago, action [cluster:monitor/nodes/stats[n]], node [{arlmselk06_M$D$}{dbO25mC-SEq0zTAz8qC_2g}{192.168.xxx.xxx}{192.168.xxx.xxx:9300}], id [392528]
[2016-10-14 16:16:53,484][WARN ][transport ] [arlmselk02_M!D!] Transport response handler not found of id [392350]
[2016-10-14 16:16:53,485][WARN ][transport ] [arlmselk02_M!D!] Transport response handler not found of id [392533]
[2016-10-14 16:18:31,514][ERROR][watcher.input.http ] [arlmselk02_M!D!] failed to execute [http] input for [org.elasticsearch.watcher.watch.Watch@5efed351]
ElasticsearchTimeoutException[failed to execute http request. timeout expired]; nested: SocketTimeoutException[Read timed out];
at org.elasticsearch.watcher.support.http.HttpClient.execute(HttpClient.java:128)
at org.elasticsearch.watcher.input.http.ExecutableHttpInput.doExecute(ExecutableHttpInput.java:66)
at org.elasticsearch.watcher.input.http.ExecutableHttpInput.execute(ExecutableHttpInput.java:58)
at org.elasticsearch.watcher.input.http.ExecutableHttpInput.execute(ExecutableHttpInput.java:42)
at org.elasticsearch.watcher.execution.ExecutionService.executeInner(ExecutionService.java:357)
at org.elasticsearch.watcher.execution.ExecutionService.execute(ExecutionService.java:273)
at org.elasticsearch.watcher.execution.ExecutionService$WatchExecutionTask.run(ExecutionService.java:438)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:704)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1536)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
at org.elasticsearch.watcher.support.http.HttpClient.doExecute(HttpClient.java:205)
at org.elasticsearch.watcher.support.http.HttpClient.execute(HttpClient.java:126)
... 9 more
[2016-10-14 16:18:31,519][WARN ][monitor.jvm ] [arlmselk02_M!D!] [gc][old][67285][38] duration [3.3m], collections [6]/[3.3m], total [3.3m]/[17.1m], memory [7.9gb]->[7.9gb]/[7.9gb], all_pools {[young] [266.2mb]->[266.2mb]/[266.2mb]}{[survivor] [32.6mb]->[33.2mb]/[33.2mb]}{[old] [7.6gb]->[7.6gb]/[7.6gb]}
[2016-10-14 16:21:14,061][ERROR][watcher.execution ] [arlmselk02_M!D!] failed to update watch record [cluster_health_watch_229-2016-10-14T10:44:51.903Z]
ElasticsearchTimeoutException[Timeout waiting for task.]
at org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:70)
at org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:62)
at org.elasticsearch.watcher.support.init.proxy.ClientProxy.index(ClientProxy.java:86)
at org.elasticsearch.watcher.history.HistoryStore.put(HistoryStore.java:93)
at org.elasticsearch.watcher.execution.ExecutionService.execute(ExecutionService.java:302)
at org.elasticsearch.watcher.execution.ExecutionService$WatchExecutionTask.run(ExecutionService.java:438)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-10-14 16:20:43,156][WARN ][transport ] [arlmselk02_M!D!] Transport response handler not found of id [392549]
[2016-10-14 16:33:18,596][DEBUG][action.admin.indices.stats] [arlmselk02_M!D!] [indices:monitor/stats] failed to execute operation for shard [[viruslog][0], node[3EaM-8ijRayGauHwPcxBpw], [P], v[131], s[STARTED], a[id=c9A_cYKwTBqPAA5H-ZeL0Q]]
java.lang.OutOfMemoryError: Java heap space
at sun.nio.fs.UnixPath.resolve(UnixPath.java:405)
at sun.nio.fs.UnixDirectoryStream$UnixDirectoryIterator.readNextEntry(UnixDirectoryStream.java:185)
at sun.nio.fs.UnixDirectoryStream$UnixDirectoryIterator.hasNext(UnixDirectoryStream.java:201)
at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:192)
at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:203)
at org.elasticsearch.index.store.FsDirectoryService$1.listAll(FsDirectoryService.java:127)
at org.apache.lucene.store.FilterDirectory.listAll(FilterDirectory.java:57)
at org.apache.lucene.store.FilterDirectory.listAll(FilterDirectory.java:57)
at org.elasticsearch.index.store.Store$StoreStatsCache.estimateSize(Store.java:1538)
at org.elasticsearch.index.store.Store$StoreStatsCache.refresh(Store.java:1530)
at org.elasticsearch.index.store.Store$StoreStatsCache.refresh(Store.java:1517)
at org.elasticsearch.common.util.SingleObjectCache.getOrRefresh(SingleObjectCache.java:55)
at org.elasticsearch.index.store.Store.stats(Store.java:293)
at org.elasticsearch.index.shard.IndexShard.storeStats(IndexShard.java:702)
at org.elasticsearch.action.admin.indices.stats.CommonStats.<init>(CommonStats.java:134)
at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.shardOperation(TransportIndicesStatsAction.java:165)
at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.shardOperation(TransportIndicesStatsAction.java:47)
at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$BroadcastByNodeTransportRequestHandler.onShardOperation(TransportBroadcastByNodeAction.java:436)
at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$BroadcastByNodeTransportRequestHandler.messageReceived(TransportBroadcastByNodeAction.java:415)
at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$BroadcastByNodeTransportRequestHandler.messageReceived(TransportBroadcastByNodeAction.java:402)
at org.elasticsearch.transport.TransportRequestHandler.messageReceived(TransportRequestHandler.java:33)
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:77)
at org.elasticsearch.transport.TransportService$4.doRun(TransportService.java:376)
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment