Skip to content

Instantly share code, notes, and snippets.

@enguzekli

enguzekli/Exceptions from DS1 Log files

Created July 4, 2012 07:53
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save enguzekli/3045973 to your computer and use it in GitHub Desktop.
Save enguzekli/3045973 to your computer and use it in GitHub Desktop.
Download ZIP
DS Failure
Raw
Exceptions from DS1 Log files
[2012-07-03 11:35:57,621][INFO ][node ] [Xandu_71f67394-f394-4f56-bf3a-de677bb8099b] {0.19.0}[16798]: stopping ...
[2012-07-03 11:35:58,939][DEBUG][action.search.type ] [Xandu_71f67394-f394-4f56-bf3a-de677bb8099b] [226577095] Failed to execute fetch phase
org.elasticsearch.search.SearchContextMissingException: No search context found for id [226577095]
at org.elasticsearch.search.SearchService.findContext(SearchService.java:451)
at org.elasticsearch.search.SearchService.executeFetchPhase(SearchService.java:424)
at org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteFetch(SearchServiceTransportAction.java:344)
at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.executeFetch(TransportSearchQueryThenFetchAction.java:149)
at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$2.run(TransportSearchQueryThenFetchAction.java:136)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
[2012-07-03 11:35:58,942][WARN ][search.action ] [Xandu_71f67394-f394-4f56-bf3a-de677bb8099b] Failed to send release search context
org.elasticsearch.transport.SendRequestTransportException: [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a][inet[/172.27.30.215:9300]][search/freeContext]
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:200)
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:172)
at org.elasticsearch.search.action.SearchServiceTransportAction.sendFreeContext(SearchServiceTransportAction.java:99)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.releaseIrrelevantSearchContexts(TransportSearchTypeAction.java:341)
at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.finishHim(TransportSearchQueryThenFetchAction.java:183)
at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.moveToSecondPhase(TransportSearchQueryThenFetchAction.java:95)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.onFirstPhaseResult(TransportSearchTypeAction.java:228)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$3.onResult(TransportSearchTypeAction.java:207)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$3.onResult(TransportSearchTypeAction.java:204)
at org.elasticsearch.search.action.SearchServiceTransportAction$2.handleResponse(SearchServiceTransportAction.java:155)
at org.elasticsearch.search.action.SearchServiceTransportAction$2.handleResponse(SearchServiceTransportAction.java:146)
at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:262)
at org.elasticsearch.transport.netty.MessageChannelHandler.process(MessageChannelHandler.java:233)
at org.elasticsearch.transport.netty.MessageChannelHandler.callDecode(MessageChannelHandler.java:141)
at org.elasticsearch.transport.netty.MessageChannelHandler.cleanup(MessageChannelHandler.java:178)
at org.elasticsearch.transport.netty.MessageChannelHandler.channelDisconnected(MessageChannelHandler.java:111)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:107)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:558)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:553)
at org.elasticsearch.common.netty.channel.Channels.fireChannelDisconnected(Channels.java:354)
at org.elasticsearch.common.netty.channel.socket.oio.OioWorker.close(OioWorker.java:221)
at org.elasticsearch.common.netty.channel.socket.oio.OioClientSocketPipelineSink.eventSunk(OioClientSocketPipelineSink.java:54)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:568)
at org.elasticsearch.common.netty.channel.Channels.close(Channels.java:714)
at org.elasticsearch.common.netty.channel.AbstractChannel.close(AbstractChannel.java:194)
at org.elasticsearch.transport.netty.NettyTransport$NodeChannels.closeChannelsAndWait(NettyTransport.java:710)
at org.elasticsearch.transport.netty.NettyTransport$NodeChannels.close(NettyTransport.java:699)
at org.elasticsearch.transport.netty.NettyTransport$5.run(NettyTransport.java:325)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: org.elasticsearch.transport.NodeNotConnectedException: [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a][inet[/172.27.30.215:9300]] Node not connected
at org.elasticsearch.transport.netty.NettyTransport.nodeChannel(NettyTransport.java:639)
at org.elasticsearch.transport.netty.NettyTransport.sendRequest(NettyTransport.java:447)
at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:185)
... 30 more
Raw
Exceptions from DS2 Log files
[2012-07-03 11:35:59,205][WARN ][transport.netty ] [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a] Exception caught on netty layer [[id: 0x3e0bbd1b, /172.27.30.214:54842 => /172.27.30.215:9300]]
java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:96)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.getBytes(HeapChannelBuffer.java:111)
at org.elasticsearch.common.netty.buffer.TruncatedChannelBuffer.getBytes(TruncatedChannelBuffer.java:182)
at org.elasticsearch.common.netty.channel.socket.oio.OioWorker.write(OioWorker.java:148)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.handleAcceptedSocket(OioServerSocketPipelineSink.java:118)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.eventSunk(OioServerSocketPipelineSink.java:56)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:568)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:605)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:572)
at org.elasticsearch.common.netty.channel.AbstractChannel.write(AbstractChannel.java:245)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:79)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:68)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:498)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:486)
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:374)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
[2012-07-03 11:35:59,242][WARN ][transport.netty ] [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a] Exception caught on netty layer [[id: 0x24e72f0c, /172.27.30.214:54845 => /172.27.30.215:9300]]
java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:96)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.getBytes(HeapChannelBuffer.java:111)
at org.elasticsearch.common.netty.buffer.TruncatedChannelBuffer.getBytes(TruncatedChannelBuffer.java:182)
at org.elasticsearch.common.netty.channel.socket.oio.OioWorker.write(OioWorker.java:148)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.handleAcceptedSocket(OioServerSocketPipelineSink.java:118)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.eventSunk(OioServerSocketPipelineSink.java:56)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:568)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:605)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:572)
at org.elasticsearch.common.netty.channel.AbstractChannel.write(AbstractChannel.java:245)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:79)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:68)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:498)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:486)
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:374)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
[2012-07-03 11:35:59,239][WARN ][transport.netty ] [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a] Exception caught on netty layer [[id: 0x343d511e, /172.27.30.214:54844 => /172.27.30.215:9300]]
java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:96)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.getBytes(HeapChannelBuffer.java:111)
at org.elasticsearch.common.netty.buffer.TruncatedChannelBuffer.getBytes(TruncatedChannelBuffer.java:182)
at org.elasticsearch.common.netty.channel.socket.oio.OioWorker.write(OioWorker.java:148)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.handleAcceptedSocket(OioServerSocketPipelineSink.java:118)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.eventSunk(OioServerSocketPipelineSink.java:56)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:568)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:605)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:572)
at org.elasticsearch.common.netty.channel.AbstractChannel.write(AbstractChannel.java:245)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:79)
at org.elasticsearch.common.netty.channel.AbstractChannel.write(AbstractChannel.java:245)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:79)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:68)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:498)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:486)
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:374)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
[2012-07-03 11:35:59,237][WARN ][transport.netty ] [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a] Exception caught on netty layer [[id: 0x6cd9ceea, /172.27.30.214:54843 => /172.27.30.215:9300]]
java.net.SocketException: Connection reset
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:96)
at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.getBytes(HeapChannelBuffer.java:111)
at org.elasticsearch.common.netty.buffer.TruncatedChannelBuffer.getBytes(TruncatedChannelBuffer.java:182)
at org.elasticsearch.common.netty.channel.socket.oio.OioWorker.write(OioWorker.java:148)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.handleAcceptedSocket(OioServerSocketPipelineSink.java:118)
at org.elasticsearch.common.netty.channel.socket.oio.OioServerSocketPipelineSink.eventSunk(OioServerSocketPipelineSink.java:56)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:568)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:605)
at org.elasticsearch.common.netty.channel.Channels.write(Channels.java:572)
at org.elasticsearch.common.netty.channel.AbstractChannel.write(AbstractChannel.java:245)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:79)
at org.elasticsearch.transport.netty.NettyTransportChannel.sendResponse(NettyTransportChannel.java:68)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:498)
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:486)
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:374)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
[2012-07-03 11:35:59,713][INFO ][discovery.zen ] [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a] master_left [[Xandu_71f67394-f394-4f56-bf3a-de677bb8099b][dpIszqtZTaGXtWeAOi2Ywg][inet[/172.27.30.214:9300]]], reason [transport disconnected (with verified connect)]
[2012-07-03 11:36:11,122][WARN ][transport.netty ] [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a] Exception caught on netty layer [[id: 0x3e0bbd1b, /172.27.30.214:54842 => /172.27.30.215:9300]]
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:113)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at org.elasticsearch.common.netty.channel.socket.oio.OioWorker.run(OioWorker.java:78)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:102)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
[2012-07-03 11:36:13,687][WARN ][transport.netty ] [Comet_a87ee4a4-ef1e-46b8-b894-5adbd4350e7a] Exception caught on netty layer [[id: 0x6cd9ceea, /172.27.30.214:54843 => /172.27.30.215:9300]]
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:113)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at org.elasticsearch.common.netty.channel.socket.oio.OioWorker.run(OioWorker.java:78)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:102)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment