Skip to content

Instantly share code, notes, and snippets.

Created June 14, 2011 22:14
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save anonymous/1026062 to your computer and use it in GitHub Desktop.
Save anonymous/1026062 to your computer and use it in GitHub Desktop.
Thread when ScheduledConnectNodeSampler.run is stuck
2011-06-14 22:18:00
Full thread dump Java HotSpot(TM) 64-Bit Server VM (17.1-b03 mixed mode):
"Attach Listener" daemon prio=10 tid=0x000000004ea0f000 nid=0x7a97 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"elasticsearch[cached]-pool-1-thread-80" daemon prio=10 tid=0x000000004ea00800 nid=0x7167 waiting for monitor entry [0x00002abaeb73b000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-79" daemon prio=10 tid=0x000000004eccd800 nid=0x7164 waiting for monitor entry [0x00002abaeb63a000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-78" daemon prio=10 tid=0x000000004f0bf800 nid=0x7163 waiting on condition [0x00002abaeb539000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002abab1d9ac30> (a org.elasticsearch.common.util.concurrent.AbstractFuture$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281)
at org.elasticsearch.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:249)
at org.elasticsearch.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:78)
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:45)
at org.elasticsearch.transport.PlainTransportFuture.txGet(PlainTransportFuture.java:35)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:176)
- locked <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-77" daemon prio=10 tid=0x000000004ea1a000 nid=0x7162 waiting for monitor entry [0x00002abae8b0f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-76" daemon prio=10 tid=0x000000004ea19000 nid=0x7161 waiting for monitor entry [0x00002abaeb236000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-75" daemon prio=10 tid=0x000000004ea17000 nid=0x7140 waiting for monitor entry [0x00002abaeb135000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-74" daemon prio=10 tid=0x000000004ede7000 nid=0x7007 waiting for monitor entry [0x00002abadfc0c000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-73" daemon prio=10 tid=0x000000004ede8800 nid=0x6d01 waiting for monitor entry [0x00002abaeb438000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[cached]-pool-1-thread-70" daemon prio=10 tid=0x000000004ecd1000 nid=0x6ad9 waiting for monitor entry [0x00002abaeb337000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler.run(TransportClientNodesService.java:162)
- waiting to lock <0x00002aba9ce49610> (a org.elasticsearch.client.transport.TransportClientNodesService$ScheduledConnectNodeSampler)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"akka:event-driven:dispatcher:global-16" daemon prio=10 tid=0x000000004e967800 nid=0xb79 waiting on condition [0x00002abaeb034000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-15" daemon prio=10 tid=0x000000004ea27000 nid=0xb78 waiting on condition [0x00002abaeaf33000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-14" daemon prio=10 tid=0x000000004ea25000 nid=0xb77 waiting on condition [0x00002abaeae32000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-13" daemon prio=10 tid=0x000000004ea23000 nid=0xb76 waiting on condition [0x00002abaead31000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-12" daemon prio=10 tid=0x000000004ea20800 nid=0xb75 waiting on condition [0x00002abaeac30000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-11" daemon prio=10 tid=0x000000004ece4800 nid=0xb74 waiting on condition [0x00002abaeab2e000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002abab3a29ee0> (a org.elasticsearch.common.util.concurrent.AbstractFuture$Sync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1011)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1303)
at org.elasticsearch.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:232)
at org.elasticsearch.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:69)
at org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:68)
at com.klout.metric.twitter.stream.ElasticQueueConsumer.deferredRespondQueue(ElasticQueueConsumer.scala:218)
at com.klout.metric.twitter.stream.BulkResponder$$anonfun$receive$1.apply(ElasticQueueConsumer.scala:62)
at com.klout.metric.twitter.stream.BulkResponder$$anonfun$receive$1.apply(ElasticQueueConsumer.scala:60)
at akka.actor.Actor$$anonfun$4.apply(Actor.scala:481)
at akka.actor.Actor$$anonfun$4.apply(Actor.scala:464)
at akka.actor.Actor$class.apply(Actor.scala:435)
at com.klout.metric.twitter.stream.BulkResponder.apply(ElasticQueueConsumer.scala:59)
at akka.actor.LocalActorRef.akka$actor$LocalActorRef$$dispatch(ActorRef.scala:1012)
at akka.actor.LocalActorRef$$anonfun$invoke$1.apply$mcV$sp(ActorRef.scala:832)
at akka.actor.LocalActorRef$$anonfun$invoke$1.apply(ActorRef.scala:828)
at akka.actor.LocalActorRef$$anonfun$invoke$1.apply(ActorRef.scala:828)
at akka.util.ReentrantGuard.withGuard(LockUtil.scala:19)
at akka.actor.LocalActorRef.invoke(ActorRef.scala:827)
at akka.dispatch.MessageInvocation.invoke(MessageHandling.scala:23)
at akka.dispatch.ExecutableMailbox$class.processMailbox(ExecutorBasedEventDrivenDispatcher.scala:190)
at akka.dispatch.ExecutorBasedEventDrivenDispatcher$$anon$1.processMailbox(ExecutorBasedEventDrivenDispatcher.scala:109)
at akka.dispatch.ExecutableMailbox$class.run(ExecutorBasedEventDrivenDispatcher.scala:166)
at akka.dispatch.ExecutorBasedEventDrivenDispatcher$$anon$1.run(ExecutorBasedEventDrivenDispatcher.scala:109)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-10" daemon prio=10 tid=0x000000004ece2800 nid=0xb73 waiting on condition [0x00002abaeaa2e000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-9" daemon prio=10 tid=0x000000004ece0000 nid=0xb72 waiting on condition [0x00002abaea92d000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-8" daemon prio=10 tid=0x000000004ecde000 nid=0xb71 waiting on condition [0x00002abaea82c000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-7" daemon prio=10 tid=0x000000004ed08000 nid=0xb70 waiting on condition [0x00002abaea72b000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-6" daemon prio=10 tid=0x000000004ed06000 nid=0xb6f waiting on condition [0x00002abaea62a000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-5" daemon prio=10 tid=0x000000004ed04800 nid=0xb6e waiting on condition [0x00002abaea529000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-4" daemon prio=10 tid=0x000000004ed03000 nid=0xb6d waiting on condition [0x00002abaea428000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-3" daemon prio=10 tid=0x000000004ed01800 nid=0xb6c waiting on condition [0x00002abaea327000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-2" daemon prio=10 tid=0x000000004ea3a000 nid=0xb6b waiting on condition [0x00002abaea226000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"akka:event-driven:dispatcher:global-1" daemon prio=10 tid=0x00002abae00fd000 nid=0xb6a waiting on condition [0x00002abaea125000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd92a90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
at akka.dispatch.MonitorableThread.run(ThreadPoolBuilder.scala:185)
"devhdn4:22133:send:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00f7800 nid=0xb69 waiting on condition [0x00002abaea024000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd9d088> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at com.twitter.grabbyhands.ConnectionSend.run2(ConnectionSend.scala:64)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:recv:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00f5800 nid=0xb68 runnable [0x00002abae9f23000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cd976c0> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cd976a8> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cd97630> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.twitter.grabbyhands.Socket$class.selectRead(Socket.scala:95)
at com.twitter.grabbyhands.ConnectionBase.selectRead(ConnectionBase.scala:25)
at com.twitter.grabbyhands.Socket$class.readBuffer(Socket.scala:133)
at com.twitter.grabbyhands.ConnectionBase.readBuffer(ConnectionBase.scala:25)
at com.twitter.grabbyhands.ConnectionRecv.run2(ConnectionRecv.scala:71)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:send:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00f3800 nid=0xb67 waiting on condition [0x00002abae9e22000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd9d088> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at com.twitter.grabbyhands.ConnectionSend.run2(ConnectionSend.scala:64)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:recv:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00f1800 nid=0xb66 runnable [0x00002abae9d21000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cdbaa10> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cdba9f8> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cdb6220> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.twitter.grabbyhands.Socket$class.selectRead(Socket.scala:95)
at com.twitter.grabbyhands.ConnectionBase.selectRead(ConnectionBase.scala:25)
at com.twitter.grabbyhands.Socket$class.readBuffer(Socket.scala:133)
at com.twitter.grabbyhands.ConnectionBase.readBuffer(ConnectionBase.scala:25)
at com.twitter.grabbyhands.ConnectionRecv.run2(ConnectionRecv.scala:71)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:send:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00ef800 nid=0xb65 waiting on condition [0x00002abae9c20000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd9d088> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at com.twitter.grabbyhands.ConnectionSend.run2(ConnectionSend.scala:64)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:recv:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00ed800 nid=0xb64 runnable [0x00002abae9b1f000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cdc6fb0> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cdc6f98> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cdbc7c8> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.twitter.grabbyhands.Socket$class.selectRead(Socket.scala:95)
at com.twitter.grabbyhands.ConnectionBase.selectRead(ConnectionBase.scala:25)
at com.twitter.grabbyhands.Socket$class.readBuffer(Socket.scala:133)
at com.twitter.grabbyhands.ConnectionBase.readBuffer(ConnectionBase.scala:25)
at com.twitter.grabbyhands.ConnectionRecv.run2(ConnectionRecv.scala:71)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:send:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00eb800 nid=0xb63 waiting on condition [0x00002abae9a1e000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd9d088> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at com.twitter.grabbyhands.ConnectionSend.run2(ConnectionSend.scala:64)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:recv:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00e9800 nid=0xb62 runnable [0x00002abae991d000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cdc8448> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cdc8430> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cdc7d20> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.twitter.grabbyhands.Socket$class.selectRead(Socket.scala:95)
at com.twitter.grabbyhands.ConnectionBase.selectRead(ConnectionBase.scala:25)
at com.twitter.grabbyhands.Socket$class.readBuffer(Socket.scala:133)
at com.twitter.grabbyhands.ConnectionBase.readBuffer(ConnectionBase.scala:25)
at com.twitter.grabbyhands.ConnectionRecv.run2(ConnectionRecv.scala:71)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:send:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00e7800 nid=0xb61 waiting on condition [0x00002abae981c000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd9d088> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at com.twitter.grabbyhands.ConnectionSend.run2(ConnectionSend.scala:64)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:recv:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00e5800 nid=0xb60 runnable [0x00002abae971b000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cdcfe28> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cdcfe10> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cdcfd98> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.twitter.grabbyhands.Socket$class.selectRead(Socket.scala:95)
at com.twitter.grabbyhands.ConnectionBase.selectRead(ConnectionBase.scala:25)
at com.twitter.grabbyhands.Socket$class.readBuffer(Socket.scala:133)
at com.twitter.grabbyhands.ConnectionBase.readBuffer(ConnectionBase.scala:25)
at com.twitter.grabbyhands.ConnectionRecv.run2(ConnectionRecv.scala:71)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:send:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00e3800 nid=0xb5f waiting on condition [0x00002abae961a000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd9d088> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at com.twitter.grabbyhands.ConnectionSend.run2(ConnectionSend.scala:64)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:recv:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00e3000 nid=0xb5e runnable [0x00002abae9519000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cdd04b0> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cdd0498> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cddf188> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.twitter.grabbyhands.Socket$class.selectRead(Socket.scala:95)
at com.twitter.grabbyhands.ConnectionBase.selectRead(ConnectionBase.scala:25)
at com.twitter.grabbyhands.Socket$class.readBuffer(Socket.scala:133)
at com.twitter.grabbyhands.ConnectionBase.readBuffer(ConnectionBase.scala:25)
at com.twitter.grabbyhands.ConnectionRecv.run2(ConnectionRecv.scala:71)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:send:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00bb000 nid=0xb5d waiting on condition [0x00002abae9418000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cd9d088> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:424)
at com.twitter.grabbyhands.ConnectionSend.run2(ConnectionSend.scala:64)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"devhdn4:22133:recv:ElasticTwitterEvents:1" daemon prio=10 tid=0x00002abae00e0000 nid=0xb5c runnable [0x00002abae9317000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cde6bd8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cde6bc0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cde0410> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at com.twitter.grabbyhands.Socket$class.selectRead(Socket.scala:95)
at com.twitter.grabbyhands.ConnectionBase.selectRead(ConnectionBase.scala:25)
at com.twitter.grabbyhands.Socket$class.readBuffer(Socket.scala:133)
at com.twitter.grabbyhands.ConnectionBase.readBuffer(ConnectionBase.scala:25)
at com.twitter.grabbyhands.ConnectionRecv.run2(ConnectionRecv.scala:71)
at com.twitter.grabbyhands.ConnectionBase.run(ConnectionBase.scala:67)
"main-EventThread" daemon prio=10 tid=0x00002abae00ba000 nid=0xb5b waiting on condition [0x00002abae9216000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9cdd0730> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
"main-SendThread(devhnn:2181)" daemon prio=10 tid=0x00002abae00b9800 nid=0xb5a runnable [0x00002abae9115000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cdf0048> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cdf0030> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cdef948> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1107)
"New I/O client worker #1-14" daemon prio=10 tid=0x000000004edef000 nid=0xb58 runnable [0x00002abae9014000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cdf0378> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cdf0360> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cdf02e8> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-12" daemon prio=10 tid=0x000000004edd4800 nid=0xb57 runnable [0x00002abae8f13000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cde85b8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cde85a0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cde8528> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-11" daemon prio=10 tid=0x000000004edd2800 nid=0xb56 runnable [0x00002abae8e12000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cec5eb8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cec5ea0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9ce7fe88> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-13" daemon prio=10 tid=0x000000004ec8b000 nid=0xb55 runnable [0x00002abae8d11000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cf3dcc8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cf3dcb0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cf08030> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-9" daemon prio=10 tid=0x000000004ec8a000 nid=0xb54 runnable [0x00002abae8c10000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9d005de8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9d005dd0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cfa7510> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-8" daemon prio=10 tid=0x000000004ec87000 nid=0xb52 runnable [0x00002abae8a0e000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9ce6b618> (a sun.nio.ch.Util$1)
- locked <0x00002aba9ce6b600> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cdf6718> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-5" daemon prio=10 tid=0x000000004ebcc000 nid=0xb51 runnable [0x00002abae890d000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cf3cd88> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cf3cd70> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cedc5b0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-7" daemon prio=10 tid=0x000000004ebc9800 nid=0xb50 runnable [0x00002abae880c000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9ce92c70> (a sun.nio.ch.Util$1)
- locked <0x00002aba9ce92c58> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9ce4c048> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-4" daemon prio=10 tid=0x000000004ee42000 nid=0xb4f runnable [0x00002abae870b000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9d0186b8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9d0186a0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cfb7490> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-1" daemon prio=10 tid=0x000000004ee40000 nid=0xb4e runnable [0x00002abae860a000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9d0bd0a8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9d0bd090> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9d072508> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-16" daemon prio=10 tid=0x000000004ecd3800 nid=0xb4d runnable [0x00002abae8509000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9d0e1998> (a sun.nio.ch.Util$1)
- locked <0x00002aba9d0e1980> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9ce0dd90> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-2" daemon prio=10 tid=0x000000004eeb8000 nid=0xb4c runnable [0x00002abae8408000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9d079ad8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9d079ac0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9d01ed60> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-15" daemon prio=10 tid=0x000000004eeb6800 nid=0xb4b runnable [0x00002abae8307000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cf069a0> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cf06988> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cea9a70> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-10" daemon prio=10 tid=0x000000004ee9c800 nid=0xb4a runnable [0x00002abadff0f000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cfa2828> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cfa2810> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cf454b0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-3" daemon prio=10 tid=0x000000004ee9b800 nid=0xb49 runnable [0x00002abadfe0e000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9d06edb8> (a sun.nio.ch.Util$1)
- locked <0x00002aba9d06eda0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9d013a28> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"New I/O client worker #1-6" daemon prio=10 tid=0x000000004ecff000 nid=0xb48 runnable [0x00002abadfd0d000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9cfaf218> (a sun.nio.ch.Util$1)
- locked <0x00002aba9cfaf200> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9cf4f140> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:38)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:163)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[Scratch, Nicholas][scheduler]-pool-8-thread-1" daemon prio=10 tid=0x00002abae4063000 nid=0xb46 waiting on condition [0x00002abadfb0b000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aba9ce49258> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:662)
"elasticsearch[Scratch, Nicholas][timer]" daemon prio=10 tid=0x00002abae4003000 nid=0xb45 waiting on condition [0x00002abadfa0a000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.elasticsearch.threadpool.ThreadPool$EstimatedTimeThread.run(ThreadPool.java:270)
"DestroyJavaVM" prio=10 tid=0x00002abae0092800 nid=0xb31 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"shutdown port listener" prio=10 tid=0x00002abae00a0000 nid=0xb44 runnable [0x00002abae8206000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
- locked <0x00002aba9d0e2630> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at com.klout.metric.twitter.stream.ElasticQueueConsumer$$anon$1.run(ElasticQueueConsumer.scala:375)
at java.lang.Thread.run(Thread.java:662)
"main-EventThread" daemon prio=10 tid=0x00002abae0030800 nid=0xb43 runnable [0x00002abadf909000]
java.lang.Thread.State: RUNNABLE
at java.lang.Throwable.fillInStackTrace(Native Method)
- locked <0x00002abad708e380> (a java.util.NoSuchElementException)
at java.lang.Throwable.<init>(Throwable.java:181)
at java.lang.Exception.<init>(Exception.java:29)
at java.lang.RuntimeException.<init>(RuntimeException.java:32)
at java.util.NoSuchElementException.<init>(NoSuchElementException.java:28)
at java.util.AbstractQueue.remove(AbstractQueue.java:90)
at com.klout.streams.messagequeue.GrabbyKestrelMQClient.pollQueue(GrabbyKestrelMQClient.scala:55)
at com.klout.streams.messagequeue.QueueConsumer.consume(QueueConsumer.java:141)
at com.klout.metric.twitter.stream.ElasticQueueConsumerWatcher.process(ElasticQueueConsumer.scala:328)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
"main-SendThread(devhnn:2181)" daemon prio=10 tid=0x00002abae005a800 nid=0xb42 runnable [0x00002abadf808000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:210)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:65)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
- locked <0x00002aba9d0eb7b0> (a sun.nio.ch.Util$1)
- locked <0x00002aba9d0eb798> (a java.util.Collections$UnmodifiableSet)
- locked <0x00002aba9d0eb720> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1107)
"Low Memory Detector" daemon prio=10 tid=0x000000004e9ad800 nid=0xb40 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread1" daemon prio=10 tid=0x000000004e9ab800 nid=0xb3f waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread0" daemon prio=10 tid=0x000000004e9a6000 nid=0xb3e waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x000000004e9a4000 nid=0xb3d runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x000000004e981000 nid=0xb3c in Object.wait() [0x00002abade700000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00002aba9d0ed0f0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x00002aba9d0ed0f0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x000000004e97f000 nid=0xb3b in Object.wait() [0x00002abade5ff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00002aba9d0e2df0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x00002aba9d0e2df0> (a java.lang.ref.Reference$Lock)
"VM Thread" prio=10 tid=0x000000004e97a800 nid=0xb3a runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x000000004e928800 nid=0xb32 runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x000000004e92a800 nid=0xb33 runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x000000004e92c800 nid=0xb34 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x000000004e92e000 nid=0xb35 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x000000004e930000 nid=0xb36 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x000000004e932000 nid=0xb37 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x000000004e933800 nid=0xb38 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x000000004e935800 nid=0xb39 runnable
"VM Periodic Task Thread" prio=10 tid=0x000000004e9b8800 nid=0xb41 waiting on condition
JNI global references: 982
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment