Skip to content

Instantly share code, notes, and snippets.

@timcharper

timcharper/README.md

Created June 16, 2017 18:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save timcharper/9ab4fea9da4669e620507e85e764d94a to your computer and use it in GitHub Desktop.
Save timcharper/9ab4fea9da4669e620507e85e764d94a to your computer and use it in GitHub Desktop.
Download ZIP
Strange deadlock issue
Raw
README.md

We have encountered a strange deadlock scenario in which it appears that all threads are waiting on acquiring a ReentrantLock, but no thread has the lock. A scan of the above thread dump reveals that all threads are stuck on Lock.scala:7, which is as follows:

/Users/tim/src/m8e/marathon-1.4/src/main/scala/mesosphere/marathon/util/Lock.scala

   1 | package mesosphere.marathon.util
   2 | 
   3 | import java.util.concurrent.locks.{ ReentrantLock, ReentrantReadWriteLock }
   4 | 
   5 | class RichLock(private val lock: ReentrantLock) extends AnyVal {
   6 |   def apply[T](f: => T): T = {
   7 |     lock.lock()
   8 |     try {
   9 |       f
  10 |     } finally {
  11 |       lock.unlock()
  12 |     }
  13 |   }
  14 | }
  15 |

The full code with it's context can be seen here:

https://github.com/mesosphere/marathon/blob/v1.4.2/src/main/scala/mesosphere/marathon/util/Lock.scala#L7

Raw
threaddump.txt
"qtp1329043305-47525" #47525 prio=5 os_prio=0 tid=0x00007ff88c06c800 nid=0x1c9c6 runnable [0x00007ff7f8607000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005c0e2bbb8> (a sun.nio.ch.Util$2)
- locked <0x00000005c0e2bc68> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005c0dd2510> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:232)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:180)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:162)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-47523" #47523 prio=5 os_prio=0 tid=0x00007ff8d8008000 nid=0x1c9c2 waiting on condition [0x00007ff8abefd000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0e43b10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-47407" #47407 prio=5 os_prio=0 tid=0x00007ff8a0001000 nid=0x1c301 waiting on condition [0x00007ff7f8403000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007b8611cc8> (a scala.concurrent.impl.Promise$CompletionLatch)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at scala.concurrent.impl.Promise$DefaultPromise.tryAwait(Promise.scala:208)
at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:218)
at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190)
at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
at scala.concurrent.Await$.result(package.scala:190)
at mesosphere.marathon.api.RestResource$class.result(RestResource.scala:59)
at mesosphere.marathon.api.v2.AppsResource.result(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$result$6(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.result(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1$$anonfun$apply$3.apply(AppsResource.scala:90)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1$$anonfun$apply$3.apply(AppsResource.scala:82)
at mesosphere.marathon.api.RestResource$class.withValid(RestResource.scala:75)
at mesosphere.marathon.api.v2.AppsResource.withValid(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$withValid$28(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.withValid(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1.apply(AppsResource.scala:82)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1.apply(AppsResource.scala:81)
at mesosphere.marathon.api.AuthResource$$anonfun$authenticated$1.apply(AuthResource.scala:27)
at mesosphere.marathon.api.AuthResource$$anonfun$authenticated$1.apply(AuthResource.scala:25)
at scala.Option.map(Option.scala:146)
at mesosphere.marathon.api.AuthResource$class.authenticated(AuthResource.scala:25)
at mesosphere.marathon.api.v2.AppsResource.authenticated(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$authenticated$35(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.authenticated(<generated>)
at mesosphere.marathon.api.v2.AppsResource.create(AppsResource.scala:81)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$create$5(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.create(<generated>)
at sun.reflect.GeneratedMethodAccessor129.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.codahale.metrics.jersey.InstrumentedResourceMethodDispatchProvider$TimedRequestDispatcher.dispatch(InstrumentedResourceMethodDispatchProvider.java:30)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
at mesosphere.marathon.api.CacheDisablingFilter.doFilter(CacheDisablingFilter.scala:18)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8$$FastClassByGuice$$ccb95931.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.CORSFilter.doFilter(CORSFilter.scala:45)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af$$FastClassByGuice$$5af91364.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.pass(LimitConcurrentRequestsFilter.scala:30)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.doFilter(LimitConcurrentRequestsFilter.scala:34)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LeaderProxyFilter.doFilter(LeaderProxyFilter.scala:98)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:513)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:240)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:109)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:375)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at org.eclipse.jetty.server.Server.handle(Server.java:517)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-47320" #47320 prio=5 os_prio=0 tid=0x00007ff8a000d000 nid=0x1b68b runnable [0x00007ff918db1000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005c0e45d90> (a sun.nio.ch.Util$2)
- locked <0x00000005c0e45d80> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005c0e45b58> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:232)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:180)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:162)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-47150" #47150 prio=5 os_prio=0 tid=0x00007ff7c809a800 nid=0x15ebf waiting on condition [0x00007ff7f8708000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0e43b10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-47142" #47142 prio=5 os_prio=0 tid=0x00007ff89c0f7000 nid=0x15d5c runnable [0x00007ff7faae6000]
java.lang.Thread.State: RUNNABLE
at java.util.zip.Deflater.deflateBytes(Native Method)
at java.util.zip.Deflater.deflate(Deflater.java:444)
- locked <0x000000062bea8e98> (a java.util.zip.ZStreamRef)
at org.eclipse.jetty.server.handler.gzip.GzipHttpOutputInterceptor$GzipBufferCB.process(GzipHttpOutputInterceptor.java:356)
at org.eclipse.jetty.util.IteratingCallback.processing(IteratingCallback.java:241)
at org.eclipse.jetty.util.IteratingCallback.iterate(IteratingCallback.java:224)
at org.eclipse.jetty.server.handler.gzip.GzipHttpOutputInterceptor.gzip(GzipHttpOutputInterceptor.java:143)
at org.eclipse.jetty.server.handler.gzip.GzipHttpOutputInterceptor.write(GzipHttpOutputInterceptor.java:112)
at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:177)
at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:163)
at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:413)
at com.sun.jersey.spi.container.servlet.WebComponent$Writer.write(WebComponent.java:300)
at com.sun.jersey.spi.container.ContainerResponse$CommittingOutputStream.write(ContainerResponse.java:135)
at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282)
at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125)
- locked <0x000000079ac483d0> (a java.io.OutputStreamWriter)
at java.io.OutputStreamWriter.write(OutputStreamWriter.java:207)
at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:129)
- locked <0x000000079ac483d0> (a java.io.OutputStreamWriter)
at java.io.BufferedWriter.write(BufferedWriter.java:230)
- locked <0x000000079ac483d0> (a java.io.OutputStreamWriter)
at java.io.Writer.write(Writer.java:157)
at com.sun.jersey.core.util.ReaderWriter.writeToAsString(ReaderWriter.java:190)
at com.sun.jersey.core.provider.AbstractMessageReaderWriterProvider.writeToAsString(AbstractMessageReaderWriterProvider.java:128)
at com.sun.jersey.core.impl.provider.entity.StringProvider.writeTo(StringProvider.java:88)
at com.sun.jersey.core.impl.provider.entity.StringProvider.writeTo(StringProvider.java:58)
at com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:302)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1510)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
at mesosphere.marathon.api.CacheDisablingFilter.doFilter(CacheDisablingFilter.scala:18)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8$$FastClassByGuice$$ccb95931.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.CORSFilter.doFilter(CORSFilter.scala:45)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af$$FastClassByGuice$$5af91364.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.pass(LimitConcurrentRequestsFilter.scala:30)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.doFilter(LimitConcurrentRequestsFilter.scala:34)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LeaderProxyFilter.doFilter(LeaderProxyFilter.scala:98)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:513)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:240)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:109)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:437)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at org.eclipse.jetty.server.Server.handle(Server.java:517)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-37663" #37663 prio=5 os_prio=0 tid=0x00007ff904009000 nid=0x154c3 waiting on condition [0x00007ff9185ab000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0e43b10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-37545" #37545 prio=5 os_prio=0 tid=0x00007ff88c06c000 nid=0x14ec1 runnable [0x00007ff9182a8000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005c0e15ee8> (a sun.nio.ch.Util$2)
- locked <0x00000005c0e15ed8> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005c0e15c80> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:232)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:180)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:162)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-37541" #37541 prio=5 os_prio=0 tid=0x00007ff89c0a4000 nid=0x14e30 waiting on condition [0x00007ff91a707000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0e43b10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-37540" #37540 prio=5 os_prio=0 tid=0x00007ff89c0a3800 nid=0x14e2c waiting on condition [0x00007ff7f8d08000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007b862a270> (a scala.concurrent.impl.Promise$CompletionLatch)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at scala.concurrent.impl.Promise$DefaultPromise.tryAwait(Promise.scala:208)
at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:218)
at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190)
at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
at scala.concurrent.Await$.result(package.scala:190)
at mesosphere.marathon.api.RestResource$class.result(RestResource.scala:59)
at mesosphere.marathon.api.v2.AppsResource.result(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$result$6(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.result(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1$$anonfun$apply$3.apply(AppsResource.scala:90)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1$$anonfun$apply$3.apply(AppsResource.scala:82)
at mesosphere.marathon.api.RestResource$class.withValid(RestResource.scala:75)
at mesosphere.marathon.api.v2.AppsResource.withValid(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$withValid$28(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.withValid(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1.apply(AppsResource.scala:82)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$create$1.apply(AppsResource.scala:81)
at mesosphere.marathon.api.AuthResource$$anonfun$authenticated$1.apply(AuthResource.scala:27)
at mesosphere.marathon.api.AuthResource$$anonfun$authenticated$1.apply(AuthResource.scala:25)
at scala.Option.map(Option.scala:146)
at mesosphere.marathon.api.AuthResource$class.authenticated(AuthResource.scala:25)
at mesosphere.marathon.api.v2.AppsResource.authenticated(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$authenticated$35(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.authenticated(<generated>)
at mesosphere.marathon.api.v2.AppsResource.create(AppsResource.scala:81)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$create$5(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.create(<generated>)
at sun.reflect.GeneratedMethodAccessor129.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.codahale.metrics.jersey.InstrumentedResourceMethodDispatchProvider$TimedRequestDispatcher.dispatch(InstrumentedResourceMethodDispatchProvider.java:30)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
at mesosphere.marathon.api.CacheDisablingFilter.doFilter(CacheDisablingFilter.scala:18)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8$$FastClassByGuice$$ccb95931.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.CORSFilter.doFilter(CORSFilter.scala:45)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af$$FastClassByGuice$$5af91364.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.pass(LimitConcurrentRequestsFilter.scala:30)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.doFilter(LimitConcurrentRequestsFilter.scala:34)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LeaderProxyFilter.doFilter(LeaderProxyFilter.scala:98)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:513)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:240)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:109)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:375)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at org.eclipse.jetty.server.Server.handle(Server.java:517)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"ForkJoinPool-2-worker-11" #37499 daemon prio=5 os_prio=0 tid=0x00007ff7a8b04000 nid=0x14729 waiting on condition [0x00007ff8a8dd4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"qtp1329043305-36896" #36896 prio=5 os_prio=0 tid=0x00007ff790019800 nid=0xd816 runnable [0x00007ff9191b5000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005c0dce520> (a sun.nio.ch.Util$2)
- locked <0x00000005c0dce510> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005c0dce2e8> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:232)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:180)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:162)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"qtp1329043305-26785" #26785 prio=5 os_prio=0 tid=0x00007ff790021800 nid=0xc589 waiting on condition [0x00007ff7f8504000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000073a34c9c0> (a scala.concurrent.impl.Promise$CompletionLatch)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at scala.concurrent.impl.Promise$DefaultPromise.tryAwait(Promise.scala:208)
at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:218)
at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190)
at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
at scala.concurrent.Await$.result(package.scala:190)
at mesosphere.marathon.api.RestResource$class.result(RestResource.scala:59)
at mesosphere.marathon.api.v2.AppsResource.result(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$result$6(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.result(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$index$1.apply(AppsResource.scala:60)
at mesosphere.marathon.api.v2.AppsResource$$anonfun$index$1.apply(AppsResource.scala:55)
at mesosphere.marathon.api.AuthResource$$anonfun$authenticated$1.apply(AuthResource.scala:27)
at mesosphere.marathon.api.AuthResource$$anonfun$authenticated$1.apply(AuthResource.scala:25)
at scala.Option.map(Option.scala:146)
at mesosphere.marathon.api.AuthResource$class.authenticated(AuthResource.scala:25)
at mesosphere.marathon.api.v2.AppsResource.authenticated(AppsResource.scala:30)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$authenticated$35(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.authenticated(<generated>)
at mesosphere.marathon.api.v2.AppsResource.index(AppsResource.scala:55)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.CGLIB$index$1(<generated>)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c$$FastClassByGuice$$422c678d.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.v2.AppsResource$$EnhancerByGuice$$12b0477c.index(<generated>)
at sun.reflect.GeneratedMethodAccessor116.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.codahale.metrics.jersey.InstrumentedResourceMethodDispatchProvider$TimedRequestDispatcher.dispatch(InstrumentedResourceMethodDispatchProvider.java:30)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
at mesosphere.marathon.api.CacheDisablingFilter.doFilter(CacheDisablingFilter.scala:18)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8$$FastClassByGuice$$ccb95931.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CacheDisablingFilter$$EnhancerByGuice$$bbaeb0a8.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.CORSFilter.doFilter(CORSFilter.scala:45)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.CGLIB$doFilter$2(<generated>)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af$$FastClassByGuice$$5af91364.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.api.CORSFilter$$EnhancerByGuice$$6ba633af.doFilter(<generated>)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.pass(LimitConcurrentRequestsFilter.scala:30)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter$$anonfun$3$$anonfun$apply$2.apply(LimitConcurrentRequestsFilter.scala:15)
at mesosphere.marathon.api.LimitConcurrentRequestsFilter.doFilter(LimitConcurrentRequestsFilter.scala:34)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at mesosphere.marathon.api.LeaderProxyFilter.doFilter(LeaderProxyFilter.scala:98)
at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:513)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:240)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:109)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:437)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at org.eclipse.jetty.server.Server.handle(Server.java:517)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"ForkJoinPool-2-worker-33" #25346 daemon prio=5 os_prio=0 tid=0x00007ff80c11c000 nid=0x5747 waiting on condition [0x00007ff8a91d8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-3" #25329 daemon prio=5 os_prio=0 tid=0x00007ff890022000 nid=0x5243 runnable [0x00007ff8a81cf000]
java.lang.Thread.State: RUNNABLE
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData.maybeLastTaskFailureFuture$lzycompute(AppInfoBaseData.scala:164)
- locked <0x000000079a4f5aa0> (a mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData.maybeLastTaskFailureFuture(AppInfoBaseData.scala:163)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$$anonfun$appInfoFuture$1$$anonfun$apply$7.apply(AppInfoBaseData.scala:87)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$$anonfun$appInfoFuture$1$$anonfun$apply$7.apply(AppInfoBaseData.scala:78)
at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:253)
at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:251)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-49" #25327 daemon prio=5 os_prio=0 tid=0x00007ff7b0026800 nid=0x5139 waiting on condition [0x00007ff8ab5f6000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-27" #25275 daemon prio=5 os_prio=0 tid=0x00007ff8a400a800 nid=0x481f runnable [0x00007ff9190b4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-21" #25260 daemon prio=5 os_prio=0 tid=0x00007ff8b4017800 nid=0x45d6 waiting on condition [0x00007ff918eb2000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-15" #25254 daemon prio=5 os_prio=0 tid=0x00007ff79c035000 nid=0x453a runnable [0x00007ff7f930b000]
java.lang.Thread.State: RUNNABLE
at scala.collection.immutable.VectorIterator.initFrom(Vector.scala:659)
at scala.collection.immutable.VectorPointer$class.initFrom(Vector.scala:764)
at scala.collection.immutable.VectorIterator.initFrom(Vector.scala:659)
at scala.collection.immutable.Vector.initIterator(Vector.scala:90)
at scala.collection.immutable.Vector.iterator(Vector.scala:97)
at scala.collection.immutable.Vector.iterator(Vector.scala:62)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.util.hashing.MurmurHash3.orderedHash(MurmurHash3.scala:109)
at scala.util.hashing.MurmurHash3$.seqHash(MurmurHash3.scala:219)
at scala.collection.IndexedSeqLike$class.hashCode(IndexedSeqLike.scala:44)
at scala.collection.immutable.Vector.hashCode(Vector.scala:62)
at scala.runtime.Statics.anyHash(Statics.java:87)
at mesosphere.marathon.state.AppDefinition.hashCode(AppDefinition.scala:30)
at java.util.AbstractMap$SimpleImmutableEntry.hashCode(AbstractMap.java:843)
at scala.runtime.ScalaRunTime$.hash(ScalaRunTime.scala:206)
at scala.collection.immutable.HashSet.elemHashCode(HashSet.scala:177)
at scala.collection.immutable.HashSet.computeHash(HashSet.scala:186)
at scala.collection.immutable.HashSet.$plus(HashSet.scala:84)
at scala.collection.immutable.HashSet.$plus(HashSet.scala:35)
at scala.collection.mutable.SetBuilder.$plus$eq(SetBuilder.scala:22)
at scala.collection.mutable.SetBuilder.$plus$eq(SetBuilder.scala:20)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entries$lzycompute(JavaConversions.scala:32)
- locked <0x0000000799610028> (a mesosphere.marathon.stream.JavaConversions$JavaMap)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entries(JavaConversions.scala:31)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entrySet(JavaConversions.scala:33)
at java.util.AbstractMap.containsKey(AbstractMap.java:144)
at mesosphere.marathon.upgrade.DeploymentPlan$$anonfun$19.apply(DeploymentPlan.scala:318)
at mesosphere.marathon.upgrade.DeploymentPlan$$anonfun$19.apply(DeploymentPlan.scala:316)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104)
at mesosphere.marathon.upgrade.DeploymentPlan$.apply(DeploymentPlan.scala:327)
at mesosphere.marathon.storage.repository.StoredPlan$stateMachine$macro$913$1.apply(DeploymentRepositoryImpl.scala:36)
at mesosphere.marathon.storage.repository.StoredPlan$stateMachine$macro$913$1.apply(DeploymentRepositoryImpl.scala:30)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-55" #15864 daemon prio=5 os_prio=0 tid=0x00007ff79c01f000 nid=0x3d7f waiting on condition [0x00007ff8a93da000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-43" #15847 daemon prio=5 os_prio=0 tid=0x00007ff78c016800 nid=0x35cc waiting on condition [0x00007ff7f960f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-61" #15839 daemon prio=5 os_prio=0 tid=0x00007ff7b0028800 nid=0x335d waiting on condition [0x00007ff8a90d7000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-9" #15838 daemon prio=5 os_prio=0 tid=0x00007ff8d000f800 nid=0x3267 waiting on condition [0x00007ff7face9000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-57" #15836 daemon prio=5 os_prio=0 tid=0x00007ff79c034000 nid=0x3126 waiting on condition [0x00007ff918fb3000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-51" #15828 daemon prio=5 os_prio=0 tid=0x00007ff80c170000 nid=0x2c1e runnable [0x00007ff7f920a000]
java.lang.Thread.State: RUNNABLE
at scala.collection.immutable.VectorIterator.initFrom(Vector.scala:659)
at scala.collection.immutable.VectorPointer$class.initFrom(Vector.scala:764)
at scala.collection.immutable.VectorIterator.initFrom(Vector.scala:659)
at scala.collection.immutable.Vector.initIterator(Vector.scala:90)
at scala.collection.immutable.Vector.iterator(Vector.scala:97)
at scala.collection.immutable.Vector.iterator(Vector.scala:62)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.util.hashing.MurmurHash3.orderedHash(MurmurHash3.scala:109)
at scala.util.hashing.MurmurHash3$.seqHash(MurmurHash3.scala:219)
at scala.collection.IndexedSeqLike$class.hashCode(IndexedSeqLike.scala:44)
at scala.collection.immutable.Vector.hashCode(Vector.scala:62)
at scala.runtime.Statics.anyHash(Statics.java:87)
at mesosphere.marathon.state.AppDefinition.hashCode(AppDefinition.scala:30)
at java.util.AbstractMap$SimpleImmutableEntry.hashCode(AbstractMap.java:843)
at scala.runtime.ScalaRunTime$.hash(ScalaRunTime.scala:206)
at scala.collection.immutable.HashSet.elemHashCode(HashSet.scala:177)
at scala.collection.immutable.HashSet.computeHash(HashSet.scala:186)
at scala.collection.immutable.HashSet.$plus(HashSet.scala:84)
at scala.collection.immutable.HashSet.$plus(HashSet.scala:35)
at scala.collection.mutable.SetBuilder.$plus$eq(SetBuilder.scala:22)
at scala.collection.mutable.SetBuilder.$plus$eq(SetBuilder.scala:20)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entries$lzycompute(JavaConversions.scala:32)
- locked <0x000000079adf9480> (a mesosphere.marathon.stream.JavaConversions$JavaMap)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entries(JavaConversions.scala:31)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entrySet(JavaConversions.scala:33)
at java.util.AbstractMap.containsKey(AbstractMap.java:144)
at mesosphere.marathon.upgrade.DeploymentPlan$$anonfun$19.apply(DeploymentPlan.scala:319)
at mesosphere.marathon.upgrade.DeploymentPlan$$anonfun$19.apply(DeploymentPlan.scala:316)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104)
at mesosphere.marathon.upgrade.DeploymentPlan$.apply(DeploymentPlan.scala:327)
at mesosphere.marathon.storage.repository.StoredPlan$stateMachine$macro$913$1.apply(DeploymentRepositoryImpl.scala:36)
at mesosphere.marathon.storage.repository.StoredPlan$stateMachine$macro$913$1.apply(DeploymentRepositoryImpl.scala:30)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-35" #15826 daemon prio=5 os_prio=0 tid=0x00007ff7a000f000 nid=0x2b2a waiting on condition [0x00007ff7f950e000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-13" #15823 daemon prio=5 os_prio=0 tid=0x00007ff7a1556800 nid=0x2a9c waiting on condition [0x00007ff918aae000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-39" #15815 daemon prio=5 os_prio=0 tid=0x00007ff8a40ba800 nid=0x2766 waiting on condition [0x00007ff8a83d1000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-17" #15814 daemon prio=5 os_prio=0 tid=0x00007ff7ac002800 nid=0x2726 waiting on condition [0x00007ff7faeeb000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-19" #15805 daemon prio=5 os_prio=0 tid=0x00007ff890021000 nid=0x257e runnable [0x00007ff8a8ed5000]
java.lang.Thread.State: RUNNABLE
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData.taskCountsFuture$lzycompute(AppInfoBaseData.scala:132)
- locked <0x000000079a4d6048> (a mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData.taskCountsFuture(AppInfoBaseData.scala:131)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$$anonfun$appInfoFuture$1$$anonfun$apply$7.apply(AppInfoBaseData.scala:81)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$$anonfun$appInfoFuture$1$$anonfun$apply$7.apply(AppInfoBaseData.scala:78)
at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:253)
at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:251)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-7" #15799 daemon prio=5 os_prio=0 tid=0x00007ff8b4011000 nid=0x2539 waiting on condition [0x00007ff9193b7000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-25" #15796 daemon prio=5 os_prio=0 tid=0x00007ff8a40b9000 nid=0x2360 waiting on condition [0x00007ff8a84d2000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-29" #15787 daemon prio=5 os_prio=0 tid=0x00007ff7b0024000 nid=0x20d1 waiting on condition [0x00007ff9184aa000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-37" #15738 daemon prio=5 os_prio=0 tid=0x00007ff804011800 nid=0x1cc0c waiting on condition [0x00007ff7f9710000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"qtp1329043305-15711" #15711 prio=5 os_prio=0 tid=0x00007ff8d8012800 nid=0x1c294 waiting on condition [0x00007ff9183a9000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0e43b10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)
at java.lang.Thread.run(Thread.java:745)
"ForkJoinPool-2-worker-23" #15663 daemon prio=5 os_prio=0 tid=0x00007ff7a4062800 nid=0x1bc4b waiting on condition [0x00007ff7f940d000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-47" #6327 daemon prio=5 os_prio=0 tid=0x00007ff818027000 nid=0x1987b runnable [0x00007ff8a8fd6000]
java.lang.Thread.State: RUNNABLE
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData.healthByInstanceIdFuture$lzycompute(AppInfoBaseData.scala:115)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData.healthByInstanceIdFuture(AppInfoBaseData.scala:115)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData$$anonfun$enrichedTasksFuture$3.apply(AppInfoBaseData.scala:157)
at mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$AppData$$anonfun$enrichedTasksFuture$3.apply(AppInfoBaseData.scala:156)
at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:253)
at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:251)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-1" #6325 daemon prio=5 os_prio=0 tid=0x00007ff79c025000 nid=0x19834 waiting on condition [0x00007ff7f9811000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-59" #6321 daemon prio=5 os_prio=0 tid=0x00007ff7a4061800 nid=0x19678 waiting on condition [0x00007ff7fadea000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.io.pinned-dispatcher-64" #354 prio=5 os_prio=0 tid=0x00007ff7dc00a000 nid=0x121ac runnable [0x00007ff79a2e9000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005cb119d58> (a sun.nio.ch.Util$2)
- locked <0x00000005cb119d48> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005cb0a9258> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at akka.io.SelectionHandler$ChannelRegistryImpl$$anon$3.tryRun(SelectionHandler.scala:115)
at akka.io.SelectionHandler$ChannelRegistryImpl$Task.run(SelectionHandler.scala:219)
at akka.io.SelectionHandler$ChannelRegistryImpl$$anon$3.run(SelectionHandler.scala:148)
at akka.util.SerializedSuspendableExecutionContext.run$1(SerializedSuspendableExecutionContext.scala:67)
at akka.util.SerializedSuspendableExecutionContext.run(SerializedSuspendableExecutionContext.scala:71)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"marathon-akka.actor.default-dispatcher-57" #336 prio=5 os_prio=0 tid=0x00007ff828002800 nid=0x1215e waiting on condition [0x00007ff79a9ea000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-63" #342 prio=5 os_prio=0 tid=0x00007ff830002800 nid=0x1215d waiting on condition [0x00007ff79aaeb000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-62" #341 prio=5 os_prio=0 tid=0x00007ff840004800 nid=0x1215c waiting on condition [0x00007ff79abec000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-44" #323 prio=5 os_prio=0 tid=0x00007ff85c002800 nid=0x1215b waiting on condition [0x00007ff79aced000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-61" #340 prio=5 os_prio=0 tid=0x00007ff83c002000 nid=0x1215a waiting on condition [0x00007ff79adee000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-60" #339 prio=5 os_prio=0 tid=0x00007ff844002800 nid=0x12159 waiting on condition [0x00007ff79aeef000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-59" #338 prio=5 os_prio=0 tid=0x00007ff8c8003000 nid=0x12158 waiting on condition [0x00007ff79aff0000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-58" #337 prio=5 os_prio=0 tid=0x00007ff854040000 nid=0x12157 waiting on condition [0x00007ff79b0f1000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-56" #335 prio=5 os_prio=0 tid=0x00007ff830001000 nid=0x12156 waiting on condition [0x00007ff79b1f2000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-55" #334 prio=5 os_prio=0 tid=0x00007ff86401f800 nid=0x12154 waiting on condition [0x00007ff79b2f3000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-54" #333 prio=5 os_prio=0 tid=0x00007ff86c030800 nid=0x12153 waiting on condition [0x00007ff79b3f4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-53" #332 prio=5 os_prio=0 tid=0x00007ff834002800 nid=0x12152 waiting on condition [0x00007ff79b4f5000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-52" #331 prio=5 os_prio=0 tid=0x00007ff85800e000 nid=0x12151 waiting on condition [0x00007ff79b5f6000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-41" #321 prio=5 os_prio=0 tid=0x00007ff870007000 nid=0x12150 waiting on condition [0x00007ff79b6f7000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-51" #330 prio=5 os_prio=0 tid=0x00007ff860004800 nid=0x1214e waiting on condition [0x00007ff79b7f8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-50" #329 prio=5 os_prio=0 tid=0x00007ff848001000 nid=0x1214d waiting on condition [0x00007ff79b8f9000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-49" #328 prio=5 os_prio=0 tid=0x00007ff908033000 nid=0x1214c waiting on condition [0x00007ff79b9fa000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-48" #327 prio=5 os_prio=0 tid=0x00007ff834001000 nid=0x1214b waiting on condition [0x00007ff79bafb000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-47" #326 prio=5 os_prio=0 tid=0x00007ff84c006800 nid=0x12144 waiting on condition [0x00007ff79bbfc000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-46" #325 prio=5 os_prio=0 tid=0x00007ff840002800 nid=0x12140 waiting on condition [0x00007ff79bcfd000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-45" #324 prio=5 os_prio=0 tid=0x00007ff840001000 nid=0x1213f waiting on condition [0x00007ff79bdfe000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-43" #322 prio=5 os_prio=0 tid=0x00007ff85403f000 nid=0x1213e waiting on condition [0x00007ff7f8104000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-42" #320 prio=5 os_prio=0 tid=0x00007ff83c001000 nid=0x1213d waiting on condition [0x00007ff91a909000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-45" #292 daemon prio=5 os_prio=0 tid=0x00007ff87801f000 nid=0x12000 waiting on condition [0x00007ff7fabe8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-31" #291 daemon prio=5 os_prio=0 tid=0x00007ff8cc003800 nid=0x11ffc waiting on condition [0x00007ff7fafec000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-53" #288 daemon prio=5 os_prio=0 tid=0x00007ff890005800 nid=0x11ffa waiting on condition [0x00007ff8a82d0000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-5" #280 daemon prio=5 os_prio=0 tid=0x00007ff878019800 nid=0x11fdf waiting on condition [0x00007ff8a92d9000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-41" #278 daemon prio=5 os_prio=0 tid=0x00007ff8a40bb800 nid=0x11fdd runnable [0x00007ff8a94da000]
java.lang.Thread.State: RUNNABLE
at org.apache.mesos.MesosSchedulerDriver.join(Native Method)
at org.apache.mesos.MesosSchedulerDriver.run(MesosSchedulerDriver.java:255)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1$$anonfun$apply$mcV$sp$1$$anonfun$apply$mcV$sp$2.apply(MarathonSchedulerService.scala:231)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1$$anonfun$apply$mcV$sp$1$$anonfun$apply$mcV$sp$2.apply(MarathonSchedulerService.scala:231)
at scala.Option.foreach(Option.scala:257)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(MarathonSchedulerService.scala:231)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1$$anonfun$apply$mcV$sp$1.apply(MarathonSchedulerService.scala:231)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1$$anonfun$apply$mcV$sp$1.apply(MarathonSchedulerService.scala:231)
at scala.concurrent.impl.ExecutionContextImpl$DefaultThreadFactory$$anon$2$$anon$4.block(ExecutionContextImpl.scala:48)
at scala.concurrent.forkjoin.ForkJoinPool.managedBlock(ForkJoinPool.java:3640)
at scala.concurrent.impl.ExecutionContextImpl$DefaultThreadFactory$$anon$2.blockOn(ExecutionContextImpl.scala:45)
at scala.concurrent.package$.blocking(package.scala:123)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1.apply$mcV$sp(MarathonSchedulerService.scala:231)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1.apply(MarathonSchedulerService.scala:230)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$startLeadership$1.apply(MarathonSchedulerService.scala:230)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-38" #274 prio=5 os_prio=0 tid=0x00007ff84c004800 nid=0x11fd8 waiting on condition [0x00007ff8a97dc000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-33" #269 prio=5 os_prio=0 tid=0x00007ff870002800 nid=0x11fd7 runnable [0x00007ff8a98dc000]
java.lang.Thread.State: RUNNABLE
at scala.util.hashing.MurmurHash3.unorderedHash(MurmurHash3.scala:91)
at scala.util.hashing.MurmurHash3$.setHash(MurmurHash3.scala:223)
at scala.collection.GenSetLike$class.hashCode(GenSetLike.scala:131)
at scala.collection.AbstractSet.hashCode(Set.scala:47)
at scala.runtime.Statics.anyHash(Statics.java:87)
at mesosphere.marathon.state.AppDefinition.hashCode(AppDefinition.scala:30)
at java.util.AbstractMap$SimpleImmutableEntry.hashCode(AbstractMap.java:843)
at scala.runtime.ScalaRunTime$.hash(ScalaRunTime.scala:206)
at scala.collection.immutable.HashSet.elemHashCode(HashSet.scala:177)
at scala.collection.immutable.HashSet.computeHash(HashSet.scala:186)
at scala.collection.immutable.HashSet.$plus(HashSet.scala:84)
at scala.collection.immutable.HashSet.$plus(HashSet.scala:35)
at scala.collection.mutable.SetBuilder.$plus$eq(SetBuilder.scala:22)
at scala.collection.mutable.SetBuilder.$plus$eq(SetBuilder.scala:20)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entries$lzycompute(JavaConversions.scala:32)
- locked <0x000000079a292450> (a mesosphere.marathon.stream.JavaConversions$JavaMap)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entries(JavaConversions.scala:31)
at mesosphere.marathon.stream.JavaConversions$JavaMap.entrySet(JavaConversions.scala:33)
at java.util.AbstractMap.containsKey(AbstractMap.java:144)
at mesosphere.marathon.upgrade.DeploymentPlan$$anonfun$19.apply(DeploymentPlan.scala:319)
at mesosphere.marathon.upgrade.DeploymentPlan$$anonfun$19.apply(DeploymentPlan.scala:316)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104)
at mesosphere.marathon.upgrade.DeploymentPlan$.apply(DeploymentPlan.scala:327)
at mesosphere.marathon.core.group.impl.GroupManagerActor$$anonfun$mesosphere$marathon$core$group$impl$GroupManagerActor$$getUpgrade$1$$anonfun$3$$anonfun$apply$6.apply(GroupManagerActor.scala:149)
at mesosphere.marathon.core.group.impl.GroupManagerActor$$anonfun$mesosphere$marathon$core$group$impl$GroupManagerActor$$getUpgrade$1$$anonfun$3$$anonfun$apply$6.apply(GroupManagerActor.scala:146)
at scala.util.Success$$anonfun$map$1.apply(Try.scala:237)
at scala.util.Try$.apply(Try.scala:192)
at scala.util.Success.map(Try.scala:237)
at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:237)
at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:237)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:91)
at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)
at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)
at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)
at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:90)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-40" #276 prio=5 os_prio=0 tid=0x00007ff900015000 nid=0x11fd6 waiting on condition [0x00007ff8a99de000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-34" #270 prio=5 os_prio=0 tid=0x00007ff8bc00a800 nid=0x11fd5 waiting on condition [0x00007ff8a9adf000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-35" #271 prio=5 os_prio=0 tid=0x00007ff868004000 nid=0x11fd4 runnable [0x00007ff8a9be0000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-39" #275 prio=5 os_prio=0 tid=0x00007ff860002000 nid=0x11fd3 waiting on condition [0x00007ff8a9ce1000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-37" #273 prio=5 os_prio=0 tid=0x00007ff8dc006800 nid=0x11fc1 waiting on condition [0x00007ff8a9de2000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-36" #272 prio=5 os_prio=0 tid=0x00007ff85c001000 nid=0x11fbf waiting on condition [0x00007ff8a9ee3000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-30" #267 prio=5 os_prio=0 tid=0x00007ff864001000 nid=0x11fbe waiting on condition [0x00007ff8a9fe4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-31" #266 prio=5 os_prio=0 tid=0x00007ff90801f000 nid=0x11fbd waiting on condition [0x00007ff8aa0e5000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-32" #268 prio=5 os_prio=0 tid=0x00007ff84c001000 nid=0x11fbc waiting on condition [0x00007ff8aa1e6000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-25" #261 prio=5 os_prio=0 tid=0x00007ff900013800 nid=0x11fbb waiting on condition [0x00007ff8aa2e7000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-29" #265 prio=5 os_prio=0 tid=0x00007ff870001000 nid=0x11fba runnable [0x00007ff8aa3e8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-28" #264 prio=5 os_prio=0 tid=0x00007ff86c005000 nid=0x11fb9 waiting on condition [0x00007ff8aa4e9000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-27" #263 prio=5 os_prio=0 tid=0x00007ff86c001000 nid=0x11fb8 waiting on condition [0x00007ff8aa5ea000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-26" #262 prio=5 os_prio=0 tid=0x00007ff8dc001000 nid=0x11fb7 waiting on condition [0x00007ff8aa6eb000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-24" #260 prio=5 os_prio=0 tid=0x00007ff908012000 nid=0x11fb6 runnable [0x00007ff8aa7ec000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-23" #259 prio=5 os_prio=0 tid=0x00007ff8d4007800 nid=0x11fb5 waiting on condition [0x00007ff8aa8ed000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-22" #258 prio=5 os_prio=0 tid=0x00007ff90000e800 nid=0x11fb4 waiting on condition [0x00007ff8aa9ee000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-21" #257 prio=5 os_prio=0 tid=0x00007ff908015800 nid=0x11fb3 waiting on condition [0x00007ff9194b8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-20" #256 prio=5 os_prio=0 tid=0x00007ff8d4005800 nid=0x11fb2 waiting on condition [0x00007ff8aaeef000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-19" #255 prio=5 os_prio=0 tid=0x00007ff908015000 nid=0x11fb1 waiting on condition [0x00007ff918cb0000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-18" #254 prio=5 os_prio=0 tid=0x00007ff8d4004800 nid=0x11fb0 waiting on condition [0x00007ff91a606000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"marathon-akka.actor.default-dispatcher-17" #253 prio=5 os_prio=0 tid=0x00007ff8d4004000 nid=0x11faf waiting on condition [0x00007ff91a808000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"ForkJoinPool-2-worker-63" #251 daemon prio=5 os_prio=0 tid=0x00007ff8d0007800 nid=0x11f8d waiting on condition [0x00007ff8abdfc000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af6298> (a java.util.concurrent.locks.ReentrantLock$FairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at java.util.concurrent.locks.ReentrantLock$FairSync.lock(ReentrantLock.java:224)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:285)
at mesosphere.marathon.util.RichLock$.apply$extension(Lock.scala:7)
at mesosphere.marathon.util.Lock.apply(Lock.scala:25)
at mesosphere.marathon.util.KeyedLock.apply(WorkQueue.scala:94)
at mesosphere.marathon.core.storage.store.impl.cache.LazyCachingPersistenceStore.get(LazyCachingPersistenceStore.scala:102)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:235)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply$mcV$sp(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at mesosphere.marathon.core.storage.store.impl.cache.LazyVersionCachingPersistentStore$stateMachine$macro$388$1.apply(LazyCachingPersistenceStore.scala:234)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"Timer-0" #244 daemon prio=5 os_prio=0 tid=0x00007ff8a4021800 nid=0x11f7d in Object.wait() [0x00007ff91aa0a000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.util.TimerThread.mainLoop(Timer.java:526)
- locked <0x00000005c0bedc78> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:505)
"Scheduler-1252204540" #66 prio=5 os_prio=0 tid=0x00007ff8b0005800 nid=0xe67f waiting on condition [0x00007ff9187ad000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0e18920> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"DestroyJavaVM" #65 prio=5 os_prio=0 tid=0x00007ff9d1784000 nid=0xe163 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Curator-Framework-0" #63 daemon prio=5 os_prio=0 tid=0x00007ff884022000 nid=0xe5b2 waiting on condition [0x00007ff8ab6f7000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0c155c0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64)
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"pool-4-thread-1-EventThread" #62 daemon prio=5 os_prio=0 tid=0x00007ff884020800 nid=0xe5b1 waiting on condition [0x00007ff8ab7f8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0c14c58> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:511)
"pool-4-thread-1-SendThread(10.64.101.144:22181)" #61 daemon prio=5 os_prio=0 tid=0x00007ff884004800 nid=0xe5b0 runnable [0x00007ff8ab8f9000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005c0c12530> (a sun.nio.ch.Util$2)
- locked <0x00000005c0c12520> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005c0c120b0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1192)
"Curator-ConnectionStateManager-0" #60 daemon prio=5 os_prio=0 tid=0x00007ff884003000 nid=0xe5af waiting on condition [0x00007ff8ab9fa000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0c15b48> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
at org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
at org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
at org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"pool-4-thread-1" #59 prio=5 os_prio=0 tid=0x00007ff90c001000 nid=0xe5ad waiting on condition [0x00007ff8abafb000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0c10290> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
java.lang.Thread.State: BLOCKED (on object monitor)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:233)
- waiting to lock <0x00000005c0dcc018> (a java.lang.Object)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:382)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:564)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
- locked <0x00000005c0dcc018> (a java.lang.Object)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:382)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:564)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
"MarathonSchedulerService$$EnhancerByGuice$$63a173f3" #48 prio=5 os_prio=0 tid=0x00007ff9d1786000 nid=0xe58f waiting on condition [0x00007ff9186ab000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0c389f8> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$run$1.apply$mcV$sp(MarathonSchedulerService.scala:166)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$run$1.apply(MarathonSchedulerService.scala:166)
at mesosphere.marathon.MarathonSchedulerService$$anonfun$run$1.apply(MarathonSchedulerService.scala:166)
at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
at scala.concurrent.package$.blocking(package.scala:123)
at mesosphere.marathon.MarathonSchedulerService.run(MarathonSchedulerService.scala:166)
at mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$63a173f3.CGLIB$run$0(<generated>)
at mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$63a173f3$$FastClassByGuice$$f9a4c9bd.invoke(<generated>)
at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at mesosphere.marathon.DebugModule$MetricsBehavior$$anonfun$invoke$1.apply(DebugConf.scala:82)
at mesosphere.marathon.metrics.Metrics.timed(Metrics.scala:28)
at mesosphere.marathon.DebugModule$MetricsBehavior.invoke(DebugConf.scala:82)
at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
at mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$63a173f3.run(<generated>)
at com.google.common.util.concurrent.AbstractExecutionThreadService$1$2.run(AbstractExecutionThreadService.java:60)
at com.google.common.util.concurrent.Callables$3.run(Callables.java:100)
at java.lang.Thread.run(Thread.java:745)
"marathonSchedulerTimer" #43 prio=5 os_prio=0 tid=0x00007ff9d1734800 nid=0xe581 in Object.wait() [0x00007ff918baf000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.util.TimerThread.mainLoop(Timer.java:552)
- locked <0x00000005c0c38f70> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:505)
"marathon-akka.actor.default-dispatcher-9" #37 prio=5 os_prio=0 tid=0x00007ff8fc002800 nid=0xe57a waiting on condition [0x00007ff9192b6000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0581aa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool)
at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
"RxScheduledExecutorPool-2" #34 daemon prio=5 os_prio=0 tid=0x00007ff9d159d800 nid=0xe540 waiting on condition [0x00007ff919c00000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0c6bcf8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"RxScheduledExecutorPool-1" #33 daemon prio=5 os_prio=0 tid=0x00007ff9d159c000 nid=0xe53f waiting on condition [0x00007ff919d01000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0c9f480> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Curator-Framework-0" #32 daemon prio=5 os_prio=0 tid=0x00007ff9d1475000 nid=0xe518 waiting on condition [0x00007ff91a002000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af3fa8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
at org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64)
at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"main-EventThread" #31 daemon prio=5 os_prio=0 tid=0x00007ff9d1458000 nid=0xe517 waiting on condition [0x00007ff91a103000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af3570> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:511)
"main-SendThread(10.64.101.144:22181)" #30 daemon prio=5 os_prio=0 tid=0x00007ff9d1478800 nid=0xe516 runnable [0x00007ff91a204000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000005c0af0ea8> (a sun.nio.ch.Util$2)
- locked <0x00000005c0af0e98> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000005c0af0a18> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1192)
"Curator-ConnectionStateManager-0" #29 daemon prio=5 os_prio=0 tid=0x00007ff9d144f000 nid=0xe512 waiting on condition [0x00007ff91a305000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c0af45e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
at org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
at org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
at org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"marathon-scheduler-1" #22 prio=5 os_prio=0 tid=0x00007ff9d0ffe000 nid=0xe4e3 sleeping[0x00007ff9281da000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at akka.actor.LightArrayRevolverScheduler.waitNanos(LightArrayRevolverScheduler.scala:85)
at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:266)
at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:236)
at java.lang.Thread.run(Thread.java:745)
"com.google.inject.internal.util.$Finalizer" #21 daemon prio=5 os_prio=0 tid=0x00007ff9d0c50000 nid=0xe47e in Object.wait() [0x00007ff9284db000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000005c05e50a8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00000005c05e50a8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at com.google.inject.internal.util.$Finalizer.run(Finalizer.java:114)
"AsyncAppender-Worker-async" #19 daemon prio=5 os_prio=0 tid=0x00007ff9d039e000 nid=0xe28e waiting on condition [0x00007ff990dc8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000005c007f608> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
at ch.qos.logback.core.AsyncAppenderBase$Worker.run(AsyncAppenderBase.java:264)
"Service Thread" #17 daemon prio=9 os_prio=0 tid=0x00007ff9d00ee000 nid=0xe183 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread11" #16 daemon prio=9 os_prio=0 tid=0x00007ff9d00eb000 nid=0xe182 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread10" #15 daemon prio=9 os_prio=0 tid=0x00007ff9d00e9000 nid=0xe181 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread9" #14 daemon prio=9 os_prio=0 tid=0x00007ff9d00e7000 nid=0xe180 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread8" #13 daemon prio=9 os_prio=0 tid=0x00007ff9d00e4800 nid=0xe17f waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread7" #12 daemon prio=9 os_prio=0 tid=0x00007ff9d00e2800 nid=0xe17e waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread6" #11 daemon prio=9 os_prio=0 tid=0x00007ff9d00e0800 nid=0xe17d waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread5" #10 daemon prio=9 os_prio=0 tid=0x00007ff9d00de000 nid=0xe17c waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread4" #9 daemon prio=9 os_prio=0 tid=0x00007ff9d00d4000 nid=0xe17b waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007ff9d00d2000 nid=0xe17a waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007ff9d00d0000 nid=0xe179 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007ff9d00ce000 nid=0xe178 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007ff9d00cb000 nid=0xe177 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007ff9d00c9800 nid=0xe176 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007ff9d0096800 nid=0xe175 in Object.wait() [0x00007ff992964000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00000005c00a62a0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007ff9d0092000 nid=0xe174 in Object.wait() [0x00007ff992a65000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
- locked <0x00000005c00a64b8> (a java.lang.ref.Reference$Lock)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
"VM Thread" os_prio=0 tid=0x00007ff9d008a000 nid=0xe173 runnable
"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007ff9d001f000 nid=0xe164 runnable
"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007ff9d0021000 nid=0xe165 runnable
"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007ff9d0022800 nid=0xe166 runnable
"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007ff9d0024800 nid=0xe167 runnable
"GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007ff9d0026000 nid=0xe168 runnable
"GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007ff9d0028000 nid=0xe169 runnable
"GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007ff9d0029800 nid=0xe16a runnable
"GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007ff9d002b800 nid=0xe16b runnable
"GC task thread#8 (ParallelGC)" os_prio=0 tid=0x00007ff9d002d000 nid=0xe16c runnable
"GC task thread#9 (ParallelGC)" os_prio=0 tid=0x00007ff9d002f000 nid=0xe16d runnable
"GC task thread#10 (ParallelGC)" os_prio=0 tid=0x00007ff9d0030800 nid=0xe16e runnable
"GC task thread#11 (ParallelGC)" os_prio=0 tid=0x00007ff9d0032800 nid=0xe16f runnable
"GC task thread#12 (ParallelGC)" os_prio=0 tid=0x00007ff9d0034000 nid=0xe170 runnable
"VM Periodic Task Thread" os_prio=0 tid=0x00007ff9d00f0800 nid=0xe185 waiting on condition
JNI global references: 463
Heap
PSYoungGen total 2732032K, used 2241282K [0x0000000715580000, 0x00000007c0000000, 0x00000007c0000000)
eden space 2670080K, 83% used [0x0000000715580000,0x000000079cd20b58,0x00000007b8500000)
from space 61952K, 34% used [0x00000007b8500000,0x00000007b9a20010,0x00000007bc180000)
to space 60928K, 0% used [0x00000007bc480000,0x00000007bc480000,0x00000007c0000000)
ParOldGen total 5592576K, used 2005795K [0x00000005c0000000, 0x0000000715580000, 0x0000000715580000)
object space 5592576K, 35% used [0x00000005c0000000,0x000000063a6c8df8,0x0000000715580000)
Metaspace used 95972K, capacity 96712K, committed 97280K, reserved 1134592K
class space used 12861K, capacity 13005K, committed 13056K, reserved 1048576K
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment