Skip to content

Instantly share code, notes, and snippets.

@ianmilligan1

ianmilligan1/k-means-error.txt

Created May 20, 2016 20:01
Show Gist options
  • Save ianmilligan1/bd712181a33e8bacf274917bc08ffd5a to your computer and use it in GitHub Desktop.
Save ianmilligan1/bd712181a33e8bacf274917bc08ffd5a to your computer and use it in GitHub Desktop.
Download ZIP
Raw
k-means-error.txt
This file has been truncated, but you can view the full file.
i2millig@camalon01:~$ spark-shell --jars ~/git/warcbase/target/warcbase-0.1.0-SNAPSHOT-fatjar.jar --num-executors 75 --executor-cores 5 --executor-memory 20G --driver-memory 10G
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.3.0
/_/
Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_91)
Type in expressions to have them evaluated.
Type :help for more information.
Spark context available as sc.
SQL context available as sqlContext.
scala> :paste
// Entering paste mode (ctrl-D to finish)
import org.warcbase.spark.rdd.RecordRDD._
import org.warcbase.spark.matchbox.{RecordLoader, ExtractClusters}
val recs=RecordLoader.loadArchives("/collections/webarchives/geocities/warcs/", sc)
.keepUrlPatterns(Set("http://geocities.com/EnchantedForest/.*".r))
val clusters = ExtractClusters(recs, sc)
.topNWords("GEO_ENCHANTED_FOREST_TOP_N", sc)
.computeLDA("GEO_ENCHANTED_FOREST_LDA", sc)
.saveSampleDocs("GEO_ENCHANTED_FOREST_LDA", sc)
// Exiting paste mode, now interpreting.
WARN BLAS - Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS
WARN BLAS - Failed to load implementation from: com.github.fommil.netlib.NativeRefBLAS
[Stage 20:========================================================>(8860 + 18) /[Stage 20:========================================================>(8861 + 17) /[Stage 20:======[Stage 20:=========================================================>(8875 + 3) / 8878]channel 3: open failed: administratively prohibited: open failed
channel 4: open failed: administratively prohibited: open failed
[Stage 20:=========================================================>(8876 + 2) / 8878]channel 6: open failed: administratively prohibited: open failed
[Stage 266:> (0 + 0) / 8878][Stage 267:> (0 + 0) / 8878][Stage 268:> (0 + 0) / 8878]ERROR YarnScheduler - Lost executor 21 on trantor21.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 3644.0 in stage 266.0 (TID 1999414, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 21 lost)
WARN TaskSetManager - Lost task 3432.0 in stage 266.0 (TID 1999354, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 21 lost)
WARN TaskSetManager - Lost task 3562.0 in stage 266.0 (TID 1999408, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 21 lost)
WARN TaskSetManager - Lost task 3654.0 in stage 266.0 (TID 1999446, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 21 lost)
WARN TaskSetManager - Lost task 2918.0 in stage 266.0 (TID 1998700, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 21 lost)
ERROR YarnScheduler - Lost executor 58 on trantor08.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 4607.0 in stage 266.0 (TID 2000928, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 58 lost)
WARN TaskSetManager - Lost task 2921.0 in stage 266.0 (TID 1997867, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 58 lost)
WARN TaskSetManager - Lost task 4854.0 in stage 266.0 (TID 2000938, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 58 lost)
WARN TaskSetManager - Lost task 4863.0 in stage 266.0 (TID 2000950, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 58 lost)
WARN TaskSetManager - Lost task 2924.0 in stage 266.0 (TID 1997869, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 58 lost)
ERROR LiveListenerBus - Dropping SparkListenerEvent because no remaining room in event queue. This likely means one of the SparkListeners is too slow and cannot keep up with the rate at which tasks are being started by the scheduler.
[Stage 266:(5973 + 302) / 8878][Stage 267:(84 + 33) / 8878][Stage 268:> (0 + 0) / 8878]ERROR YarnScheduler - Lost executor 59 on trantor08.umiacs.umd.edu: remote Akka client disassociated
[Stage 266:(5995 + 299) / 8878][Stage 267:(86 + 36) / 8878][Stage 268:> (0 + 0) / 8878]WARN TaskSetManager - Lost task 5832.0 in stage 266.0 (TID 2001998, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 59 lost)
WARN TaskSetManager - Lost task 2930.0 in stage 266.0 (TID 1998959, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 59 lost)
WARN TaskSetManager - Lost task 5906.0 in stage 266.0 (TID 2002072, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 59 lost)
WARN TaskSetManager - Lost task 6038.0 in stage 266.0 (TID 2002140, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 59 lost)
WARN TaskSetManager - Lost task 5012.0 in stage 266.0 (TID 2001299, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 59 lost)
[Stage 266:(6392 + 244) / 8878][Stage 267:(258 + 86) / 8878][Stage 268:> (0 + 0) / 8878]ERROR YarnScheduler - Lost executor 44 on trantor20.umiacs.umd.edu: remote Akka client disassociated
[Stage 266:(6401 + 244) / 8878][Stage 267:(273 + 86) / 8878][Stage 268:> (0 + 0) / 8878]WARN TaskSetManager - Lost task 7060.0 in stage 266.0 (TID 2002755, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 44 lost)
WARN TaskSetManager - Lost task 7032.0 in stage 266.0 (TID 2002689, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 44 lost)
WARN TaskSetManager - Lost task 6665.0 in stage 266.0 (TID 2002279, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 44 lost)
WARN TaskSetManager - Lost task 5008.0 in stage 266.0 (TID 2000918, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 44 lost)
WARN TaskSetManager - Lost task 5412.0 in stage 266.0 (TID 2001136, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 44 lost)
[Stage 266:(6401 + 239) / 8878][Stage 267:(273 + 86) / 8878][Stage 268:> (0 + 0) / 8878]WARN TaskSetManager - Lost task 5939.0 in stage 266.0 (TID 2000395, trantor21.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor21.umiacs.umd.edu/192.168.74.221:51629
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor21.umiacs.umd.edu/192.168.74.221:51629
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 266:(6515 + 232) / 8878][Stage 267:(421 + 93) / 8878][Stage 268:> (0 + 5) / 8878]ERROR YarnScheduler - Lost executor 42 on trantor20.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5007.0 in stage 266.0 (TID 2000883, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 42 lost)
WARN TaskSetManager - Lost task 5006.0 in stage 266.0 (TID 2000880, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 42 lost)
WARN TaskSetManager - Lost task 5934.0 in stage 266.0 (TID 2002572, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 42 lost)
WARN TaskSetManager - Lost task 2911.0 in stage 266.0 (TID 1999257, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 42 lost)
WARN TaskSetManager - Lost task 5702.0 in stage 266.0 (TID 2001649, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 42 lost)
[Stage 266:(6558 + 220) / 8878][Stage 267:(501 + 100) / 8878][Stage 268:> (0 + 5) / 8878]WARN TaskSetManager - Lost task 5011.0 in stage 266.0 (TID 2001349, trantor07.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor08.umiacs.umd.edu/192.168.74.208:40688
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor08.umiacs.umd.edu/192.168.74.208:40688
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 266:(6820 + 202) / 8878][Stage 267:(1047 + 111) / 8878][Stage 268:>(57 + 9) / 8878]ERROR YarnScheduler - Lost executor 11 on trantor22.umiacs.umd.edu: remote Akka client disassociated
[Stage 266:(6829 + 201) / 8878][Stage 267:(1060 + 112) / 8878][Stage 268:>(59 + 9) / 8878]WARN TaskSetManager - Lost task 5002.0 in stage 266.0 (TID 2001182, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 11 lost)
WARN TaskSetManager - Lost task 7633.0 in stage 266.0 (TID 2002649, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 11 lost)
WARN TaskSetManager - Lost task 8749.0 in stage 266.0 (TID 2003324, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 11 lost)
WARN TaskSetManager - Lost task 663.0 in stage 267.0 (TID 2003873, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 11 lost)
WARN TaskSetManager - Lost task 683.0 in stage 267.0 (TID 2003875, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 11 lost)
[Stage 266:(6937 + 179) / 8878][Stage 267:(1427 + 126) / 8878][Stage 268:(97 + 11) / 8878]WARN TaskSetManager - Lost task 6369.0 in stage 266.0 (TID 2002388, trantor20.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor20.umiacs.umd.edu/192.168.74.220:54705
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor20.umiacs.umd.edu/192.168.74.220:54705
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 266:(7185 + 161) / 8878][Stage 267:(2268 + 112) / 8878][Stage 268:(330 + 39) / 8878]WARN TaskSetManager - Lost task 30.0 in stage 268.0 (TID 2004061, trantor24.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor22.umiacs.umd.edu/192.168.74.222:45834
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor22.umiacs.umd.edu/192.168.74.222:45834
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
WARN TaskSetManager - Lost task 34.0 in stage 267.0 (TID 2004183, trantor07.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor22.umiacs.umd.edu/192.168.74.222:45834
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor22.umiacs.umd.edu/192.168.74.222:45834
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 266:(7714 + 102) / 8878][Stage 267:(5136 + 93) / 8878][Stage 268:(2473 + 54) / 8878]ERROR YarnScheduler - Lost executor 67 on trantor09.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 8530.0 in stage 266.0 (TID 2009499, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 67 lost)
WARN TaskSetManager - Lost task 7622.0 in stage 266.0 (TID 2006257, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 67 lost)
WARN TaskSetManager - Lost task 5988.0 in stage 266.0 (TID 2002939, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 67 lost)
WARN TaskSetManager - Lost task 8679.0 in stage 266.0 (TID 2015033, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 67 lost)
WARN TaskSetManager - Lost task 2910.0 in stage 266.0 (TID 1999218, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 67 lost)
[Stage 266:(7895 + 200) / 8878][Stage 267:(5739 + 72) / 8878][Stage 268:(3270 + 39) / 8878]WARN TaskSetManager - Lost task 6615.0 in stage 266.0 (TID 2020235, trantor02.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 266:(7903 + 205) / 8878][Stage 267:(5744 + 67) / 8878][Stage 268:(3270 + 39) / 8878]ERROR TaskSetManager - Task 6786 in stage 266.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5046.0 in stage 266.0 (TID 2019946, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5875.0 in stage 266.0 (TID 2020035, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5906.1 in stage 266.0 (TID 2018584, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6038.1 in stage 266.0 (TID 2018522, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5853.0 in stage 266.0 (TID 2019973, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5888.0 in stage 266.0 (TID 2020036, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.1 in stage 266.0 (TID 2019271, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5979.0 in stage 266.0 (TID 2020069, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.1 in stage 266.0 (TID 2019906, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6875.0 in stage 266.0 (TID 2020257, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5943.0 in stage 266.0 (TID 2020040, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5702.1 in stage 266.0 (TID 2018648, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5988.1 in stage 266.0 (TID 2018730, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5947.0 in stage 266.0 (TID 2020060, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8749.1 in stage 266.0 (TID 2018514, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5496.0 in stage 266.0 (TID 2019959, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6332.0 in stage 266.0 (TID 2020169, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6485.0 in stage 266.0 (TID 2020227, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6364.0 in stage 266.0 (TID 2020172, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5002.1 in stage 266.0 (TID 2018526, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6571.0 in stage 266.0 (TID 2020234, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6384.0 in stage 266.0 (TID 2020175, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5832.1 in stage 266.0 (TID 2018879, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6563.0 in stage 266.0 (TID 2020233, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5927.0 in stage 266.0 (TID 2020055, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 266.0 (TID 2001403, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6465.0 in stage 266.0 (TID 2020179, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.1 in stage 266.0 (TID 2018495, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5930.0 in stage 266.0 (TID 2020146, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6914.0 in stage 266.0 (TID 2020259, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7589.0 in stage 266.0 (TID 2013267, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6365.0 in stage 266.0 (TID 2020173, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(5744 + 74) / 8878][Stage 268:(3270 + 47) / 8878][Stage 269:(1848 + 26) / 8878]WARN TaskSetManager - Lost task 8709.0 in stage 266.0 (TID 2016807, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6616.0 in stage 266.0 (TID 2020236, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6843.0 in stage 266.0 (TID 2020253, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6721.0 in stage 266.0 (TID 2020242, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6157.0 in stage 266.0 (TID 2020156, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6837.0 in stage 266.0 (TID 2020252, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6084.0 in stage 266.0 (TID 2020150, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5935.0 in stage 266.0 (TID 2001571, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6685.0 in stage 266.0 (TID 2020240, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2930.1 in stage 266.0 (TID 2018593, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5472.0 in stage 266.0 (TID 2019958, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6527.0 in stage 266.0 (TID 2020230, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6320.0 in stage 266.0 (TID 2020168, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5660.0 in stage 266.0 (TID 2019966, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6665.1 in stage 266.0 (TID 2019908, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6305.0 in stage 266.0 (TID 2020166, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6368.0 in stage 266.0 (TID 2004401, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5931.0 in stage 266.0 (TID 2020147, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6274.0 in stage 266.0 (TID 2020164, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6429.0 in stage 266.0 (TID 2020178, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8448.0 in stage 266.0 (TID 2017514, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5907.0 in stage 266.0 (TID 2020038, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.1 in stage 266.0 (TID 2019905, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6964.0 in stage 266.0 (TID 2020265, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4966.0 in stage 266.0 (TID 2019944, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6528.0 in stage 266.0 (TID 2020231, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5961.0 in stage 266.0 (TID 2020148, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6658.0 in stage 266.0 (TID 2020238, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6639.0 in stage 266.0 (TID 2020237, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7633.1 in stage 266.0 (TID 2018520, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6516.0 in stage 266.0 (TID 2020229, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6386.0 in stage 266.0 (TID 2002738, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5975.0 in stage 266.0 (TID 2020149, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6378.0 in stage 266.0 (TID 2020174, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6533.0 in stage 266.0 (TID 2020232, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6232.0 in stage 266.0 (TID 2020159, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6438.0 in stage 266.0 (TID 2020224, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.1 in stage 266.0 (TID 2019907, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8679.1 in stage 266.0 (TID 2018515, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8655.0 in stage 266.0 (TID 2003737, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6282.0 in stage 266.0 (TID 2020165, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2909.0 in stage 266.0 (TID 1999886, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 266.0 (TID 1998677, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6915.0 in stage 266.0 (TID 2020263, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6338.0 in stage 266.0 (TID 2001628, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6879.0 in stage 266.0 (TID 2020258, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8637.0 in stage 266.0 (TID 2012358, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7622.1 in stage 266.0 (TID 2019294, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5923.0 in stage 266.0 (TID 2001112, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6510.0 in stage 266.0 (TID 2020228, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5501.0 in stage 266.0 (TID 2019960, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.0 in stage 266.0 (TID 1998093, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6825.0 in stage 266.0 (TID 2020251, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5771.0 in stage 266.0 (TID 2019971, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4914.0 in stage 266.0 (TID 2019941, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7032.1 in stage 266.0 (TID 2019909, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6330.0 in stage 266.0 (TID 2002837, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5122.0 in stage 266.0 (TID 2019950, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6213.0 in stage 266.0 (TID 2020158, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6355.0 in stage 266.0 (TID 2002199, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 266.0 (TID 2004641, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 266.0 (TID 2019948, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6272.0 in stage 266.0 (TID 2020163, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 266.0 (TID 2019947, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.1 in stage 266.0 (TID 2018500, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8680.0 in stage 266.0 (TID 2004723, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5937.0 in stage 266.0 (TID 2001030, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6100.0 in stage 266.0 (TID 2020152, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5615.0 in stage 266.0 (TID 2019964, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5752.0 in stage 266.0 (TID 2019968, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8731.0 in stage 266.0 (TID 2004594, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4436.0 in stage 266.0 (TID 2019930, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5955.0 in stage 266.0 (TID 1999060, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6106.0 in stage 266.0 (TID 2020154, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6418.0 in stage 266.0 (TID 2020177, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6730.0 in stage 266.0 (TID 2020243, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5791.0 in stage 266.0 (TID 2019972, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6339.0 in stage 266.0 (TID 2001750, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8694.0 in stage 266.0 (TID 2018914, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5755.0 in stage 266.0 (TID 2019969, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8652.0 in stage 266.0 (TID 2015973, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3562.1 in stage 266.0 (TID 2019913, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5904.0 in stage 266.0 (TID 2020037, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5357.0 in stage 266.0 (TID 2019953, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6257.0 in stage 266.0 (TID 2020162, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4955.0 in stage 266.0 (TID 2019943, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6189.0 in stage 266.0 (TID 2020157, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5527.0 in stage 266.0 (TID 2019962, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5509.0 in stage 266.0 (TID 2019961, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3666.0 in stage 266.0 (TID 2019916, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6356.0 in stage 266.0 (TID 2001687, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6345.0 in stage 266.0 (TID 2001054, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6095.0 in stage 266.0 (TID 2020151, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5197.0 in stage 266.0 (TID 2019952, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6369.1 in stage 266.0 (TID 2005405, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2922.0 in stage 266.0 (TID 1998752, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2928.0 in stage 266.0 (TID 1998314, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2919.0 in stage 266.0 (TID 1998292, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 266.0 (TID 2000291, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5745.0 in stage 266.0 (TID 2019967, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6101.0 in stage 266.0 (TID 2020153, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6731.0 in stage 266.0 (TID 2020244, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 266.0 (TID 2019949, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2917.0 in stage 266.0 (TID 1999565, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5431.0 in stage 266.0 (TID 2019955, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6670.0 in stage 266.0 (TID 2020239, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 266.0 (TID 2001472, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5445.0 in stage 266.0 (TID 2019956, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5377.0 in stage 266.0 (TID 2019954, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8487.0 in stage 266.0 (TID 2007457, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2923.0 in stage 266.0 (TID 1997940, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8532.0 in stage 266.0 (TID 2005502, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6615.3 in stage 266.0 (TID 2020262, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5461.0 in stage 266.0 (TID 2019957, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5581.0 in stage 266.0 (TID 2019963, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6382.0 in stage 266.0 (TID 2005693, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6329.0 in stage 266.0 (TID 2001618, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6739.0 in stage 266.0 (TID 2020245, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5939.1 in stage 266.0 (TID 2003378, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6468.0 in stage 266.0 (TID 2020225, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2929.0 in stage 266.0 (TID 1999467, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8662.0 in stage 266.0 (TID 2004332, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 266.0 (TID 1998991, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 266.0 (TID 2000630, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2926.0 in stage 266.0 (TID 1998831, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6335.0 in stage 266.0 (TID 2020170, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6313.0 in stage 266.0 (TID 2002493, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.1 in stage 266.0 (TID 2018496, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7060.1 in stage 266.0 (TID 2019910, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5938.0 in stage 266.0 (TID 2001367, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4968.0 in stage 266.0 (TID 2019945, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 266.0 (TID 2002560, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 266.0 (TID 1998735, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6362.0 in stage 266.0 (TID 2001666, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2915.0 in stage 266.0 (TID 1997698, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6385.0 in stage 266.0 (TID 2020176, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.0 in stage 266.0 (TID 2001236, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5758.0 in stage 266.0 (TID 2019970, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6367.0 in stage 266.0 (TID 2001421, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5991.0 in stage 266.0 (TID 2002431, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 266.0 (TID 1999003, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.0 in stage 266.0 (TID 1996904, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6474.0 in stage 266.0 (TID 2020226, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5363.0 in stage 266.0 (TID 1996914, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5936.0 in stage 266.0 (TID 2000979, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2911.1 in stage 266.0 (TID 2018726, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5503.0 in stage 266.0 (TID 2001990, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6151.0 in stage 266.0 (TID 2020155, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 266.0 (TID 1996486, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5502.0 in stage 266.0 (TID 2002112, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6783.0 in stage 266.0 (TID 2020247, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6239.0 in stage 266.0 (TID 2020160, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6381.0 in stage 266.0 (TID 2004679, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6711.0 in stage 266.0 (TID 2020241, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 266.0 (TID 2001333, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 266.0 (TID 2019951, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 266.0 (TID 2001385, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 266.0 (TID 2001387, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 266.0 (TID 1996728, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 266.0 (TID 2001481, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5950.0 in stage 266.0 (TID 2001711, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6855.0 in stage 266.0 (TID 2020254, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2912.0 in stage 266.0 (TID 1997656, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.1 in stage 266.0 (TID 2003836, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6318.0 in stage 266.0 (TID 2020167, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6361.0 in stage 266.0 (TID 2020171, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6254.0 in stage 266.0 (TID 2020161, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5948.0 in stage 266.0 (TID 2002342, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5934.1 in stage 266.0 (TID 2019903, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2931.0 in stage 266.0 (TID 1998707, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8665.0 in stage 266.0 (TID 2006060, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8481.0 in stage 266.0 (TID 2006757, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6366.0 in stage 266.0 (TID 2001569, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4704.0 in stage 266.0 (TID 2019936, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 266.0 (TID 2001454, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6009.0 in stage 266.0 (TID 2003113, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.1 in stage 266.0 (TID 2019911, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8624.0 in stage 266.0 (TID 2004560, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 266.0 (TID 2001459, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6340.0 in stage 266.0 (TID 2001438, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 266.0 (TID 2001490, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 266.0 (TID 2001353, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4865.0 in stage 266.0 (TID 2019939, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 266.0 (TID 1999138, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 266.0 (TID 2001501, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8616.0 in stage 266.0 (TID 2002762, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 266.0 (TID 2001486, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5919.0 in stage 266.0 (TID 2020039, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 266.0 (TID 2001772, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4402.0 in stage 266.0 (TID 2019929, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6774.0 in stage 266.0 (TID 2020246, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4883.0 in stage 266.0 (TID 2019940, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5648.0 in stage 266.0 (TID 2019965, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6965.0 in stage 266.0 (TID 2020266, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(5925 + 152) / 8878][Stage 268:(3326 + 70) / 8878][Stage 269:(1895 + 51) / 8878]WARN TaskSetManager - Lost task 4814.0 in stage 266.0 (TID 2019938, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(6121 + 149) / 8878][Stage 268:(3379 + 71) / 8878][Stage 269:(1956 + 50) / 8878]WARN TaskSetManager - Lost task 6804.1 in stage 266.0 (TID 2020261, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(6564 + 140) / 8878][Stage 268:(3537 + 78) / 8878][Stage 269:(2196 + 49) / 8878]ERROR YarnScheduler - Lost executor 15 on trantor14.umiacs.umd.edu: remote Akka client disassociated
[Stage 267:(6574 + 140) / 8878][Stage 268:(3540 + 78) / 8878][Stage 269:(2200 + 49) / 8878]WARN TaskSetManager - Lost task 2425.0 in stage 267.0 (TID 2021868, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 15 lost)
WARN TaskSetManager - Lost task 2692.0 in stage 267.0 (TID 2021951, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 15 lost)
WARN TaskSetManager - Lost task 2486.0 in stage 267.0 (TID 2021894, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 15 lost)
WARN TaskSetManager - Lost task 2690.0 in stage 267.0 (TID 2021929, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 15 lost)
WARN TaskSetManager - Lost task 2693.0 in stage 267.0 (TID 2021997, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 15 lost)
[Stage 267:(6713 + 133) / 8878][Stage 268:(3681 + 77) / 8878][Stage 269:(2270 + 48) / 8878]WARN TaskSetManager - Lost task 4715.0 in stage 266.0 (TID 2019937, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(6896 + 123) / 8878][Stage 268:(4061 + 77) / 8878][Stage 269:(2474 + 53) / 8878]WARN TaskSetManager - Lost task 591.0 in stage 273.0 (TID 2021856, trantor18.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor14.umiacs.umd.edu/192.168.74.214:47157
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor14.umiacs.umd.edu/192.168.74.214:47157
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 267:(6933 + 122) / 8878][Stage 268:(4210 + 75) / 8878][Stage 269:(2592 + 48) / 8878]WARN TaskSetManager - Lost task 8692.0 in stage 266.0 (TID 2019050, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(7291 + 111) / 8878][Stage 268:(4884 + 71) / 8878][Stage 269:(3230 + 47) / 8878]WARN TaskSetManager - Lost task 8530.1 in stage 266.0 (TID 2019902, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(7902 + 109) / 8878][Stage 268:(6364 + 69) / 8878][Stage 269:(4421 + 44) / 8878]WARN TaskSetManager - Lost task 5006.1 in stage 266.0 (TID 2019904, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 267:(8279 + 197) / 8878][Stage 268:(7144 + 38) / 8878][Stage 269:(5329 + 44) / 8878]WARN TaskSetManager - Lost task 5006.0 in stage 267.0 (TID 2054789, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 267:(8297 + 216) / 8878][Stage 268:(7287 + 33) / 8878][Stage 269:(5334 + 39) / 8878]WARN TaskSetManager - Lost task 6371.0 in stage 267.0 (TID 2056234, trantor10.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 267:(8299 + 222) / 8878][Stage 268:(7329 + 33) / 8878][Stage 269:(5336 + 37) / 8878]WARN TaskSetManager - Lost task 6371.3 in stage 267.0 (TID 2056287, trantor24.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
ERROR TaskSetManager - Task 6371 in stage 267.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 4955.0 in stage 267.0 (TID 2050333, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6501.0 in stage 267.0 (TID 2056126, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6384.0 in stage 267.0 (TID 2056189, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6522.0 in stage 267.0 (TID 2056190, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 267.0 (TID 2050363, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6232.0 in stage 267.0 (TID 2056090, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5377.0 in stage 267.0 (TID 2055803, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5809.0 in stage 267.0 (TID 2055882, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6123.0 in stage 267.0 (TID 2056052, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6423.0 in stage 267.0 (TID 2056239, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 267.0 (TID 2050005, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6163.0 in stage 267.0 (TID 2056084, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5421.0 in stage 267.0 (TID 2055808, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5724.0 in stage 267.0 (TID 2047126, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5913.0 in stage 267.0 (TID 2056002, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6524.0 in stage 267.0 (TID 2056194, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6438.0 in stage 267.0 (TID 2056245, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5494.0 in stage 267.0 (TID 2051973, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5372.0 in stage 267.0 (TID 2050820, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5758.0 in stage 267.0 (TID 2055876, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5745.0 in stage 267.0 (TID 2055832, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 267.0 (TID 2054771, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5746.0 in stage 267.0 (TID 2055844, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5280.0 in stage 267.0 (TID 2055797, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5702.0 in stage 267.0 (TID 2055830, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6018.0 in stage 267.0 (TID 2056012, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5549.0 in stage 267.0 (TID 2055818, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5943.0 in stage 267.0 (TID 2056006, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 267.0 (TID 2055819, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5288.0 in stage 267.0 (TID 2055798, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5807.0 in stage 267.0 (TID 2055881, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5679.0 in stage 267.0 (TID 2055829, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5499.0 in stage 267.0 (TID 2055811, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5752.0 in stage 267.0 (TID 2055874, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5445.0 in stage 267.0 (TID 2054758, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5853.0 in stage 267.0 (TID 2055889, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5663.0 in stage 267.0 (TID 2045683, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5765.0 in stage 267.0 (TID 2055877, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4949.0 in stage 267.0 (TID 2049853, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5907.0 in stage 267.0 (TID 2056001, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5341.0 in stage 267.0 (TID 2055800, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5947.0 in stage 267.0 (TID 2056007, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5508.0 in stage 267.0 (TID 2055813, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5927.0 in stage 267.0 (TID 2055943, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5906.0 in stage 267.0 (TID 2055930, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5897.0 in stage 267.0 (TID 2055929, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5701.0 in stage 267.0 (TID 2052122, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6318.0 in stage 267.0 (TID 2056187, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5722.0 in stage 267.0 (TID 2055840, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5526.0 in stage 267.0 (TID 2045499, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5597.0 in stage 267.0 (TID 2055823, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6403.0 in stage 267.0 (TID 2056279, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5581.0 in stage 267.0 (TID 2055822, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5060.0 in stage 267.0 (TID 2050435, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5845.0 in stage 267.0 (TID 2055888, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5833.0 in stage 267.0 (TID 2055885, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6365.0 in stage 267.0 (TID 2056233, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5840.0 in stage 267.0 (TID 2055886, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5850.0 in stage 267.0 (TID 2053877, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5734.0 in stage 267.0 (TID 2053871, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5333.0 in stage 267.0 (TID 2055799, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6361.0 in stage 267.0 (TID 2056231, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6378.0 in stage 267.0 (TID 2056235, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5138.0 in stage 267.0 (TID 2055796, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5129.0 in stage 267.0 (TID 2055505, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6335.0 in stage 267.0 (TID 2056230, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8709.0 in stage 267.0 (TID 2028401, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5352.0 in stage 267.0 (TID 2050803, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 267.0 (TID 2021138, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5895.0 in stage 267.0 (TID 2055928, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5576.0 in stage 267.0 (TID 2055821, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4951.0 in stage 267.0 (TID 2043590, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6320.0 in stage 267.0 (TID 2056188, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5934.0 in stage 267.0 (TID 2056004, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5355.0 in stage 267.0 (TID 2050807, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5888.0 in stage 267.0 (TID 2055900, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5527.0 in stage 267.0 (TID 2055815, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5942.0 in stage 267.0 (TID 2056005, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6396.0 in stage 267.0 (TID 2056238, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5419.0 in stage 267.0 (TID 2055807, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6315.0 in stage 267.0 (TID 2056061, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5472.0 in stage 267.0 (TID 2055809, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6038.0 in stage 267.0 (TID 2056043, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5496.0 in stage 267.0 (TID 2055810, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5439.0 in stage 267.0 (TID 2045227, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 267.0 (TID 2054823, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6332.0 in stage 267.0 (TID 2056214, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6152.0 in stage 267.0 (TID 2056080, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6272.0 in stage 267.0 (TID 2056060, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6416.0 in stage 267.0 (TID 2056288, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5717.0 in stage 267.0 (TID 2046580, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 267.0 (TID 2043864, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6146.0 in stage 267.0 (TID 2056015, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6085.0 in stage 267.0 (TID 2056045, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6092.0 in stage 267.0 (TID 2056046, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4995.0 in stage 267.0 (TID 2054743, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5112.0 in stage 267.0 (TID 2044354, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.0 in stage 267.0 (TID 2054834, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6095.0 in stage 267.0 (TID 2056047, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5985.0 in stage 267.0 (TID 2055890, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5342.0 in stage 267.0 (TID 2055801, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6364.0 in stage 267.0 (TID 2056232, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5033.0 in stage 267.0 (TID 2054835, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5875.0 in stage 267.0 (TID 2055898, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5142.0 in stage 267.0 (TID 2044899, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5740.0 in stage 267.0 (TID 2055843, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5988.0 in stage 267.0 (TID 2055956, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5046.0 in stage 267.0 (TID 2054971, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6274.0 in stage 267.0 (TID 2056180, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6133.0 in stage 267.0 (TID 2056077, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5501.0 in stage 267.0 (TID 2055812, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 267.0 (TID 2055817, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6101.0 in stage 267.0 (TID 2056049, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6192.0 in stage 267.0 (TID 2056169, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6529.0 in stage 267.0 (TID 2056280, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5403.0 in stage 267.0 (TID 2055805, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6007.0 in stage 267.0 (TID 2055931, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 267.0 (TID 2055285, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5002.0 in stage 267.0 (TID 2044296, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5567.0 in stage 267.0 (TID 2055820, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6254.0 in stage 267.0 (TID 2056173, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5930.0 in stage 267.0 (TID 2055949, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6009.0 in stage 267.0 (TID 2055932, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5796.0 in stage 267.0 (TID 2047263, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6239.0 in stage 267.0 (TID 2056171, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6215.0 in stage 267.0 (TID 2056170, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5961.0 in stage 267.0 (TID 2056008, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5842.0 in stage 267.0 (TID 2055887, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6282.0 in stage 267.0 (TID 2056097, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 267.0 (TID 2055274, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6106.0 in stage 267.0 (TID 2056050, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5769.0 in stage 267.0 (TID 2055878, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5919.0 in stage 267.0 (TID 2055905, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5832.0 in stage 267.0 (TID 2055884, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5212.0 in stage 267.0 (TID 2055587, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6305.0 in stage 267.0 (TID 2056181, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5713.0 in stage 267.0 (TID 2055831, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5822.0 in stage 267.0 (TID 2055883, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 267.0 (TID 2055816, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5993.0 in stage 267.0 (TID 2055415, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5502.0 in stage 267.0 (TID 2009496, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5791.0 in stage 267.0 (TID 2055880, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5615.0 in stage 267.0 (TID 2055825, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5931.0 in stage 267.0 (TID 2056003, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6327.0 in stage 267.0 (TID 2056063, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6129.0 in stage 267.0 (TID 2056058, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5747.0 in stage 267.0 (TID 2055873, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5399.0 in stage 267.0 (TID 2055804, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5999.0 in stage 267.0 (TID 2055845, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6002.0 in stage 267.0 (TID 2056011, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5648.0 in stage 267.0 (TID 2055826, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6151.0 in stage 267.0 (TID 2056079, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4991.0 in stage 267.0 (TID 2054724, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5197.0 in stage 267.0 (TID 2055531, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.0 in stage 267.0 (TID 2047121, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5509.0 in stage 267.0 (TID 2055814, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5697.0 in stage 267.0 (TID 2046340, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5660.0 in stage 267.0 (TID 2055827, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 267.0 (TID 2055496, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8731.0 in stage 267.0 (TID 2009056, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5739.0 in stage 267.0 (TID 2055842, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 267.0 (TID 2014225, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6148.0 in stage 267.0 (TID 2056078, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5890.0 in stage 267.0 (TID 2055901, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6100.0 in stage 267.0 (TID 2056048, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8694.0 in stage 267.0 (TID 2035570, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5881.0 in stage 267.0 (TID 2055899, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6019.0 in stage 267.0 (TID 2056013, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6029.0 in stage 267.0 (TID 2056014, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5503.0 in stage 267.0 (TID 2021524, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5755.0 in stage 267.0 (TID 2055875, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5431.0 in stage 267.0 (TID 2053400, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5975.0 in stage 267.0 (TID 2056009, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6382.0 in stage 267.0 (TID 2056215, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6189.0 in stage 267.0 (TID 2056168, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6084.0 in stage 267.0 (TID 2056044, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 267.0 (TID 2055806, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5810.0 in stage 267.0 (TID 2050184, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6159.0 in stage 267.0 (TID 2056082, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.0 in stage 267.0 (TID 2005935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6118.0 in stage 267.0 (TID 2056051, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6519.0 in stage 267.0 (TID 2056174, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.0 in stage 267.0 (TID 2047122, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6369.0 in stage 267.0 (TID 2020501, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.0 in stage 267.0 (TID 2010144, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5771.0 in stage 267.0 (TID 2055879, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 267.0 (TID 2005632, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 267.0 (TID 2006452, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6157.0 in stage 267.0 (TID 2056081, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 267.0 (TID 2020479, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8692.0 in stage 267.0 (TID 2032828, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6257.0 in stage 267.0 (TID 2056175, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 268:(7329 + 47) / 8878][Stage 269:(5336 + 46) / 8878][Stage 270:(4310 + 30) / 8878]WARN TaskSetManager - Lost task 6213.0 in stage 267.0 (TID 2056053, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5904.0 in stage 267.0 (TID 2055902, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 267.0 (TID 2054816, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5461.0 in stage 267.0 (TID 2055124, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6366.0 in stage 267.0 (TID 2020791, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6249.0 in stage 267.0 (TID 2056172, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6385.0 in stage 267.0 (TID 2056236, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5979.0 in stage 267.0 (TID 2056010, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 267.0 (TID 2017434, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2931.0 in stage 267.0 (TID 2006291, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 267.0 (TID 2004669, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6381.0 in stage 267.0 (TID 2028653, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 267.0 (TID 2005424, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 267.0 (TID 2005282, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2911.0 in stage 267.0 (TID 2047120, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5600.0 in stage 267.0 (TID 2055824, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5738.0 in stage 267.0 (TID 2055841, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6340.0 in stage 267.0 (TID 2006670, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 267.0 (TID 2007777, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 267.0 (TID 2007038, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5666.0 in stage 267.0 (TID 2055828, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 267.0 (TID 2006231, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 267.0 (TID 2007212, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 267.0 (TID 2004661, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 267.0 (TID 2005185, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 267.0 (TID 2004911, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5706.0 in stage 267.0 (TID 2053847, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6418.0 in stage 267.0 (TID 2056290, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 267.0 (TID 2005110, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6130.0 in stage 267.0 (TID 2056059, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6417.0 in stage 267.0 (TID 2056289, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 268:(7578 + 58) / 8878][Stage 269:(5868 + 79) / 8878][Stage 270:(4552 + 59) / 8878]WARN TaskSetManager - Lost task 6331.1 in stage 267.0 (TID 2056278, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 268:(7614 + 56) / 8878][Stage 269:(6089 + 79) / 8878][Stage 270:(4639 + 59) / 8878]ERROR YarnScheduler - Lost executor 24 on trantor21.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 8090.0 in stage 269.0 (TID 2057190, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 24 lost)
[Stage 268:(7614 + 56) / 8878][Stage 269:(6092 + 78) / 8878][Stage 270:(4639 + 59) / 8878]WARN TaskSetManager - Lost task 2919.0 in stage 270.0 (TID 2059209, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 24 lost)
WARN TaskSetManager - Lost task 3393.0 in stage 270.0 (TID 2059393, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 24 lost)
WARN TaskSetManager - Lost task 3451.0 in stage 270.0 (TID 2059425, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 24 lost)
WARN TaskSetManager - Lost task 3648.0 in stage 270.0 (TID 2059428, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 24 lost)
[Stage 268:(7631 + 55) / 8878][Stage 269:(6129 + 77) / 8878][Stage 270:(4658 + 55) / 8878]WARN TaskSetManager - Lost task 5006.1 in stage 267.0 (TID 2056076, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 268:(7837 + 79) / 8878][Stage 269:(6230 + 76) / 8878][Stage 270:(4746 + 49) / 8878]WARN TaskSetManager - Lost task 806.0 in stage 281.0 (TID 2059743, trantor24.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor21.umiacs.umd.edu/192.168.74.221:49213
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor21.umiacs.umd.edu/192.168.74.221:49213
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 268:(8070 + 90) / 8878][Stage 269:(6521 + 64) / 8878][Stage 270:(5018 + 40) / 8878]ERROR YarnScheduler - Lost executor 2 on trantor15.umiacs.umd.edu: remote Akka client disassociated
[Stage 268:(8070 + 90) / 8878][Stage 269:(6524 + 64) / 8878][Stage 270:(5018 + 40) / 8878]WARN TaskSetManager - Lost task 7519.0 in stage 269.0 (TID 2064960, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 2 lost)
WARN TaskSetManager - Lost task 7536.0 in stage 269.0 (TID 2064978, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 2 lost)
WARN TaskSetManager - Lost task 6366.0 in stage 269.0 (TID 2059603, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 2 lost)
WARN TaskSetManager - Lost task 5936.0 in stage 269.0 (TID 2059121, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 2 lost)
WARN TaskSetManager - Lost task 5940.0 in stage 269.0 (TID 2059159, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 2 lost)
[Stage 268:(8186 + 131) / 8878][Stage 269:(6551 + 57) / 8878][Stage 270:(5044 + 44) / 8878]WARN TaskSetManager - Lost task 1317.0 in stage 281.0 (TID 2065068, trantor24.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor15.umiacs.umd.edu/192.168.74.215:38248
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor15.umiacs.umd.edu/192.168.74.215:38248
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 268:(8259 + 173) / 8878][Stage 269:(6711 + 53) / 8878][Stage 270:(5169 + 36) / 8878]WARN TaskSetManager - Lost task 5006.0 in stage 268.0 (TID 2064801, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 268:(8305 + 204) / 8878][Stage 269:(6900 + 47) / 8878][Stage 270:(5316 + 33) / 8878]WARN TaskSetManager - Lost task 5006.1 in stage 268.0 (TID 2067051, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 268:(8317 + 207) / 8878][Stage 269:(6960 + 47) / 8878][Stage 270:(5359 + 31) / 8878]WARN TaskSetManager - Lost task 6332.0 in stage 268.0 (TID 2067562, trantor20.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 112409011)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 43 more
WARN TaskSetManager - Lost task 5934.0 in stage 268.0 (TID 2067053, trantor20.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 473651739)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 43 more
WARN TaskSetManager - Lost task 6403.0 in stage 268.0 (TID 2067624, trantor20.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 268:(8318 + 204) / 8878][Stage 269:(6962 + 50) / 8878][Stage 270:(5361 + 31) / 8878]WARN TaskSetManager - Lost task 6371.0 in stage 268.0 (TID 2067710, trantor09.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 268:(8320 + 201) / 8878][Stage 269:(6970 + 50) / 8878][Stage 270:(5374 + 33) / 8878]ERROR YarnScheduler - Lost executor 43 on trantor20.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6355.0 in stage 268.0 (TID 2056658, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 43 lost)
WARN TaskSetManager - Lost task 6369.0 in stage 268.0 (TID 2056766, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 43 lost)
WARN TaskSetManager - Lost task 2476.0 in stage 269.0 (TID 2067750, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 43 lost)
WARN TaskSetManager - Lost task 2496.0 in stage 269.0 (TID 2067752, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 43 lost)
WARN TaskSetManager - Lost task 2474.0 in stage 269.0 (TID 2067748, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 43 lost)
[Stage 268:(8328 + 199) / 8878][Stage 269:(6979 + 47) / 8878][Stage 270:(5406 + 31) / 8878]WARN TaskSetManager - Lost task 6371.3 in stage 268.0 (TID 2067952, trantor24.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
ERROR TaskSetManager - Task 6371 in stage 268.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5822.0 in stage 268.0 (TID 2066016, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6019.0 in stage 268.0 (TID 2067271, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6327.0 in stage 268.0 (TID 2067280, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6318.0 in stage 268.0 (TID 2067594, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5985.0 in stage 268.0 (TID 2066083, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5439.0 in stage 268.0 (TID 2061446, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6007.0 in stage 268.0 (TID 2067061, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6522.0 in stage 268.0 (TID 2067874, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6369.1 in stage 268.0 (TID 2067954, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6130.0 in stage 268.0 (TID 2067342, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6438.0 in stage 268.0 (TID 2067955, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5567.0 in stage 268.0 (TID 2065611, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5895.0 in stage 268.0 (TID 2064413, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5576.0 in stage 268.0 (TID 2065612, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 268.0 (TID 2065493, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6382.0 in stage 268.0 (TID 2067688, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5509.0 in stage 268.0 (TID 2065505, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6254.0 in stage 268.0 (TID 2067559, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6478.0 in stage 268.0 (TID 2067886, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6239.0 in stage 268.0 (TID 2067565, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6157.0 in stage 268.0 (TID 2067541, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5581.0 in stage 268.0 (TID 2065613, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6384.0 in stage 268.0 (TID 2067806, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6152.0 in stage 268.0 (TID 2067540, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5333.0 in stage 268.0 (TID 2065485, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5747.0 in stage 268.0 (TID 2065631, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6146.0 in stage 268.0 (TID 2067281, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5961.0 in stage 268.0 (TID 2067265, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6215.0 in stage 268.0 (TID 2067545, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5740.0 in stage 268.0 (TID 2065629, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5372.0 in stage 268.0 (TID 2065489, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5907.0 in stage 268.0 (TID 2067066, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6151.0 in stage 268.0 (TID 2067539, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5791.0 in stage 268.0 (TID 2066010, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 268.0 (TID 2063495, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5927.0 in stage 268.0 (TID 2067261, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6118.0 in stage 268.0 (TID 2067339, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5919.0 in stage 268.0 (TID 2067260, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5930.0 in stage 268.0 (TID 2067262, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5341.0 in stage 268.0 (TID 2065486, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5129.0 in stage 268.0 (TID 2065479, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6192.0 in stage 268.0 (TID 2067440, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5931.0 in stage 268.0 (TID 2067263, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4991.0 in stage 268.0 (TID 2065471, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6095.0 in stage 268.0 (TID 2067275, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6213.0 in stage 268.0 (TID 2067544, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5993.0 in stage 268.0 (TID 2066421, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6257.0 in stage 268.0 (TID 2067680, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6416.0 in stage 268.0 (TID 2067837, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6148.0 in stage 268.0 (TID 2067538, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6029.0 in stage 268.0 (TID 2067145, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 268.0 (TID 2065608, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4955.0 in stage 268.0 (TID 2065468, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5738.0 in stage 268.0 (TID 2065627, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6232.0 in stage 268.0 (TID 2067546, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 268.0 (TID 2065476, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6085.0 in stage 268.0 (TID 2067274, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5600.0 in stage 268.0 (TID 2065615, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6335.0 in stage 268.0 (TID 2067599, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5212.0 in stage 268.0 (TID 2065482, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6100.0 in stage 268.0 (TID 2067276, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6133.0 in stage 268.0 (TID 2067484, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5853.0 in stage 268.0 (TID 2066019, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5527.0 in stage 268.0 (TID 2065606, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5660.0 in stage 268.0 (TID 2065618, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6272.0 in stage 268.0 (TID 2067386, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5713.0 in stage 268.0 (TID 2065624, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6106.0 in stage 268.0 (TID 2067286, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5833.0 in stage 268.0 (TID 2061597, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6320.0 in stage 268.0 (TID 2067550, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5666.0 in stage 268.0 (TID 2065619, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 268.0 (TID 2065607, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5771.0 in stage 268.0 (TID 2066009, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8692.0 in stage 268.0 (TID 2051562, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6101.0 in stage 268.0 (TID 2067277, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5280.0 in stage 268.0 (TID 2065483, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6159.0 in stage 268.0 (TID 2067409, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5850.0 in stage 268.0 (TID 2066018, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5445.0 in stage 268.0 (TID 2065497, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5122.0 in stage 268.0 (TID 2065478, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5549.0 in stage 268.0 (TID 2065609, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6305.0 in stage 268.0 (TID 2067564, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8709.0 in stage 268.0 (TID 2061803, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5810.0 in stage 268.0 (TID 2066015, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6002.0 in stage 268.0 (TID 2067269, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5906.0 in stage 268.0 (TID 2067058, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6018.0 in stage 268.0 (TID 2067270, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5875.0 in stage 268.0 (TID 2066020, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5342.0 in stage 268.0 (TID 2065487, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5904.0 in stage 268.0 (TID 2066023, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5888.0 in stage 268.0 (TID 2066022, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2922.0 in stage 268.0 (TID 2061470, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 269:(6979 + 52) / 8878][Stage 270:(5407 + 47) / 8878][Stage 271:(4307 + 39) / 8878]WARN TaskSetManager - Lost task 5988.0 in stage 268.0 (TID 2067268, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5496.0 in stage 268.0 (TID 2065501, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5431.0 in stage 268.0 (TID 2065496, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5734.0 in stage 268.0 (TID 2065626, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5060.0 in stage 268.0 (TID 2064448, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5943.0 in stage 268.0 (TID 2067062, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5499.0 in stage 268.0 (TID 2065502, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5701.0 in stage 268.0 (TID 2065621, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.0 in stage 268.0 (TID 2061617, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6282.0 in stage 268.0 (TID 2067547, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5832.0 in stage 268.0 (TID 2065635, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.0 in stage 268.0 (TID 2064832, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5648.0 in stage 268.0 (TID 2065617, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5494.0 in stage 268.0 (TID 2065500, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5947.0 in stage 268.0 (TID 2067072, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5881.0 in stage 268.0 (TID 2066021, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 268.0 (TID 2064813, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 268.0 (TID 2065610, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.0 in stage 268.0 (TID 2056907, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6009.0 in stage 268.0 (TID 2067071, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6189.0 in stage 268.0 (TID 2067543, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6361.0 in stage 268.0 (TID 2067805, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5419.0 in stage 268.0 (TID 2065494, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5739.0 in stage 268.0 (TID 2065628, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6092.0 in stage 268.0 (TID 2067192, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4968.0 in stage 268.0 (TID 2065470, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6038.0 in stage 268.0 (TID 2067272, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6123.0 in stage 268.0 (TID 2067340, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 268.0 (TID 2065475, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5942.0 in stage 268.0 (TID 2067264, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5403.0 in stage 268.0 (TID 2065492, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 268.0 (TID 2065473, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6501.0 in stage 268.0 (TID 2067556, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6274.0 in stage 268.0 (TID 2067681, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 268.0 (TID 2065477, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.0 in stage 268.0 (TID 2032421, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8680.0 in stage 268.0 (TID 2063053, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5002.0 in stage 268.0 (TID 2061429, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5706.0 in stage 268.0 (TID 2065623, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5890.0 in stage 268.0 (TID 2063830, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5746.0 in stage 268.0 (TID 2065630, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5472.0 in stage 268.0 (TID 2065499, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6163.0 in stage 268.0 (TID 2067542, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5508.0 in stage 268.0 (TID 2065504, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6129.0 in stage 268.0 (TID 2067341, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5765.0 in stage 268.0 (TID 2066008, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5758.0 in stage 268.0 (TID 2065633, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5702.0 in stage 268.0 (TID 2065622, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6519.0 in stage 268.0 (TID 2067683, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 268.0 (TID 2020455, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5615.0 in stage 268.0 (TID 2065616, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5913.0 in stage 268.0 (TID 2065692, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5717.0 in stage 268.0 (TID 2061498, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8637.0 in stage 268.0 (TID 2064167, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5526.0 in stage 268.0 (TID 2061462, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.0 in stage 268.0 (TID 2061383, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8665.0 in stage 268.0 (TID 2056942, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5724.0 in stage 268.0 (TID 2061510, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5897.0 in stage 268.0 (TID 2065545, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6249.0 in stage 268.0 (TID 2067679, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5377.0 in stage 268.0 (TID 2065490, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6381.0 in stage 268.0 (TID 2043594, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6362.0 in stage 268.0 (TID 2056509, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8694.0 in stage 268.0 (TID 2067343, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5503.0 in stage 268.0 (TID 2035386, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6315.0 in stage 268.0 (TID 2067182, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6368.0 in stage 268.0 (TID 2060243, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6366.0 in stage 268.0 (TID 2051274, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5809.0 in stage 268.0 (TID 2066014, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.0 in stage 268.0 (TID 2063583, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.0 in stage 268.0 (TID 2061612, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5979.0 in stage 268.0 (TID 2067267, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8655.0 in stage 268.0 (TID 2061959, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5840.0 in stage 268.0 (TID 2066017, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5769.0 in stage 268.0 (TID 2065634, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5752.0 in stage 268.0 (TID 2065632, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5845.0 in stage 268.0 (TID 2065637, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 268.0 (TID 2008878, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 268.0 (TID 2031698, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 268.0 (TID 2042145, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 268.0 (TID 2018661, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5363.0 in stage 268.0 (TID 2032481, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6084.0 in stage 268.0 (TID 2067273, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5502.0 in stage 268.0 (TID 2025099, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 268.0 (TID 2032437, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5755.0 in stage 268.0 (TID 2066007, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 268.0 (TID 2009028, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5975.0 in stage 268.0 (TID 2067266, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 268.0 (TID 2016028, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5842.0 in stage 268.0 (TID 2065636, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5807.0 in stage 268.0 (TID 2066013, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 268.0 (TID 2019528, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 268.0 (TID 2018629, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 268.0 (TID 2010207, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 268.0 (TID 2008890, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2931.0 in stage 268.0 (TID 2017160, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 268.0 (TID 2013164, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5999.0 in stage 268.0 (TID 2066431, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 268.0 (TID 2009687, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 268.0 (TID 2010776, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 268.0 (TID 2012887, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5288.0 in stage 268.0 (TID 2065484, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 269:(7069 + 69) / 8878][Stage 270:(5512 + 62) / 8878][Stage 271:(4389 + 59) / 8878]WARN TaskSetManager - Lost task 5399.0 in stage 268.0 (TID 2065491, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 269:(7196 + 66) / 8878][Stage 270:(5687 + 65) / 8878][Stage 271:(4453 + 48) / 8878]WARN TaskSetManager - Lost task 1310.0 in stage 274.0 (TID 2067770, trantor02.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor20.umiacs.umd.edu/192.168.74.220:33766
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor20.umiacs.umd.edu/192.168.74.220:33766
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 269:(7285 + 65) / 8878][Stage 270:(5828 + 66) / 8878][Stage 271:(4479 + 46) / 8878]WARN TaskSetManager - Lost task 6331.1 in stage 268.0 (TID 2067953, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 269:(7545 + 79) / 8878][Stage 270:(6068 + 60) / 8878][Stage 271:(4607 + 44) / 8878]ERROR YarnScheduler - Lost executor 46 on trantor07.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5011.0 in stage 271.0 (TID 2061190, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 46 lost)
WARN TaskSetManager - Lost task 4756.0 in stage 272.0 (TID 2071626, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 46 lost)
WARN TaskSetManager - Lost task 4888.0 in stage 272.0 (TID 2071631, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 46 lost)
WARN TaskSetManager - Lost task 2925.0 in stage 272.0 (TID 2070629, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 46 lost)
WARN TaskSetManager - Lost task 4712.0 in stage 272.0 (TID 2071621, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 46 lost)
[Stage 269:(7690 + 91) / 8878][Stage 270:(6102 + 57) / 8878][Stage 271:(4652 + 43) / 8878]ERROR YarnScheduler - Lost executor 13 on trantor14.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 3846.0 in stage 269.0 (TID 2072291, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 13 lost)
WARN TaskSetManager - Lost task 5992.0 in stage 270.0 (TID 2069733, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 13 lost)
WARN TaskSetManager - Lost task 5932.0 in stage 270.0 (TID 2069451, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 13 lost)
WARN TaskSetManager - Lost task 6602.0 in stage 270.0 (TID 2070258, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 13 lost)
WARN TaskSetManager - Lost task 6601.0 in stage 270.0 (TID 2070179, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 13 lost)
[Stage 269:(7719 + 88) / 8878][Stage 270:(6136 + 50) / 8878][Stage 271:(4776 + 45) / 8878]WARN TaskSetManager - Lost task 1541.0 in stage 281.0 (TID 2072338, trantor24.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor14.umiacs.umd.edu/192.168.74.214:40322
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor14.umiacs.umd.edu/192.168.74.214:40322
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 269:(7721 + 87) / 8878][Stage 270:(6136 + 50) / 8878][Stage 271:(4777 + 45) / 8878]WARN TaskSetManager - Lost task 4198.0 in stage 269.0 (TID 2072343, trantor14.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor14.umiacs.umd.edu/192.168.74.214:40322
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor14.umiacs.umd.edu/192.168.74.214:40322
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 269:(7739 + 80) / 8878][Stage 270:(6149 + 50) / 8878][Stage 271:(4834 + 44) / 8878]ERROR YarnScheduler - Lost executor 65 on trantor09.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 8288.0 in stage 269.0 (TID 2071140, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 65 lost)
WARN TaskSetManager - Lost task 6345.0 in stage 269.0 (TID 2070341, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 65 lost)
WARN TaskSetManager - Lost task 8680.0 in stage 269.0 (TID 2072628, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 65 lost)
WARN TaskSetManager - Lost task 2914.0 in stage 269.0 (TID 2068851, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 65 lost)
WARN TaskSetManager - Lost task 8655.0 in stage 269.0 (TID 2071435, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 65 lost)
[Stage 269:(8140 + 109) / 8878][Stage 270:(6654 + 92) / 8878][Stage 271:(5175 + 31) / 8878]ERROR YarnScheduler - Lost executor 33 on trantor04.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6381.0 in stage 269.0 (TID 2063626, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 33 lost)
WARN TaskSetManager - Lost task 8692.0 in stage 269.0 (TID 2067410, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 33 lost)
WARN TaskSetManager - Lost task 8692.0 in stage 270.0 (TID 2075929, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 33 lost)
WARN TaskSetManager - Lost task 1437.0 in stage 270.0 (TID 2076132, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 33 lost)
WARN TaskSetManager - Lost task 1741.0 in stage 271.0 (TID 2075960, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 33 lost)
[Stage 269:(8158 + 104) / 8878][Stage 270:(6874 + 104) / 8878][Stage 271:(5175 + 30) / 8878]WARN TaskSetManager - Lost task 5006.2 in stage 268.0 (TID 2067585, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 269:(8164 + 105) / 8878][Stage 270:(6914 + 105) / 8878][Stage 271:(5175 + 30) / 8878]WARN TaskSetManager - Lost task 5706.0 in stage 269.0 (TID 2076119, trantor09.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 269:(8164 + 105) / 8878][Stage 270:(6915 + 105) / 8878][Stage 271:(5175 + 30) / 8878]WARN TaskSetManager - Lost task 5494.0 in stage 269.0 (TID 2075919, trantor09.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 512351831)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
[Stage 269:(8171 + 105) / 8878][Stage 270:(6929 + 107) / 8878][Stage 271:(5175 + 30) / 8878]ERROR YarnScheduler - Lost executor 66 on trantor09.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 2914.1 in stage 269.0 (TID 2073564, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 66 lost)
WARN TaskSetManager - Lost task 5706.1 in stage 269.0 (TID 2076596, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 66 lost)
WARN TaskSetManager - Lost task 5734.0 in stage 269.0 (TID 2076595, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 66 lost)
WARN TaskSetManager - Lost task 5701.1 in stage 269.0 (TID 2076597, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 66 lost)
WARN TaskSetManager - Lost task 5938.0 in stage 270.0 (TID 2070089, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 66 lost)
[Stage 269:(8203 + 107) / 8878][Stage 270:(7066 + 105) / 8878][Stage 271:(5191 + 35) / 8878]ERROR YarnScheduler - Lost executor 23 on trantor21.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6330.0 in stage 269.0 (TID 2070271, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 23 lost)
WARN TaskSetManager - Lost task 8694.0 in stage 269.0 (TID 2076632, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 23 lost)
WARN TaskSetManager - Lost task 8637.0 in stage 269.0 (TID 2073867, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 23 lost)
WARN TaskSetManager - Lost task 2909.0 in stage 269.0 (TID 2068881, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 23 lost)
WARN TaskSetManager - Lost task 6368.0 in stage 269.0 (TID 2071369, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 23 lost)
[Stage 269:(8211 + 104) / 8878][Stage 270:(7105 + 112) / 8878][Stage 271:(5196 + 30) / 8878]WARN TaskSetManager - Lost task 1409.0 in stage 274.0 (TID 2076675, trantor00.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 89496695)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
WARN TaskSetManager - Lost task 3116.0 in stage 270.0 (TID 2076763, trantor00.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
WARN TaskSetManager - Lost task 1450.0 in stage 272.0 (TID 2076712, trantor00.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 79633450)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
WARN TaskSetManager - Lost task 3427.0 in stage 270.0 (TID 2076862, trantor00.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 28761490)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
[Stage 269:(8214 + 104) / 8878][Stage 270:(7125 + 116) / 8878][Stage 271:(5196 + 30) / 8878]ERROR YarnScheduler - Lost executor 74 on trantor00.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 3620.0 in stage 270.0 (TID 2076931, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 74 lost)
WARN TaskSetManager - Lost task 3116.1 in stage 270.0 (TID 2076934, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 74 lost)
WARN TaskSetManager - Lost task 3624.0 in stage 270.0 (TID 2076933, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 74 lost)
WARN TaskSetManager - Lost task 3427.1 in stage 270.0 (TID 2076935, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 74 lost)
WARN TaskSetManager - Lost task 3622.0 in stage 270.0 (TID 2076932, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 74 lost)
[Stage 269:(8216 + 110) / 8878][Stage 270:(7167 + 115) / 8878][Stage 271:(5198 + 28) / 8878]WARN TaskSetManager - Lost task 3425.0 in stage 270.0 (TID 2076860, trantor03.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor21.umiacs.umd.edu/192.168.74.221:53037
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor21.umiacs.umd.edu/192.168.74.221:53037
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 269:(8216 + 110) / 8878][Stage 270:(7169 + 115) / 8878][Stage 271:(5198 + 28) / 8878]WARN TaskSetManager - Lost task 2914.2 in stage 269.0 (TID 2076854, trantor09.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor21.umiacs.umd.edu/192.168.74.221:53037
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor21.umiacs.umd.edu/192.168.74.221:53037
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 269:(8235 + 152) / 8878][Stage 270:(7331 + 92) / 8878][Stage 271:(5199 + 27) / 8878]WARN TaskSetManager - Lost task 5006.0 in stage 269.0 (TID 2076786, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 269:(8250 + 159) / 8878][Stage 270:(7383 + 93) / 8878][Stage 271:(5200 + 26) / 8878]ERROR YarnScheduler - Lost executor 47 on trantor07.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 2916.0 in stage 270.0 (TID 2063176, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 47 lost)
WARN TaskSetManager - Lost task 2920.0 in stage 271.0 (TID 2072101, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 47 lost)
WARN TaskSetManager - Lost task 2916.0 in stage 271.0 (TID 2072099, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 47 lost)
[Stage 269:(8250 + 159) / 8878][Stage 270:(7385 + 92) / 8878][Stage 271:(5200 + 24) / 8878]WARN TaskSetManager - Lost task 2916.0 in stage 272.0 (TID 2075634, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 47 lost)
WARN TaskSetManager - Lost task 2920.0 in stage 272.0 (TID 2075640, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 47 lost)
[Stage 269:(8261 + 177) / 8878][Stage 270:(7440 + 83) / 8878][Stage 271:(5208 + 25) / 8878]WARN TaskSetManager - Lost task 6009.0 in stage 269.0 (TID 2077349, trantor14.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
WARN TaskSetManager - Lost task 5999.0 in stage 269.0 (TID 2077292, trantor14.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 91495641)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
WARN TaskSetManager - Lost task 6007.0 in stage 269.0 (TID 2077329, trantor14.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 63257763)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 43 more
[Stage 269:(8262 + 178) / 8878][Stage 270:(7448 + 81) / 8878][Stage 271:(5208 + 26) / 8878]ERROR YarnScheduler - Lost executor 14 on trantor14.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5999.1 in stage 269.0 (TID 2077415, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 14 lost)
WARN TaskSetManager - Lost task 6007.1 in stage 269.0 (TID 2077418, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 14 lost)
WARN TaskSetManager - Lost task 6315.0 in stage 269.0 (TID 2077412, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 14 lost)
WARN TaskSetManager - Lost task 6009.1 in stage 269.0 (TID 2077414, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 14 lost)
WARN TaskSetManager - Lost task 6327.0 in stage 269.0 (TID 2077416, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 14 lost)
[Stage 269:(8267 + 186) / 8878][Stage 270:(7497 + 68) / 8878][Stage 271:(5220 + 28) / 8878]WARN TaskSetManager - Lost task 5006.1 in stage 269.0 (TID 2077254, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 269:(8274 + 205) / 8878][Stage 270:(7568 + 70) / 8878][Stage 271:(5227 + 26) / 8878]WARN TaskSetManager - Lost task 6331.0 in stage 269.0 (TID 2077547, trantor14.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 269:(8280 + 214) / 8878][Stage 270:(7593 + 64) / 8878][Stage 271:(5228 + 28) / 8878]WARN TaskSetManager - Lost task 6371.0 in stage 269.0 (TID 2077674, trantor07.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 269:(8289 + 218) / 8878][Stage 270:(7607 + 59) / 8878][Stage 271:(5252 + 29) / 8878]WARN TaskSetManager - Lost task 6331.1 in stage 269.0 (TID 2077650, trantor16.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 269:(8289 + 217) / 8878][Stage 270:(7608 + 59) / 8878][Stage 271:(5260 + 28) / 8878]ERROR TaskSetManager - Task 6371 in stage 269.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 8637.1 in stage 269.0 (TID 2076957, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5904.0 in stage 269.0 (TID 2077282, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5771.0 in stage 269.0 (TID 2077230, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5740.0 in stage 269.0 (TID 2077202, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5509.0 in stage 269.0 (TID 2077118, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8869.0 in stage 269.0 (TID 2077286, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6522.0 in stage 269.0 (TID 2076703, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6192.0 in stage 269.0 (TID 2077599, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5934.0 in stage 269.0 (TID 2077345, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5822.0 in stage 269.0 (TID 2077277, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5567.0 in stage 269.0 (TID 2077162, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5496.0 in stage 269.0 (TID 2077114, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6100.0 in stage 269.0 (TID 2077615, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6129.0 in stage 269.0 (TID 2077580, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5472.0 in stage 269.0 (TID 2077087, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6392.0 in stage 269.0 (TID 2077716, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6378.0 in stage 269.0 (TID 2077675, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6385.0 in stage 269.0 (TID 2077714, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5501.0 in stage 269.0 (TID 2077116, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5853.0 in stage 269.0 (TID 2077326, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5940.1 in stage 269.0 (TID 2065509, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6215.0 in stage 269.0 (TID 2077641, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5618.0 in stage 269.0 (TID 2077170, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6364.0 in stage 269.0 (TID 2077660, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5026.0 in stage 269.0 (TID 2076844, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6189.0 in stage 269.0 (TID 2077640, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6007.2 in stage 269.0 (TID 2077519, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6038.0 in stage 269.0 (TID 2077461, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8066.0 in stage 269.0 (TID 2072607, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5752.0 in stage 269.0 (TID 2077206, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6305.0 in stage 269.0 (TID 2077653, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5834.0 in stage 269.0 (TID 2077322, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6152.0 in stage 269.0 (TID 2075521, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 269.0 (TID 2077124, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5845.0 in stage 269.0 (TID 2077325, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6320.0 in stage 269.0 (TID 2077655, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6254.0 in stage 269.0 (TID 2077645, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6123.0 in stage 269.0 (TID 2077570, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7112.0 in stage 269.0 (TID 2077613, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5432.0 in stage 269.0 (TID 2077085, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6416.0 in stage 269.0 (TID 2077718, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5796.1 in stage 269.0 (TID 2077522, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5508.0 in stage 269.0 (TID 2077117, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6365.0 in stage 269.0 (TID 2077661, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6501.0 in stage 269.0 (TID 2076699, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5774.0 in stage 269.0 (TID 2077219, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5600.0 in stage 269.0 (TID 2077167, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6257.0 in stage 269.0 (TID 2077646, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5527.0 in stage 269.0 (TID 2077120, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5576.0 in stage 269.0 (TID 2077163, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6374.0 in stage 269.0 (TID 2077711, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5747.0 in stage 269.0 (TID 2077204, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6157.0 in stage 269.0 (TID 2077639, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5581.0 in stage 269.0 (TID 2077126, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6519.0 in stage 269.0 (TID 2076701, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5566.0 in stage 269.0 (TID 2077161, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6118.0 in stage 269.0 (TID 2077543, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5333.0 in stage 269.0 (TID 2077051, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4992.0 in stage 269.0 (TID 2076785, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6403.0 in stage 269.0 (TID 2077717, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5975.0 in stage 269.0 (TID 2077524, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5809.0 in stage 269.0 (TID 2077276, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6418.0 in stage 269.0 (TID 2077720, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5961.0 in stage 269.0 (TID 2077523, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5919.0 in stage 269.0 (TID 2077341, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5702.0 in stage 269.0 (TID 2077197, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5927.0 in stage 269.0 (TID 2077342, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6029.1 in stage 269.0 (TID 2077521, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5739.0 in stage 269.0 (TID 2077201, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6101.0 in stage 269.0 (TID 2077617, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 269.0 (TID 2077122, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6019.0 in stage 269.0 (TID 2077361, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5769.0 in stage 269.0 (TID 2077256, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5758.0 in stage 269.0 (TID 2077253, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6315.1 in stage 269.0 (TID 2077518, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5875.0 in stage 269.0 (TID 2077327, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5979.0 in stage 269.0 (TID 2077419, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6327.1 in stage 269.0 (TID 2077516, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5648.0 in stage 269.0 (TID 2077171, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5791.0 in stage 269.0 (TID 2077245, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6375.0 in stage 269.0 (TID 2077712, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5999.2 in stage 269.0 (TID 2077520, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5807.0 in stage 269.0 (TID 2077275, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6130.0 in stage 269.0 (TID 2077637, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6018.0 in stage 269.0 (TID 2077279, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6146.0 in stage 269.0 (TID 2077394, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5750.0 in stage 269.0 (TID 2077205, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5380.0 in stage 269.0 (TID 2076967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4974.0 in stage 269.0 (TID 2076774, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5993.0 in stage 269.0 (TID 2077258, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5399.0 in stage 269.0 (TID 2077053, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5810.0 in stage 269.0 (TID 2077231, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6151.0 in stage 269.0 (TID 2077638, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6335.0 in stage 269.0 (TID 2077657, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5461.0 in stage 269.0 (TID 2077086, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5087.0 in stage 269.0 (TID 2076878, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.0 in stage 269.0 (TID 2076829, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5660.0 in stage 269.0 (TID 2077194, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5335.0 in stage 269.0 (TID 2076889, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5906.0 in stage 269.0 (TID 2077339, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5988.0 in stage 269.0 (TID 2077125, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5666.0 in stage 269.0 (TID 2077195, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5377.0 in stage 269.0 (TID 2077079, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6057.0 in stage 269.0 (TID 2077538, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6084.0 in stage 269.0 (TID 2077541, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5930.0 in stage 269.0 (TID 2077343, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6897.0 in stage 269.0 (TID 2077405, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6382.0 in stage 269.0 (TID 2077548, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6009.2 in stage 269.0 (TID 2077517, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6529.0 in stage 269.0 (TID 2076953, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5409.0 in stage 269.0 (TID 2077081, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6846.0 in stage 269.0 (TID 2077330, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6318.0 in stage 269.0 (TID 2077654, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6361.0 in stage 269.0 (TID 2077659, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6396.0 in stage 269.0 (TID 2077549, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6002.0 in stage 269.0 (TID 2077128, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6330.1 in stage 269.0 (TID 2077002, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6369.0 in stage 269.0 (TID 2077673, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5765.0 in stage 269.0 (TID 2076982, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8694.1 in stage 269.0 (TID 2077001, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6423.0 in stage 269.0 (TID 2077550, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7126.0 in stage 269.0 (TID 2077733, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6095.0 in stage 269.0 (TID 2077569, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5481.0 in stage 269.0 (TID 2077088, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6552.0 in stage 269.0 (TID 2077648, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5616.0 in stage 269.0 (TID 2077169, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 269.0 (TID 2077121, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5280.0 in stage 269.0 (TID 2076994, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6534.0 in stage 269.0 (TID 2077551, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6272.0 in stage 269.0 (TID 2077647, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2909.1 in stage 269.0 (TID 2076918, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 269.0 (TID 2077004, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5931.0 in stage 269.0 (TID 2077344, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5212.0 in stage 269.0 (TID 2076939, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 269.0 (TID 2075623, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5850.0 in stage 269.0 (TID 2077235, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6417.0 in stage 269.0 (TID 2077719, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5840.0 in stage 269.0 (TID 2077323, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6061.0 in stage 269.0 (TID 2077539, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.0 in stage 269.0 (TID 2055269, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5499.0 in stage 269.0 (TID 2077115, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8680.1 in stage 269.0 (TID 2075886, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 270:(7608 + 74) / 8878][Stage 271:(5260 + 44) / 8878][Stage 272:(4927 + 48) / 8878]WARN TaskSetManager - Lost task 5881.0 in stage 269.0 (TID 2077328, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5943.0 in stage 269.0 (TID 2077347, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5942.0 in stage 269.0 (TID 2077346, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5579.0 in stage 269.0 (TID 2077164, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6872.0 in stage 269.0 (TID 2077360, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6384.0 in stage 269.0 (TID 2077713, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6006.0 in stage 269.0 (TID 2077536, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5467.0 in stage 269.0 (TID 2076868, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5888.0 in stage 269.0 (TID 2077338, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6159.0 in stage 269.0 (TID 2077525, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5793.0 in stage 269.0 (TID 2077274, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6274.0 in stage 269.0 (TID 2077651, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 269.0 (TID 2050675, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5755.0 in stage 269.0 (TID 2077207, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8709.0 in stage 269.0 (TID 2074952, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5717.0 in stage 269.0 (TID 2072041, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6868.0 in stage 269.0 (TID 2077358, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 269.0 (TID 2020184, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5431.0 in stage 269.0 (TID 2077005, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5445.0 in stage 269.0 (TID 2077060, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6077.0 in stage 269.0 (TID 2077540, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5832.0 in stage 269.0 (TID 2077321, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5346.0 in stage 269.0 (TID 2076893, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6524.0 in stage 269.0 (TID 2076919, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6025.0 in stage 269.0 (TID 2077537, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5738.0 in stage 269.0 (TID 2077200, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 269.0 (TID 2077082, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6332.0 in stage 269.0 (TID 2077656, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6213.0 in stage 269.0 (TID 2077438, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5419.0 in stage 269.0 (TID 2077083, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5823.0 in stage 269.0 (TID 2077278, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6282.0 in stage 269.0 (TID 2077652, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6381.1 in stage 269.0 (TID 2076304, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6366.1 in stage 269.0 (TID 2065511, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6893.0 in stage 269.0 (TID 2077374, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5706.2 in stage 269.0 (TID 2076853, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5985.0 in stage 269.0 (TID 2077018, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5746.0 in stage 269.0 (TID 2076855, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6106.0 in stage 269.0 (TID 2077636, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5734.1 in stage 269.0 (TID 2076852, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6232.0 in stage 269.0 (TID 2077642, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5907.0 in stage 269.0 (TID 2077340, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6239.0 in stage 269.0 (TID 2077643, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.3 in stage 269.0 (TID 2077050, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 269.0 (TID 2032404, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6485.0 in stage 269.0 (TID 2077744, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8832.0 in stage 269.0 (TID 2077250, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5701.2 in stage 269.0 (TID 2076851, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.0 in stage 269.0 (TID 2047073, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7083.0 in stage 269.0 (TID 2077578, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 269.0 (TID 2063438, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5713.0 in stage 269.0 (TID 2077198, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6429.0 in stage 269.0 (TID 2077730, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 269.0 (TID 2015776, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 269.0 (TID 2033354, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6436.0 in stage 269.0 (TID 2077731, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5403.0 in stage 269.0 (TID 2077080, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6249.0 in stage 269.0 (TID 2077644, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 269.0 (TID 2024545, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 269.0 (TID 2016458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 270:(7610 + 78) / 8878][Stage 271:(5261 + 51) / 8878][Stage 272:(4929 + 54) / 8878]WARN TaskSetManager - Lost task 6363.0 in stage 269.0 (TID 2025531, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7536.1 in stage 269.0 (TID 2065512, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 269.0 (TID 2013148, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 269.0 (TID 2033557, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 269.0 (TID 2021056, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5947.0 in stage 269.0 (TID 2077348, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 270:(7622 + 74) / 8878][Stage 271:(5278 + 51) / 8878][Stage 272:(4935 + 54) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 269.0 (TID 2014937, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8847.0 in stage 269.0 (TID 2077263, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 270:(7673 + 72) / 8878][Stage 271:(5586 + 50) / 8878][Stage 272:(5063 + 43) / 8878]ERROR YarnScheduler - Lost executor 10 on trantor22.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5990.0 in stage 273.0 (TID 2078905, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 10 lost)
WARN TaskSetManager - Lost task 5951.0 in stage 273.0 (TID 2078857, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 10 lost)
WARN TaskSetManager - Lost task 5958.0 in stage 273.0 (TID 2078871, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 10 lost)
WARN TaskSetManager - Lost task 5398.0 in stage 273.0 (TID 2078697, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 10 lost)
WARN TaskSetManager - Lost task 5013.0 in stage 273.0 (TID 2078628, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 10 lost)
[Stage 270:(7711 + 66) / 8878][Stage 271:(5681 + 49) / 8878][Stage 272:(5144 + 37) / 8878]ERROR YarnScheduler - Lost executor 1 on trantor15.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 8532.0 in stage 269.0 (TID 2076271, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 1 lost)
WARN TaskSetManager - Lost task 5503.0 in stage 270.0 (TID 2077736, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 1 lost)
WARN TaskSetManager - Lost task 8580.0 in stage 270.0 (TID 2080053, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 1 lost)
WARN TaskSetManager - Lost task 7576.0 in stage 270.0 (TID 2079785, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 1 lost)
WARN TaskSetManager - Lost task 8449.0 in stage 270.0 (TID 2080003, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 1 lost)
[Stage 270:(7743 + 85) / 8878][Stage 271:(5689 + 43) / 8878][Stage 272:(5192 + 34) / 8878]ERROR YarnScheduler - Lost executor 50 on trantor10.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5411.0 in stage 270.0 (TID 2049181, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 50 lost)
WARN TaskSetManager - Lost task 8549.0 in stage 275.0 (TID 2078339, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 50 lost)
WARN TaskSetManager - Lost task 4908.0 in stage 276.0 (TID 2080284, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 50 lost)
WARN TaskSetManager - Lost task 4894.0 in stage 276.0 (TID 2080283, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 50 lost)
WARN TaskSetManager - Lost task 4744.0 in stage 276.0 (TID 2080281, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 50 lost)
[Stage 270:(7743 + 84) / 8878][Stage 271:(5689 + 43) / 8878][Stage 272:(5192 + 34) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 282.0 (TID 2078626, trantor18.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor22.umiacs.umd.edu/192.168.74.222:40994
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor22.umiacs.umd.edu/192.168.74.222:40994
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
WARN TaskSetManager - Lost task 6712.0 in stage 272.0 (TID 2077891, trantor10.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 176937352)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 35 more
[Stage 270:(7750 + 102) / 8878][Stage 271:(5695 + 44) / 8878][Stage 272:(5201 + 31) / 8878]ERROR YarnScheduler - Lost executor 52 on trantor10.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6712.1 in stage 272.0 (TID 2080598, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 52 lost)
WARN TaskSetManager - Lost task 8448.0 in stage 272.0 (TID 2079119, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 52 lost)
WARN TaskSetManager - Lost task 6325.0 in stage 273.0 (TID 2080600, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 52 lost)
WARN TaskSetManager - Lost task 6323.0 in stage 273.0 (TID 2080597, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 52 lost)
WARN TaskSetManager - Lost task 6337.0 in stage 273.0 (TID 2080601, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 52 lost)
[Stage 270:(7750 + 102) / 8878][Stage 271:(5696 + 43) / 8878][Stage 272:(5201 + 30) / 8878]WARN TaskSetManager - Lost task 4982.0 in stage 270.0 (TID 2080584, trantor04.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 270:(7754 + 115) / 8878][Stage 271:(5711 + 41) / 8878][Stage 272:(5209 + 29) / 8878]ERROR YarnScheduler - Lost executor 35 on trantor04.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5006.2 in stage 269.0 (TID 2077568, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 35 lost)
WARN TaskSetManager - Lost task 8692.1 in stage 269.0 (TID 2076300, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 35 lost)
WARN TaskSetManager - Lost task 2910.0 in stage 270.0 (TID 2076585, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 35 lost)
[Stage 270:(7754 + 114) / 8878][Stage 271:(5711 + 41) / 8878][Stage 272:(5209 + 29) / 8878]WARN TaskSetManager - Lost task 5588.0 in stage 273.0 (TID 2080661, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 35 lost)
WARN TaskSetManager - Lost task 2917.0 in stage 273.0 (TID 2078720, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 35 lost)
[Stage 270:(7772 + 116) / 8878][Stage 271:(5739 + 60) / 8878][Stage 272:(5253 + 31) / 8878]WARN TaskSetManager - Lost task 2768.0 in stage 277.0 (TID 2080714, trantor24.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor04.umiacs.umd.edu/192.168.74.204:34427
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor04.umiacs.umd.edu/192.168.74.204:34427
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 270:(7782 + 115) / 8878][Stage 271:(5765 + 59) / 8878][Stage 272:(5265 + 31) / 8878]WARN TaskSetManager - Lost task 8448.1 in stage 272.0 (TID 2080760, trantor10.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 125622719)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 43 more
WARN TaskSetManager - Lost task 4957.0 in stage 270.0 (TID 2080582, trantor10.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 270:(7793 + 114) / 8878][Stage 271:(5768 + 59) / 8878][Stage 272:(5275 + 30) / 8878]ERROR YarnScheduler - Lost executor 49 on trantor10.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5411.0 in stage 271.0 (TID 2065556, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 49 lost)
WARN TaskSetManager - Lost task 5411.0 in stage 272.0 (TID 2074094, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 49 lost)
WARN TaskSetManager - Lost task 5411.0 in stage 273.0 (TID 2081100, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 49 lost)
WARN TaskSetManager - Lost task 5416.0 in stage 273.0 (TID 2081183, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 49 lost)
WARN TaskSetManager - Lost task 5413.0 in stage 273.0 (TID 2081182, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 49 lost)
[Stage 270:(7820 + 137) / 8878][Stage 271:(5794 + 55) / 8878][Stage 272:(5344 + 29) / 8878]WARN TaskSetManager - Lost task 5006.0 in stage 270.0 (TID 2080263, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 270:(7829 + 141) / 8878][Stage 271:(5812 + 48) / 8878][Stage 272:(5351 + 33) / 8878]WARN TaskSetManager - Lost task 503.0 in stage 271.0 (TID 2080903, trantor12.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
WARN TaskSetManager - Lost task 5412.0 in stage 270.0 (TID 2081574, trantor12.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 270:(7830 + 143) / 8878][Stage 271:(5816 + 48) / 8878][Stage 272:(5352 + 33) / 8878]WARN TaskSetManager - Lost task 5697.0 in stage 270.0 (TID 2081663, trantor22.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 15727590)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
[Stage 270:(7833 + 144) / 8878][Stage 271:(5818 + 46) / 8878][Stage 272:(5355 + 34) / 8878]ERROR YarnScheduler - Lost executor 12 on trantor22.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5724.1 in stage 270.0 (TID 2081689, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 12 lost)
WARN TaskSetManager - Lost task 5697.1 in stage 270.0 (TID 2081692, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 12 lost)
WARN TaskSetManager - Lost task 5890.0 in stage 270.0 (TID 2081686, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 12 lost)
WARN TaskSetManager - Lost task 5717.1 in stage 270.0 (TID 2081690, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 12 lost)
WARN TaskSetManager - Lost task 5913.0 in stage 270.0 (TID 2081693, trantor22.umiacs.umd.edu): ExecutorLostFailure (executor 12 lost)
[Stage 270:(7837 + 147) / 8878][Stage 271:(5838 + 47) / 8878][Stage 272:(5375 + 36) / 8878]ERROR YarnScheduler - Lost executor 30 on trantor12.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5325.0 in stage 270.0 (TID 2040869, trantor12.umiacs.umd.edu): ExecutorLostFailure (executor 30 lost)
WARN TaskSetManager - Lost task 5325.0 in stage 271.0 (TID 2048862, trantor12.umiacs.umd.edu): ExecutorLostFailure (executor 30 lost)
WARN TaskSetManager - Lost task 6383.0 in stage 274.0 (TID 2073468, trantor12.umiacs.umd.edu): ExecutorLostFailure (executor 30 lost)
WARN TaskSetManager - Lost task 4205.0 in stage 276.0 (TID 2081670, trantor12.umiacs.umd.edu): ExecutorLostFailure (executor 30 lost)
WARN TaskSetManager - Lost task 4184.0 in stage 276.0 (TID 2081669, trantor12.umiacs.umd.edu): ExecutorLostFailure (executor 30 lost)
[Stage 270:(7840 + 161) / 8878][Stage 271:(5871 + 42) / 8878][Stage 272:(5385 + 35) / 8878]WARN TaskSetManager - Lost task 6368.1 in stage 269.0 (TID 2076917, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 270:(7855 + 160) / 8878][Stage 271:(5886 + 35) / 8878][Stage 272:(5411 + 38) / 8878]WARN TaskSetManager - Lost task 589.0 in stage 271.0 (TID 2081710, trantor10.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor12.umiacs.umd.edu/192.168.74.212:38411
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor12.umiacs.umd.edu/192.168.74.212:38411
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 270:(7855 + 160) / 8878][Stage 271:(5887 + 34) / 8878][Stage 272:(5413 + 38) / 8878]WARN TaskSetManager - Lost task 5503.1 in stage 270.0 (TID 2080580, trantor03.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor12.umiacs.umd.edu/192.168.74.212:38411
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor12.umiacs.umd.edu/192.168.74.212:38411
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 270:(7951 + 190) / 8878][Stage 271:(6131 + 41) / 8878][Stage 272:(5552 + 38) / 8878]WARN TaskSetManager - Lost task 6355.0 in stage 269.0 (TID 2077658, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 270:(8011 + 227) / 8878][Stage 271:(6293 + 32) / 8878][Stage 272:(5600 + 27) / 8878]WARN TaskSetManager - Lost task 6331.0 in stage 270.0 (TID 2082818, trantor14.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 270:(8019 + 232) / 8878][Stage 271:(6367 + 28) / 8878][Stage 272:(5618 + 27) / 8878]WARN TaskSetManager - Lost task 6331.1 in stage 270.0 (TID 2082961, trantor19.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 270:(8025 + 232) / 8878][Stage 271:(6382 + 26) / 8878][Stage 272:(5624 + 30) / 8878]WARN TaskSetManager - Lost task 6331.2 in stage 270.0 (TID 2083004, trantor24.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 270:(8035 + 238) / 8878][Stage 271:(6387 + 24) / 8878][Stage 272:(5635 + 26) / 8878]ERROR TaskSetManager - Task 6331 in stage 270.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 6239.0 in stage 270.0 (TID 2082748, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6232.0 in stage 270.0 (TID 2082731, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5889.0 in stage 270.0 (TID 2082507, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5595.0 in stage 270.0 (TID 2082210, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6418.0 in stage 270.0 (TID 2083019, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6842.0 in stage 270.0 (TID 2082732, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5347.0 in stage 270.0 (TID 2081572, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6361.0 in stage 270.0 (TID 2082791, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6577.0 in stage 270.0 (TID 2082588, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 270.0 (TID 2081566, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6342.0 in stage 270.0 (TID 2082997, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6159.0 in stage 270.0 (TID 2082723, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6880.0 in stage 270.0 (TID 2082964, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6049.0 in stage 270.0 (TID 2082701, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6438.0 in stage 270.0 (TID 2083056, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6364.0 in stage 270.0 (TID 2082811, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5942.0 in stage 270.0 (TID 2082482, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5795.0 in stage 270.0 (TID 2081801, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5939.0 in stage 270.0 (TID 2082663, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6249.0 in stage 270.0 (TID 2082762, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5975.0 in stage 270.0 (TID 2082667, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6318.0 in stage 270.0 (TID 2082776, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6025.0 in stage 270.0 (TID 2082690, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6038.0 in stage 270.0 (TID 2082528, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6371.0 in stage 270.0 (TID 2082786, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4961.0 in stage 270.0 (TID 2080457, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6284.0 in stage 270.0 (TID 2082770, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6365.0 in stage 270.0 (TID 2082970, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6382.0 in stage 270.0 (TID 2082830, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6385.0 in stage 270.0 (TID 2083003, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5853.0 in stage 270.0 (TID 2082363, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6332.0 in stage 270.0 (TID 2082784, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5706.0 in stage 270.0 (TID 2082352, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6095.0 in stage 270.0 (TID 2082709, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6245.0 in stage 270.0 (TID 2082761, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6327.0 in stage 270.0 (TID 2082777, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6378.0 in stage 270.0 (TID 2082980, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6002.0 in stage 270.0 (TID 2082601, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6214.0 in stage 270.0 (TID 2082729, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6215.0 in stage 270.0 (TID 2082730, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6552.0 in stage 270.0 (TID 2082901, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6416.0 in stage 270.0 (TID 2082801, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5888.0 in stage 270.0 (TID 2082417, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6463.0 in stage 270.0 (TID 2083059, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6118.0 in stage 270.0 (TID 2082716, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5838.0 in stage 270.0 (TID 2082503, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6151.0 in stage 270.0 (TID 2082721, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6305.0 in stage 270.0 (TID 2082775, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6019.0 in stage 270.0 (TID 2082688, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6595.0 in stage 270.0 (TID 2083064, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6374.0 in stage 270.0 (TID 2083000, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6315.0 in stage 270.0 (TID 2082749, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6157.0 in stage 270.0 (TID 2082722, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6396.0 in stage 270.0 (TID 2082853, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6436.0 in stage 270.0 (TID 2083055, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5904.0 in stage 270.0 (TID 2082657, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6100.0 in stage 270.0 (TID 2082711, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5880.0 in stage 270.0 (TID 2082543, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6006.0 in stage 270.0 (TID 2082670, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5717.2 in stage 270.0 (TID 2081722, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6024.0 in stage 270.0 (TID 2082689, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6534.0 in stage 270.0 (TID 2082883, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5907.0 in stage 270.0 (TID 2082459, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5796.0 in stage 270.0 (TID 2081684, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5750.0 in stage 270.0 (TID 2082375, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.1 in stage 270.0 (TID 2081701, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5892.0 in stage 270.0 (TID 2082544, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6279.0 in stage 270.0 (TID 2082768, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6845.0 in stage 270.0 (TID 2082739, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5328.0 in stage 270.0 (TID 2081570, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5740.0 in stage 270.0 (TID 2082357, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5593.0 in stage 270.0 (TID 2082279, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5850.0 in stage 270.0 (TID 2082452, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6897.0 in stage 270.0 (TID 2082324, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6423.0 in stage 270.0 (TID 2082861, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5979.0 in stage 270.0 (TID 2082506, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5793.0 in stage 270.0 (TID 2082405, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5988.0 in stage 270.0 (TID 2082570, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6009.0 in stage 270.0 (TID 2082685, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5382.0 in stage 270.0 (TID 2081573, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5652.0 in stage 270.0 (TID 2082288, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5999.0 in stage 270.0 (TID 2082669, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6478.0 in stage 270.0 (TID 2082822, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6369.0 in stage 270.0 (TID 2082999, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6389.0 in stage 270.0 (TID 2083017, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6417.0 in stage 270.0 (TID 2083053, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5755.0 in stage 270.0 (TID 2082377, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5931.0 in stage 270.0 (TID 2082662, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6129.0 in stage 270.0 (TID 2082718, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5597.0 in stage 270.0 (TID 2082280, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6123.0 in stage 270.0 (TID 2082717, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5528.0 in stage 270.0 (TID 2081609, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6646.0 in stage 270.0 (TID 2082631, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6322.0 in stage 270.0 (TID 2082569, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5881.0 in stage 270.0 (TID 2082487, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6546.0 in stage 270.0 (TID 2082584, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6213.0 in stage 270.0 (TID 2082728, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.1 in stage 270.0 (TID 2080578, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 270.0 (TID 2080587, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5938.1 in stage 270.0 (TID 2076621, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6375.0 in stage 270.0 (TID 2083001, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6092.0 in stage 270.0 (TID 2081752, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4992.0 in stage 270.0 (TID 2080258, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6007.0 in stage 270.0 (TID 2082671, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6029.0 in stage 270.0 (TID 2082700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5287.0 in stage 270.0 (TID 2080664, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2922.0 in stage 270.0 (TID 2076591, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6222.0 in stage 270.0 (TID 2082551, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5579.0 in stage 270.0 (TID 2081799, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6088.0 in stage 270.0 (TID 2082708, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6330.0 in stage 270.0 (TID 2082962, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6146.0 in stage 270.0 (TID 2082720, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.1 in stage 270.0 (TID 2081530, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6485.0 in stage 270.0 (TID 2083063, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5930.0 in stage 270.0 (TID 2082661, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6192.0 in stage 270.0 (TID 2082727, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6620.0 in stage 270.0 (TID 2082630, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5739.0 in stage 270.0 (TID 2082356, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7112.0 in stage 270.0 (TID 2083065, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6392.0 in stage 270.0 (TID 2083018, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6135.0 in stage 270.0 (TID 2082547, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5082.0 in stage 270.0 (TID 2080593, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6283.0 in stage 270.0 (TID 2082559, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6334.0 in stage 270.0 (TID 2082963, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6366.0 in stage 270.0 (TID 2082574, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5840.0 in stage 270.0 (TID 2082483, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5632.0 in stage 270.0 (TID 2082285, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6274.0 in stage 270.0 (TID 2082767, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6258.0 in stage 270.0 (TID 2082765, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6133.0 in stage 270.0 (TID 2081753, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8692.1 in stage 270.0 (TID 2076301, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6529.0 in stage 270.0 (TID 2081807, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5993.0 in stage 270.0 (TID 2082668, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6028.0 in stage 270.0 (TID 2082699, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6152.0 in stage 270.0 (TID 2081755, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5503.2 in stage 270.0 (TID 2082208, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6188.0 in stage 270.0 (TID 2082725, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5724.2 in stage 270.0 (TID 2081751, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5813.0 in stage 270.0 (TID 2082451, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5823.0 in stage 270.0 (TID 2082467, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6011.0 in stage 270.0 (TID 2082686, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 270.0 (TID 2081795, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6115.0 in stage 270.0 (TID 2082715, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8709.0 in stage 270.0 (TID 2081428, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5544.0 in stage 270.0 (TID 2081792, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5158.0 in stage 270.0 (TID 2081564, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6468.0 in stage 270.0 (TID 2083061, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5656.0 in stage 270.0 (TID 2082289, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6272.0 in stage 270.0 (TID 2082766, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6288.0 in stage 270.0 (TID 2082771, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6518.0 in stage 270.0 (TID 2083005, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5961.0 in stage 270.0 (TID 2082665, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5916.0 in stage 270.0 (TID 2082658, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5399.0 in stage 270.0 (TID 2080659, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5845.0 in stage 270.0 (TID 2082359, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6061.0 in stage 270.0 (TID 2082703, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5774.0 in stage 270.0 (TID 2082379, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5940.0 in stage 270.0 (TID 2082481, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5646.0 in stage 270.0 (TID 2082287, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6297.0 in stage 270.0 (TID 2082772, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5738.0 in stage 270.0 (TID 2082355, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5758.0 in stage 270.0 (TID 2082209, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5906.0 in stage 270.0 (TID 2082435, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5832.0 in stage 270.0 (TID 2082290, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7083.0 in stage 270.0 (TID 2083026, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6474.0 in stage 270.0 (TID 2083062, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6111.0 in stage 270.0 (TID 2082714, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6058.0 in stage 270.0 (TID 2082702, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.1 in stage 270.0 (TID 2081791, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6057.0 in stage 270.0 (TID 2082691, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6824.0 in stage 270.0 (TID 2082672, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5713.0 in stage 270.0 (TID 2082353, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4941.0 in stage 270.0 (TID 2080245, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6335.0 in stage 270.0 (TID 2082837, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5664.0 in stage 270.0 (TID 2082292, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6484.0 in stage 270.0 (TID 2082841, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5936.0 in stage 270.0 (TID 2082479, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6098.0 in stage 270.0 (TID 2082710, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5618.0 in stage 270.0 (TID 2082284, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6167.0 in stage 270.0 (TID 2082548, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7126.0 in stage 270.0 (TID 2083067, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6077.0 in stage 270.0 (TID 2082705, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 270.0 (TID 2081563, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4959.0 in stage 270.0 (TID 2080290, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6069.0 in stage 270.0 (TID 2082704, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6018.0 in stage 270.0 (TID 2082687, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 270.0 (TID 2028704, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5893.0 in stage 270.0 (TID 2082545, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4940.0 in stage 270.0 (TID 2080244, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6217.0 in stage 270.0 (TID 2082549, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6189.0 in stage 270.0 (TID 2082726, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4966.0 in stage 270.0 (TID 2080306, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5927.0 in stage 270.0 (TID 2082660, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5943.0 in stage 270.0 (TID 2082581, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 271:(6387 + 51) / 8878][Stage 272:(5635 + 39) / 8878][Stage 273:(4957 + 45) / 8878]WARN TaskSetManager - Lost task 5919.0 in stage 270.0 (TID 2082659, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 270.0 (TID 2026077, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 270.0 (TID 2064293, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6303.0 in stage 270.0 (TID 2082774, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5445.0 in stage 270.0 (TID 2081581, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6846.0 in stage 270.0 (TID 2081827, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2909.0 in stage 270.0 (TID 2076584, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.0 in stage 270.0 (TID 2076590, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2915.0 in stage 270.0 (TID 2076588, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5934.0 in stage 270.0 (TID 2082554, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 270.0 (TID 2081592, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7144.0 in stage 270.0 (TID 2083068, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.1 in stage 270.0 (TID 2077297, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2930.0 in stage 270.0 (TID 2076594, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5003.0 in stage 270.0 (TID 2080589, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 270.0 (TID 2040755, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6384.0 in stage 270.0 (TID 2083002, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5994.0 in stage 270.0 (TID 2082490, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6868.0 in stage 270.0 (TID 2082248, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 270.0 (TID 2024212, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6872.0 in stage 270.0 (TID 2082251, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6893.0 in stage 270.0 (TID 2082252, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6106.0 in stage 270.0 (TID 2082713, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 270.0 (TID 2019223, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5932.1 in stage 270.0 (TID 2075822, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5286.0 in stage 270.0 (TID 2081568, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 270.0 (TID 2040044, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6170.0 in stage 270.0 (TID 2082724, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 270.0 (TID 2038819, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5887.0 in stage 270.0 (TID 2082505, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 271:(6391 + 52) / 8878][Stage 272:(5637 + 39) / 8878][Stage 273:(4959 + 49) / 8878]WARN TaskSetManager - Lost task 5300.0 in stage 270.0 (TID 2040680, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 270.0 (TID 2025655, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 270.0 (TID 2023798, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5785.0 in stage 270.0 (TID 2082423, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 271:(6409 + 52) / 8878][Stage 272:(5643 + 39) / 8878][Stage 273:(4964 + 48) / 8878]WARN TaskSetManager - Lost task 5964.0 in stage 270.0 (TID 2082666, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6298.0 in stage 270.0 (TID 2082773, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 270.0 (TID 2021422, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 271:(6633 + 36) / 8878][Stage 272:(5833 + 48) / 8878][Stage 273:(5095 + 40) / 8878]ERROR YarnScheduler - Lost executor 36 on trantor04.umiacs.umd.edu: remote Akka client disassociated
[Stage 271:(6634 + 35) / 8878][Stage 272:(5839 + 49) / 8878][Stage 273:(5097 + 40) / 8878]WARN TaskSetManager - Lost task 8399.0 in stage 274.0 (TID 2083293, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 36 lost)
WARN TaskSetManager - Lost task 3297.0 in stage 275.0 (TID 2084374, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 36 lost)
WARN TaskSetManager - Lost task 3360.0 in stage 275.0 (TID 2084376, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 36 lost)
WARN TaskSetManager - Lost task 3266.0 in stage 275.0 (TID 2084352, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 36 lost)
WARN TaskSetManager - Lost task 3439.0 in stage 275.0 (TID 2084382, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 36 lost)
[Stage 271:(6636 + 48) / 8878][Stage 272:(5873 + 46) / 8878][Stage 273:(5106 + 38) / 8878]WARN TaskSetManager - Lost task 7649.0 in stage 271.0 (TID 2083417, trantor15.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 85286489)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 35 more
[Stage 271:(6649 + 39) / 8878][Stage 272:(5905 + 47) / 8878][Stage 273:(5113 + 37) / 8878]ERROR YarnScheduler - Lost executor 3 on trantor15.umiacs.umd.edu: remote Akka client disassociated
[Stage 271:(6649 + 39) / 8878][Stage 272:(5907 + 47) / 8878][Stage 273:(5114 + 37) / 8878]WARN TaskSetManager - Lost task 2045.0 in stage 271.0 (TID 2084796, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 3 lost)
WARN TaskSetManager - Lost task 7457.0 in stage 271.0 (TID 2083381, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 3 lost)
WARN TaskSetManager - Lost task 2057.0 in stage 271.0 (TID 2084813, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 3 lost)
WARN TaskSetManager - Lost task 7649.1 in stage 271.0 (TID 2084815, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 3 lost)
WARN TaskSetManager - Lost task 2857.0 in stage 272.0 (TID 2084826, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 3 lost)
[Stage 271:(6973 + 97) / 8878][Stage 272:(5942 + 42) / 8878][Stage 273:(5184 + 35) / 8878]WARN TaskSetManager - Lost task 74.0 in stage 284.0 (TID 2084970, trantor15.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor15.umiacs.umd.edu/192.168.74.215:52793
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor15.umiacs.umd.edu/192.168.74.215:52793
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 271:(7016 + 108) / 8878][Stage 272:(5943 + 43) / 8878][Stage 273:(5187 + 35) / 8878]ERROR YarnScheduler - Lost executor 7 on trantor19.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5311.0 in stage 272.0 (TID 2019667, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 7 lost)
WARN TaskSetManager - Lost task 5362.0 in stage 274.0 (TID 2080723, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 7 lost)
WARN TaskSetManager - Lost task 7928.0 in stage 274.0 (TID 2085775, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 7 lost)
WARN TaskSetManager - Lost task 5249.0 in stage 276.0 (TID 2083119, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 7 lost)
WARN TaskSetManager - Lost task 6578.0 in stage 278.0 (TID 2085609, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 7 lost)
[Stage 271:(7188 + 73) / 8878][Stage 272:(6003 + 36) / 8878][Stage 273:(5283 + 55) / 8878]WARN TaskSetManager - Lost task 6351.0 in stage 271.0 (TID 2083935, trantor14.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 560323101)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 35 more
[Stage 271:(7189 + 72) / 8878][Stage 272:(6005 + 41) / 8878][Stage 273:(5293 + 53) / 8878]ERROR YarnScheduler - Lost executor 16 on trantor14.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 8470.0 in stage 271.0 (TID 2086495, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 16 lost)
WARN TaskSetManager - Lost task 6362.0 in stage 271.0 (TID 2083947, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 16 lost)
WARN TaskSetManager - Lost task 8709.0 in stage 271.0 (TID 2086570, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 16 lost)
WARN TaskSetManager - Lost task 8722.0 in stage 271.0 (TID 2086605, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 16 lost)
WARN TaskSetManager - Lost task 5925.0 in stage 271.0 (TID 2083805, trantor14.umiacs.umd.edu): ExecutorLostFailure (executor 16 lost)
[Stage 271:(7215 + 75) / 8878][Stage 272:(6051 + 56) / 8878][Stage 273:(5298 + 49) / 8878]WARN TaskSetManager - Lost task 5006.1 in stage 270.0 (TID 2081608, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 271:(7234 + 101) / 8878][Stage 272:(6177 + 62) / 8878][Stage 273:(5319 + 51) / 8878]WARN TaskSetManager - Lost task 5006.0 in stage 271.0 (TID 2085950, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 271:(7298 + 113) / 8878][Stage 272:(6249 + 58) / 8878][Stage 273:(5434 + 64) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 271.0 (TID 2087298, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 271:(7339 + 99) / 8878][Stage 272:(6272 + 53) / 8878][Stage 273:(5508 + 67) / 8878]ERROR TaskSetManager - Task 5526 in stage 271.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 4971.0 in stage 271.0 (TID 2083073, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 271.0 (TID 2087013, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.1 in stage 271.0 (TID 2081397, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6508.0 in stage 271.0 (TID 2087423, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 271.0 (TID 2087029, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5508.0 in stage 271.0 (TID 2086746, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4065.0 in stage 271.0 (TID 2087235, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5677.0 in stage 271.0 (TID 2086801, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7649.2 in stage 271.0 (TID 2084992, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4077.0 in stage 271.0 (TID 2087271, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4105.0 in stage 271.0 (TID 2087275, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5046.0 in stage 271.0 (TID 2085672, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4962.0 in stage 271.0 (TID 2083027, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5832.0 in stage 271.0 (TID 2085938, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5568.0 in stage 271.0 (TID 2085591, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4992.0 in stage 271.0 (TID 2085948, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 271.0 (TID 2085163, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 271.0 (TID 2086701, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.0 in stage 271.0 (TID 2087188, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5551.0 in stage 271.0 (TID 2085590, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8662.0 in stage 271.0 (TID 2083715, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4210.0 in stage 271.0 (TID 2087283, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5076.0 in stage 271.0 (TID 2085530, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 271.0 (TID 2087302, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5053.0 in stage 271.0 (TID 2085460, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5758.0 in stage 271.0 (TID 2085924, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5486.0 in stage 271.0 (TID 2085575, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2930.0 in stage 271.0 (TID 2085125, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3431.0 in stage 271.0 (TID 2087527, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5665.0 in stage 271.0 (TID 2085703, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4183.0 in stage 271.0 (TID 2087277, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6362.1 in stage 271.0 (TID 2086937, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 271.0 (TID 2085545, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6351.1 in stage 271.0 (TID 2086939, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8722.1 in stage 271.0 (TID 2086927, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8709.1 in stage 271.0 (TID 2086936, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 271.0 (TID 2085547, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3471.0 in stage 271.0 (TID 2087263, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4995.0 in stage 271.0 (TID 2085652, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.1 in stage 271.0 (TID 2076640, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5925.1 in stage 271.0 (TID 2086887, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2991.0 in stage 271.0 (TID 2087305, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5338.0 in stage 271.0 (TID 2085549, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3500.0 in stage 271.0 (TID 2087314, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2911.0 in stage 271.0 (TID 2085261, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5317.0 in stage 271.0 (TID 2085548, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5695.0 in stage 271.0 (TID 2087309, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.0 in stage 271.0 (TID 2085121, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2915.0 in stage 271.0 (TID 2085977, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 271.0 (TID 2056802, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.0 in stage 271.0 (TID 2085945, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.0 in stage 271.0 (TID 2055146, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7457.1 in stage 271.0 (TID 2085000, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2912.0 in stage 271.0 (TID 2085976, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 271.0 (TID 2079775, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5002.0 in stage 271.0 (TID 2087074, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4948.0 in stage 271.0 (TID 2086949, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 271.0 (TID 2087110, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5949.0 in stage 271.0 (TID 2084375, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 271.0 (TID 2028726, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 271.0 (TID 2085969, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5297.0 in stage 271.0 (TID 2085546, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6008.0 in stage 271.0 (TID 2087319, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 271.0 (TID 2087293, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.1 in stage 271.0 (TID 2081778, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.0 in stage 271.0 (TID 2085942, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2909.0 in stage 271.0 (TID 2087187, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5954.0 in stage 271.0 (TID 2084389, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4961.0 in stage 271.0 (TID 2087064, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5399.0 in stage 271.0 (TID 2086680, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 272:(6272 + 69) / 8878][Stage 273:(5509 + 68) / 8878][Stage 274:(4311 + 35) / 8878]WARN TaskSetManager - Lost task 5576.0 in stage 271.0 (TID 2087057, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5956.0 in stage 271.0 (TID 2084451, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4218.0 in stage 271.0 (TID 2087529, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5501.0 in stage 271.0 (TID 2085860, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2927.0 in stage 271.0 (TID 2087250, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 271.0 (TID 2085665, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5697.0 in stage 271.0 (TID 2087530, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2919.0 in stage 271.0 (TID 2087189, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3444.0 in stage 271.0 (TID 2087528, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.0 in stage 271.0 (TID 2085119, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 271.0 (TID 2033074, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 271.0 (TID 2056502, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4802.0 in stage 271.0 (TID 2086944, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2922.0 in stage 271.0 (TID 2085891, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3018.0 in stage 271.0 (TID 2087531, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 271.0 (TID 2036045, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 271.0 (TID 2051415, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 271.0 (TID 2077919, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 271.0 (TID 2034105, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 272:(6275 + 70) / 8878][Stage 273:(5509 + 68) / 8878][Stage 274:(4311 + 38) / 8878]WARN TaskSetManager - Lost task 5301.0 in stage 271.0 (TID 2055300, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 271.0 (TID 2033544, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 271.0 (TID 2052703, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5717.0 in stage 271.0 (TID 2087538, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 272:(6283 + 69) / 8878][Stage 273:(5512 + 68) / 8878][Stage 274:(4315 + 40) / 8878]WARN TaskSetManager - Lost task 8470.1 in stage 271.0 (TID 2086938, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3502.0 in stage 271.0 (TID 2087537, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 272:(6390 + 56) / 8878][Stage 273:(5569 + 63) / 8878][Stage 274:(4422 + 37) / 8878]WARN TaskSetManager - Lost task 8731.0 in stage 272.0 (TID 2086077, trantor20.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 627150239)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 35 more
[Stage 272:(6416 + 54) / 8878][Stage 273:(5608 + 63) / 8878][Stage 274:(4445 + 33) / 8878]ERROR YarnScheduler - Lost executor 41 on trantor20.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5006.1 in stage 271.0 (TID 2087033, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 41 lost)
WARN TaskSetManager - Lost task 8731.1 in stage 272.0 (TID 2088158, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 41 lost)
WARN TaskSetManager - Lost task 8464.0 in stage 272.0 (TID 2084171, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 41 lost)
WARN TaskSetManager - Lost task 3903.0 in stage 273.0 (TID 2088166, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 41 lost)
WARN TaskSetManager - Lost task 3834.0 in stage 273.0 (TID 2088159, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 41 lost)
[Stage 272:(6416 + 52) / 8878][Stage 273:(5608 + 61) / 8878][Stage 274:(4445 + 33) / 8878]ERROR YarnScheduler - Lost executor 57 on trantor08.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5949.0 in stage 272.0 (TID 2088149, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 57 lost)
WARN TaskSetManager - Lost task 5410.0 in stage 272.0 (TID 2088086, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 57 lost)
WARN TaskSetManager - Lost task 5782.0 in stage 272.0 (TID 2088133, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 57 lost)
WARN TaskSetManager - Lost task 5772.0 in stage 272.0 (TID 2088109, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 57 lost)
WARN TaskSetManager - Lost task 5954.0 in stage 272.0 (TID 2088254, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 57 lost)
[Stage 272:(6512 + 61) / 8878][Stage 273:(5697 + 59) / 8878][Stage 274:(4495 + 29) / 8878]WARN TaskSetManager - Lost task 1350.0 in stage 283.0 (TID 2088280, trantor20.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor20.umiacs.umd.edu/192.168.74.220:37107
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor20.umiacs.umd.edu/192.168.74.220:37107
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
WARN TaskSetManager - Lost task 637.0 in stage 283.0 (TID 2088228, trantor08.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor08.umiacs.umd.edu/192.168.74.208:55049
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor08.umiacs.umd.edu/192.168.74.208:55049
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 272:(6512 + 61) / 8878][Stage 273:(5725 + 87) / 8878][Stage 274:(4496 + 30) / 8878]ERROR YarnScheduler - Lost executor 38 on trantor03.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5013.1 in stage 273.0 (TID 2082002, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 38 lost)
WARN TaskSetManager - Lost task 6376.0 in stage 276.0 (TID 2087849, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 38 lost)
WARN TaskSetManager - Lost task 8069.0 in stage 276.0 (TID 2088829, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 38 lost)
WARN TaskSetManager - Lost task 4330.0 in stage 277.0 (TID 2089167, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 38 lost)
WARN TaskSetManager - Lost task 4288.0 in stage 277.0 (TID 2089155, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 38 lost)
[Stage 272:(6516 + 60) / 8878][Stage 273:(5739 + 90) / 8878][Stage 274:(4496 + 36) / 8878]ERROR YarnScheduler - Lost executor 39 on trantor03.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6386.0 in stage 274.0 (TID 2085778, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 39 lost)
WARN TaskSetManager - Lost task 8487.0 in stage 274.0 (TID 2087665, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 39 lost)
WARN TaskSetManager - Lost task 5820.0 in stage 275.0 (TID 2088844, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 39 lost)
WARN TaskSetManager - Lost task 6346.0 in stage 275.0 (TID 2089248, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 39 lost)
WARN TaskSetManager - Lost task 6126.0 in stage 275.0 (TID 2089241, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 39 lost)
[Stage 272:(6708 + 100) / 8878][Stage 273:(5843 + 69) / 8878][Stage 274:(4579 + 30) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 272.0 (TID 2090089, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 272:(6758 + 104) / 8878][Stage 273:(5897 + 97) / 8878][Stage 274:(4579 + 30) / 8878]WARN TaskSetManager - Lost task 5526.3 in stage 272.0 (TID 2090235, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
ERROR TaskSetManager - Task 5526 in stage 272.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 3718.0 in stage 272.0 (TID 2090123, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 272.0 (TID 2089038, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8731.2 in stage 272.0 (TID 2089840, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4936.0 in stage 272.0 (TID 2087297, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4961.0 in stage 272.0 (TID 2089187, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6677.0 in stage 272.0 (TID 2087546, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4960.0 in stage 272.0 (TID 2087299, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 272.0 (TID 2090075, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 272.0 (TID 2087321, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3556.0 in stage 272.0 (TID 2090196, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5954.1 in stage 272.0 (TID 2088640, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4948.0 in stage 272.0 (TID 2089186, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3992.0 in stage 272.0 (TID 2090149, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6356.0 in stage 272.0 (TID 2084690, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 272.0 (TID 2090060, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4113.0 in stage 272.0 (TID 2090155, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3587.0 in stage 272.0 (TID 2090205, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5161.0 in stage 272.0 (TID 2090045, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3500.0 in stage 272.0 (TID 2090164, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3831.0 in stage 272.0 (TID 2090133, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4962.0 in stage 272.0 (TID 2090065, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5949.1 in stage 272.0 (TID 2090022, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3578.0 in stage 272.0 (TID 2090112, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4049.0 in stage 272.0 (TID 2090151, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 272.0 (TID 2089864, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4479.0 in stage 272.0 (TID 2090004, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5297.0 in stage 272.0 (TID 2090227, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5053.0 in stage 272.0 (TID 2090120, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5089.0 in stage 272.0 (TID 2089918, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 272.0 (TID 2090214, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5020.0 in stage 272.0 (TID 2089903, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3593.0 in stage 272.0 (TID 2090215, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3369.0 in stage 272.0 (TID 2090074, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2909.0 in stage 272.0 (TID 2089137, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3863.0 in stage 272.0 (TID 2090138, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2915.0 in stage 272.0 (TID 2089812, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3999.0 in stage 272.0 (TID 2090046, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4063.0 in stage 272.0 (TID 2090059, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5160.0 in stage 272.0 (TID 2089990, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3750.0 in stage 272.0 (TID 2090027, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5410.1 in stage 272.0 (TID 2089804, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3800.0 in stage 272.0 (TID 2090132, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3780.0 in stage 272.0 (TID 2090126, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3581.0 in stage 272.0 (TID 2090201, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2912.0 in stage 272.0 (TID 2089796, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4270.0 in stage 272.0 (TID 2090190, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.0 in stage 272.0 (TID 2089802, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4729.0 in stage 272.0 (TID 2090038, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5695.0 in stage 272.0 (TID 2090108, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 272.0 (TID 2090071, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4056.0 in stage 272.0 (TID 2090053, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3589.0 in stage 272.0 (TID 2090114, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3988.0 in stage 272.0 (TID 2090146, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 272.0 (TID 2090094, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4520.0 in stage 272.0 (TID 2090015, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8662.0 in stage 272.0 (TID 2087904, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5772.1 in stage 272.0 (TID 2088656, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3786.0 in stage 272.0 (TID 2090129, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4971.0 in stage 272.0 (TID 2090066, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5782.1 in stage 272.0 (TID 2088657, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2922.0 in stage 272.0 (TID 2089154, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4157.0 in stage 272.0 (TID 2090176, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4130.0 in stage 272.0 (TID 2090172, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5076.0 in stage 272.0 (TID 2090153, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.0 in stage 272.0 (TID 2089117, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.1 in stage 272.0 (TID 2085863, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.1 in stage 272.0 (TID 2081595, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2927.0 in stage 272.0 (TID 2089778, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5950.0 in stage 272.0 (TID 2087827, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.0 in stage 272.0 (TID 2089773, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3502.0 in stage 272.0 (TID 2090174, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 272.0 (TID 2085206, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8481.0 in stage 272.0 (TID 2088242, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 272.0 (TID 2047519, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.0 in stage 272.0 (TID 2089145, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 272.0 (TID 2066687, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4214.0 in stage 272.0 (TID 2090181, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3525.0 in stage 272.0 (TID 2090195, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3433.0 in stage 272.0 (TID 2089989, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5502.0 in stage 272.0 (TID 2083357, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4219.0 in stage 272.0 (TID 2090183, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 272.0 (TID 2057450, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 273:(5901 + 109) / 8878][Stage 274:(4579 + 92) / 8878][Stage 275:(4263 + 23) / 8878]WARN TaskSetManager - Lost task 2919.0 in stage 272.0 (TID 2089774, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 272.0 (TID 2068111, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 272.0 (TID 2047481, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 272.0 (TID 2069886, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6340.0 in stage 272.0 (TID 2069131, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.1 in stage 272.0 (TID 2075923, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 272.0 (TID 2061040, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.1 in stage 272.0 (TID 2077723, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 273:(5904 + 109) / 8878][Stage 274:(4582 + 91) / 8878][Stage 275:(4264 + 25) / 8878]WARN TaskSetManager - Lost task 8712.0 in stage 272.0 (TID 2081421, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5697.0 in stage 272.0 (TID 2090237, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 272.0 (TID 2067862, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 272.0 (TID 2064251, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 272.0 (TID 2039405, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2911.2 in stage 272.0 (TID 2090232, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 273:(5909 + 109) / 8878][Stage 274:(4600 + 75) / 8878][Stage 275:(4264 + 27) / 8878]WARN TaskSetManager - Lost task 5301.0 in stage 272.0 (TID 2066232, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 273:(6075 + 99) / 8878][Stage 274:(4679 + 55) / 8878][Stage 275:(4344 + 29) / 8878]WARN TaskSetManager - Lost task 6343.0 in stage 273.0 (TID 2090068, trantor10.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
WARN TaskSetManager - Lost task 6164.0 in stage 273.0 (TID 2089951, trantor10.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 191773816)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
[Stage 273:(6076 + 94) / 8878][Stage 274:(4692 + 54) / 8878][Stage 275:(4350 + 30) / 8878]ERROR YarnScheduler - Lost executor 68 on trantor09.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 2303.0 in stage 271.0 (TID 2085365, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 68 lost)
WARN TaskSetManager - Lost task 6356.0 in stage 273.0 (TID 2088791, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 68 lost)
WARN TaskSetManager - Lost task 8662.0 in stage 273.0 (TID 2090866, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 68 lost)
WARN TaskSetManager - Lost task 6718.0 in stage 273.0 (TID 2090360, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 68 lost)
WARN TaskSetManager - Lost task 1947.0 in stage 274.0 (TID 2090937, trantor09.umiacs.umd.edu): ExecutorLostFailure (executor 68 lost)
[Stage 273:(6079 + 91) / 8878][Stage 274:(4698 + 53) / 8878][Stage 275:(4353 + 30) / 8878]ERROR YarnScheduler - Lost executor 51 on trantor10.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 2733.0 in stage 279.0 (TID 2090984, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 51 lost)
WARN TaskSetManager - Lost task 2894.0 in stage 279.0 (TID 2090993, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 51 lost)
WARN TaskSetManager - Lost task 2794.0 in stage 279.0 (TID 2090992, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 51 lost)
WARN TaskSetManager - Lost task 2677.0 in stage 279.0 (TID 2090983, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 51 lost)
WARN TaskSetManager - Lost task 2569.0 in stage 279.0 (TID 2090982, trantor10.umiacs.umd.edu): ExecutorLostFailure (executor 51 lost)
[Stage 273:(6408 + 124) / 8878][Stage 274:(4930 + 45) / 8878][Stage 275:(4507 + 28) / 8878]WARN TaskSetManager - Lost task 3081.0 in stage 273.0 (TID 2090199, trantor17.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 63666978)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
[Stage 273:(6475 + 142) / 8878][Stage 274:(5027 + 62) / 8878][Stage 275:(4508 + 27) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 273.0 (TID 2092914, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 273:(6505 + 146) / 8878][Stage 274:(5053 + 67) / 8878][Stage 275:(4510 + 25) / 8878]ERROR YarnScheduler - Lost executor 71 on trantor17.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6340.0 in stage 273.0 (TID 2074521, trantor17.umiacs.umd.edu): ExecutorLostFailure (executor 71 lost)
WARN TaskSetManager - Lost task 6340.0 in stage 274.0 (TID 2090017, trantor17.umiacs.umd.edu): ExecutorLostFailure (executor 71 lost)
WARN TaskSetManager - Lost task 6928.0 in stage 274.0 (TID 2090483, trantor17.umiacs.umd.edu): ExecutorLostFailure (executor 71 lost)
WARN TaskSetManager - Lost task 1924.0 in stage 274.0 (TID 2092723, trantor17.umiacs.umd.edu): ExecutorLostFailure (executor 71 lost)
WARN TaskSetManager - Lost task 5394.0 in stage 275.0 (TID 2092513, trantor17.umiacs.umd.edu): ExecutorLostFailure (executor 71 lost)
[Stage 273:(6538 + 152) / 8878][Stage 274:(5076 + 65) / 8878][Stage 275:(4511 + 23) / 8878]ERROR TaskSetManager - Task 5526 in stage 273.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 4260.0 in stage 273.0 (TID 2093019, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4296.0 in stage 273.0 (TID 2092901, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4194.0 in stage 273.0 (TID 2092940, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4382.0 in stage 273.0 (TID 2092957, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4207.0 in stage 273.0 (TID 2092999, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3926.0 in stage 273.0 (TID 2093015, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4346.0 in stage 273.0 (TID 2092917, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4214.0 in stage 273.0 (TID 2092974, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4130.0 in stage 273.0 (TID 2092861, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 273.0 (TID 2092553, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5695.0 in stage 273.0 (TID 2092936, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5967.0 in stage 273.0 (TID 2089847, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 273.0 (TID 2092915, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5317.0 in stage 273.0 (TID 2092987, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4159.0 in stage 273.0 (TID 2092919, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3763.0 in stage 273.0 (TID 2092829, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6677.0 in stage 273.0 (TID 2091034, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8662.1 in stage 273.0 (TID 2092688, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 273.0 (TID 2092856, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 273.0 (TID 2092962, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5076.0 in stage 273.0 (TID 2092556, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4274.0 in stage 273.0 (TID 2092893, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3999.0 in stage 273.0 (TID 2092700, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6165.0 in stage 273.0 (TID 2090031, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3752.0 in stage 273.0 (TID 2092871, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3866.0 in stage 273.0 (TID 2092954, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5338.0 in stage 273.0 (TID 2092995, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5297.0 in stage 273.0 (TID 2092909, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4157.0 in stage 273.0 (TID 2092908, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5700.0 in stage 273.0 (TID 2086000, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6132.0 in stage 273.0 (TID 2089896, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4971.0 in stage 273.0 (TID 2092550, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4107.0 in stage 273.0 (TID 2092830, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2915.0 in stage 273.0 (TID 2090116, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 273.0 (TID 2092857, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4144.0 in stage 273.0 (TID 2092870, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6718.1 in stage 273.0 (TID 2091513, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5691.0 in stage 273.0 (TID 2085949, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4070.0 in stage 273.0 (TID 2092966, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4251.0 in stage 273.0 (TID 2092887, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4962.0 in stage 273.0 (TID 2092547, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6356.1 in stage 273.0 (TID 2092787, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3761.0 in stage 273.0 (TID 2092884, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4082.0 in stage 273.0 (TID 2092968, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5990.1 in stage 273.0 (TID 2082480, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5053.0 in stage 273.0 (TID 2092555, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5953.0 in stage 273.0 (TID 2089266, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4219.0 in stage 273.0 (TID 2092988, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5958.1 in stage 273.0 (TID 2082306, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5416.1 in stage 273.0 (TID 2081812, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4222.0 in stage 273.0 (TID 2093040, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4430.0 in stage 273.0 (TID 2093011, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4354.0 in stage 273.0 (TID 2092938, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4098.0 in stage 273.0 (TID 2092960, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4092.0 in stage 273.0 (TID 2092944, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3144.0 in stage 273.0 (TID 2090228, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6343.1 in stage 273.0 (TID 2092680, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.1 in stage 273.0 (TID 2082011, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4027.0 in stage 273.0 (TID 2092934, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5911.0 in stage 273.0 (TID 2089231, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 273.0 (TID 2092859, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3796.0 in stage 273.0 (TID 2092850, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4388.0 in stage 273.0 (TID 2093003, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3606.0 in stage 273.0 (TID 2092708, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4011.0 in stage 273.0 (TID 2093020, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4125.0 in stage 273.0 (TID 2093000, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2887.0 in stage 273.0 (TID 2090107, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3209.0 in stage 273.0 (TID 2092989, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3967.0 in stage 273.0 (TID 2092903, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3825.0 in stage 273.0 (TID 2092970, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4349.0 in stage 273.0 (TID 2092923, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4129.0 in stage 273.0 (TID 2093025, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3108.0 in stage 273.0 (TID 2090213, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.1 in stage 273.0 (TID 2081830, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3037.0 in stage 273.0 (TID 2090186, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3925.0 in stage 273.0 (TID 2092883, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2928.0 in stage 273.0 (TID 2089702, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8624.0 in stage 273.0 (TID 2090502, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3295.0 in stage 273.0 (TID 2093030, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3921.0 in stage 273.0 (TID 2092880, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3844.0 in stage 273.0 (TID 2093002, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2927.0 in stage 273.0 (TID 2089291, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.0 in stage 273.0 (TID 2087393, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3294.0 in stage 273.0 (TID 2093029, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6064.0 in stage 273.0 (TID 2089851, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3837.0 in stage 273.0 (TID 2092971, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2926.0 in stage 273.0 (TID 2088437, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5502.0 in stage 273.0 (TID 2088001, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3802.0 in stage 273.0 (TID 2092937, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 273.0 (TID 2090130, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6339.0 in stage 273.0 (TID 2086423, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 273.0 (TID 2056455, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2911.0 in stage 273.0 (TID 2089275, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4948.0 in stage 273.0 (TID 2091868, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5013.2 in stage 273.0 (TID 2089620, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3326.0 in stage 273.0 (TID 2093036, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4008.0 in stage 273.0 (TID 2092935, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5002.0 in stage 273.0 (TID 2092826, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2930.0 in stage 273.0 (TID 2090145, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8481.0 in stage 273.0 (TID 2091675, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3135.0 in stage 273.0 (TID 2090223, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2919.0 in stage 273.0 (TID 2089220, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5950.0 in stage 273.0 (TID 2090652, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6164.1 in stage 273.0 (TID 2092609, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4153.0 in stage 273.0 (TID 2093038, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 273.0 (TID 2074872, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3731.0 in stage 273.0 (TID 2092789, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5704.0 in stage 273.0 (TID 2086033, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3676.0 in stage 273.0 (TID 2092729, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 273.0 (TID 2090527, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 273.0 (TID 2089030, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3883.0 in stage 273.0 (TID 2093008, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3698.0 in stage 273.0 (TID 2092788, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 273.0 (TID 2075725, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.0 in stage 273.0 (TID 2090139, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(5078 + 80) / 8878][Stage 275:(4511 + 109) / 8878][Stage 276:(5068 + 41) / 8878]WARN TaskSetManager - Lost task 6363.0 in stage 273.0 (TID 2078952, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.0 in stage 273.0 (TID 2081553, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4961.0 in stage 273.0 (TID 2091871, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 273.0 (TID 2069420, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3846.0 in stage 273.0 (TID 2093005, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3128.0 in stage 273.0 (TID 2090219, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5363.0 in stage 273.0 (TID 2081620, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 273.0 (TID 2086883, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 273.0 (TID 2079094, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 273.0 (TID 2084589, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 273.0 (TID 2077952, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 273.0 (TID 2061574, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 273.0 (TID 2072006, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3384.0 in stage 273.0 (TID 2093052, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6156.1 in stage 273.0 (TID 2092627, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5717.0 in stage 273.0 (TID 2093055, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(5080 + 78) / 8878][Stage 275:(4522 + 104) / 8878][Stage 276:(5070 + 47) / 8878]WARN TaskSetManager - Lost task 2920.0 in stage 273.0 (TID 2090131, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4270.0 in stage 273.0 (TID 2093053, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5912.1 in stage 273.0 (TID 2092631, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 273.0 (TID 2073425, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 273.0 (TID 2038575, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4433.0 in stage 273.0 (TID 2093051, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(5145 + 72) / 8878][Stage 275:(4587 + 61) / 8878][Stage 276:(5096 + 39) / 8878]WARN TaskSetManager - Lost task 5894.1 in stage 273.0 (TID 2092592, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(5221 + 68) / 8878][Stage 275:(4659 + 61) / 8878][Stage 276:(5118 + 40) / 8878]WARN TaskSetManager - Lost task 2050.0 in stage 274.0 (TID 2092792, trantor00.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor17.umiacs.umd.edu/192.168.74.217:50340
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor17.umiacs.umd.edu/192.168.74.217:50340
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 274:(5316 + 55) / 8878][Stage 275:(4791 + 49) / 8878][Stage 276:(5186 + 39) / 8878]WARN TaskSetManager - Lost task 3921.0 in stage 277.0 (TID 2094183, trantor08.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 274:(5327 + 55) / 8878][Stage 275:(4801 + 47) / 8878][Stage 276:(5188 + 39) / 8878]ERROR YarnScheduler - Lost executor 60 on trantor08.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 4125.0 in stage 277.0 (TID 2094920, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 60 lost)
WARN TaskSetManager - Lost task 4098.0 in stage 277.0 (TID 2094919, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 60 lost)
WARN TaskSetManager - Lost task 4092.1 in stage 277.0 (TID 2094922, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 60 lost)
WARN TaskSetManager - Lost task 3921.1 in stage 277.0 (TID 2094921, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 60 lost)
WARN TaskSetManager - Lost task 4027.1 in stage 277.0 (TID 2094932, trantor08.umiacs.umd.edu): ExecutorLostFailure (executor 60 lost)
[Stage 274:(5738 + 75) / 8878][Stage 275:(5214 + 58) / 8878][Stage 276:(5318 + 53) / 8878]ERROR YarnScheduler - Lost executor 48 on trantor07.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6339.0 in stage 274.0 (TID 2092064, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 48 lost)
WARN TaskSetManager - Lost task 2920.0 in stage 274.0 (TID 2096214, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 48 lost)
WARN TaskSetManager - Lost task 2916.0 in stage 274.0 (TID 2096210, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 48 lost)
WARN TaskSetManager - Lost task 6338.0 in stage 274.0 (TID 2092041, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 48 lost)
WARN TaskSetManager - Lost task 6329.0 in stage 274.0 (TID 2092034, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 48 lost)
[Stage 274:(5950 + 95) / 8878][Stage 275:(5231 + 67) / 8878][Stage 276:(5353 + 31) / 8878]WARN TaskSetManager - Lost task 6126.1 in stage 275.0 (TID 2090291, trantor00.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
WARN TaskSetManager - Lost task 2877.0 in stage 275.0 (TID 2096522, trantor00.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 56687774)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
[Stage 274:(5967 + 98) / 8878][Stage 275:(5232 + 70) / 8878][Stage 276:(5354 + 30) / 8878]ERROR YarnScheduler - Lost executor 75 on trantor00.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 2919.0 in stage 275.0 (TID 2096594, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 75 lost)
WARN TaskSetManager - Lost task 2932.0 in stage 275.0 (TID 2096597, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 75 lost)
WARN TaskSetManager - Lost task 2927.0 in stage 275.0 (TID 2096596, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 75 lost)
WARN TaskSetManager - Lost task 2913.0 in stage 275.0 (TID 2096551, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 75 lost)
WARN TaskSetManager - Lost task 2926.0 in stage 275.0 (TID 2096595, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 75 lost)
[Stage 274:(6871 + 146) / 8878][Stage 275:(6437 + 121) / 8878][Stage 276:(5526 + 21) / 8878]WARN TaskSetManager - Lost task 4951.0 in stage 275.0 (TID 2098931, trantor00.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 411564759)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 43 more
WARN TaskSetManager - Lost task 6928.1 in stage 274.0 (TID 2092996, trantor00.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
WARN TaskSetManager - Lost task 4944.0 in stage 275.0 (TID 2098926, trantor00.umiacs.umd.edu): java.lang.RuntimeException: After retry (Offset 383769800)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:512)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
at org.warcbase.mapreduce.WacGenericInputFormat$GenericArchiveRecordReader.nextKeyValue(WacGenericInputFormat.java:124)
at org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:143)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:126)
at org.archive.util.LaxHttpParser.readRawLine(LaxHttpParser.java:84)
at org.archive.util.LaxHttpParser.readLine(LaxHttpParser.java:112)
at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:505)
... 44 more
WARN TaskSetManager - Lost task 4987.0 in stage 275.0 (TID 2098982, trantor00.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 274:(6871 + 146) / 8878][Stage 275:(6439 + 121) / 8878][Stage 276:(5526 + 21) / 8878]ERROR YarnScheduler - Lost executor 73 on trantor00.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5077.0 in stage 275.0 (TID 2099134, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 73 lost)
WARN TaskSetManager - Lost task 5006.0 in stage 275.0 (TID 2099044, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 73 lost)
WARN TaskSetManager - Lost task 4951.1 in stage 275.0 (TID 2099133, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 73 lost)
WARN TaskSetManager - Lost task 5076.0 in stage 275.0 (TID 2099132, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 73 lost)
WARN TaskSetManager - Lost task 4944.1 in stage 275.0 (TID 2099135, trantor00.umiacs.umd.edu): ExecutorLostFailure (executor 73 lost)
[Stage 274:(6873 + 147) / 8878][Stage 275:(6440 + 115) / 8878][Stage 276:(5526 + 21) / 8878]WARN TaskSetManager - Lost task 5006.0 in stage 274.0 (TID 2096935, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 274:(6892 + 153) / 8878][Stage 275:(6449 + 114) / 8878][Stage 276:(5526 + 21) / 8878]WARN TaskSetManager - Lost task 5006.1 in stage 274.0 (TID 2099142, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 274:(6897 + 154) / 8878][Stage 275:(6452 + 113) / 8878][Stage 276:(5526 + 21) / 8878]WARN TaskSetManager - Lost task 1548.0 in stage 272.0 (TID 2081623, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(6897 + 155) / 8878][Stage 275:(6452 + 113) / 8878][Stage 276:(5526 + 21) / 8878]WARN TaskSetManager - Lost task 1563.0 in stage 272.0 (TID 2081627, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 1544.0 in stage 272.0 (TID 2081618, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(6897 + 157) / 8878][Stage 275:(6453 + 113) / 8878][Stage 276:(5526 + 21) / 8878]WARN TaskSetManager - Lost task 5729.0 in stage 270.0 (TID 2082304, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5555.0 in stage 270.0 (TID 2081652, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(6922 + 158) / 8878][Stage 275:(6463 + 115) / 8878][Stage 276:(5527 + 21) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 274.0 (TID 2099226, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 274:(6931 + 157) / 8878][Stage 275:(6464 + 117) / 8878][Stage 276:(5527 + 21) / 8878]WARN TaskSetManager - Lost task 1728.0 in stage 272.0 (TID 2082493, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(6931 + 158) / 8878][Stage 275:(6464 + 117) / 8878][Stage 276:(5527 + 21) / 8878]WARN TaskSetManager - Lost task 5526.1 in stage 274.0 (TID 2099239, trantor24.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
WARN TaskSetManager - Lost task 2016.0 in stage 271.0 (TID 2083015, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2016.0 in stage 272.0 (TID 2086737, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 274:(6933 + 162) / 8878][Stage 275:(6466 + 115) / 8878][Stage 276:(5527 + 21) / 8878]ERROR TaskSetManager - Task 5526 in stage 274.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5128.0 in stage 274.0 (TID 2098985, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5388.0 in stage 274.0 (TID 2099056, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 274.0 (TID 2098487, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 274.0 (TID 2099042, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 274.0 (TID 2098111, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5507.0 in stage 274.0 (TID 2099181, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5038.0 in stage 274.0 (TID 2099073, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5462.0 in stage 274.0 (TID 2099110, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5095.0 in stage 274.0 (TID 2098621, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 274.0 (TID 2099224, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5464.0 in stage 274.0 (TID 2099168, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5086.0 in stage 274.0 (TID 2099049, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 274.0 (TID 2096864, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5585.0 in stage 274.0 (TID 2099179, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5641.0 in stage 274.0 (TID 2099223, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 274.0 (TID 2098935, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5350.0 in stage 274.0 (TID 2099231, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5515.0 in stage 274.0 (TID 2099221, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5392.0 in stage 274.0 (TID 2098669, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5077.0 in stage 274.0 (TID 2097374, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 274.0 (TID 2098224, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5062.0 in stage 274.0 (TID 2099019, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 274.0 (TID 2098333, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 274.0 (TID 2099174, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5059.0 in stage 274.0 (TID 2098318, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5447.0 in stage 274.0 (TID 2099001, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5495.0 in stage 274.0 (TID 2099173, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5318.0 in stage 274.0 (TID 2098552, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 274.0 (TID 2099175, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 274.0 (TID 2098696, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5314.0 in stage 274.0 (TID 2098544, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 274.0 (TID 2097087, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5097.0 in stage 274.0 (TID 2099070, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5172.0 in stage 274.0 (TID 2098540, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5320.0 in stage 274.0 (TID 2098654, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5329.0 in stage 274.0 (TID 2099185, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 274.0 (TID 2099200, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5135.0 in stage 274.0 (TID 2098482, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 274.0 (TID 2098990, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5057.0 in stage 274.0 (TID 2098767, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 274.0 (TID 2099204, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5503.0 in stage 274.0 (TID 2099178, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5336.0 in stage 274.0 (TID 2099156, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5391.0 in stage 274.0 (TID 2098089, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5480.0 in stage 274.0 (TID 2099170, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5466.0 in stage 274.0 (TID 2099117, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5579.0 in stage 274.0 (TID 2099237, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5321.0 in stage 274.0 (TID 2098662, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4950.0 in stage 274.0 (TID 2098648, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5551.0 in stage 274.0 (TID 2099171, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5061.0 in stage 274.0 (TID 2098837, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5446.0 in stage 274.0 (TID 2099098, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5096.0 in stage 274.0 (TID 2098320, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4972.0 in stage 274.0 (TID 2099061, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5471.0 in stage 274.0 (TID 2099196, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 274.0 (TID 2099069, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5468.0 in stage 274.0 (TID 2099165, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5347.0 in stage 274.0 (TID 2099186, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5402.0 in stage 274.0 (TID 2099078, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5158.0 in stage 274.0 (TID 2098512, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5460.0 in stage 274.0 (TID 2099102, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 274.0 (TID 2099227, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5121.0 in stage 274.0 (TID 2099108, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5140.0 in stage 274.0 (TID 2099123, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5042.0 in stage 274.0 (TID 2098295, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 274.0 (TID 2099072, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4956.0 in stage 274.0 (TID 2098914, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5328.0 in stage 274.0 (TID 2099184, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 274.0 (TID 2099183, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6928.2 in stage 274.0 (TID 2099137, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5083.0 in stage 274.0 (TID 2099045, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5204.0 in stage 274.0 (TID 2099138, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5435.0 in stage 274.0 (TID 2099105, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5454.0 in stage 274.0 (TID 2099009, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5130.0 in stage 274.0 (TID 2098326, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 274.0 (TID 2097634, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 274.0 (TID 2098840, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5080.0 in stage 274.0 (TID 2099036, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5040.0 in stage 274.0 (TID 2099074, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5284.0 in stage 274.0 (TID 2099148, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5484.0 in stage 274.0 (TID 2099220, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5020.0 in stage 274.0 (TID 2099062, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5327.0 in stage 274.0 (TID 2099153, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5125.0 in stage 274.0 (TID 2098414, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5451.0 in stage 274.0 (TID 2099198, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 274.0 (TID 2098932, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5003.0 in stage 274.0 (TID 2098313, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5270.0 in stage 274.0 (TID 2099145, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5486.0 in stage 274.0 (TID 2099166, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5670.0 in stage 274.0 (TID 2099232, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5275.0 in stage 274.0 (TID 2099146, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5532.0 in stage 274.0 (TID 2099230, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5286.0 in stage 274.0 (TID 2099149, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5382.0 in stage 274.0 (TID 2099189, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5631.0 in stage 274.0 (TID 2099206, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5440.0 in stage 274.0 (TID 2099193, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4961.0 in stage 274.0 (TID 2097524, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 274.0 (TID 2099060, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5019.0 in stage 274.0 (TID 2098993, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 274.0 (TID 2098732, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5353.0 in stage 274.0 (TID 2099182, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 274.0 (TID 2099011, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5129.0 in stage 274.0 (TID 2099122, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5102.0 in stage 274.0 (TID 2099087, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 274.0 (TID 2098753, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5469.0 in stage 274.0 (TID 2099130, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4941.0 in stage 274.0 (TID 2098237, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5046.0 in stage 274.0 (TID 2098708, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 274.0 (TID 2098855, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5013.0 in stage 274.0 (TID 2097626, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.0 in stage 274.0 (TID 2099059, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4976.0 in stage 274.0 (TID 2099067, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2761.0 in stage 273.0 (TID 2090101, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5070.0 in stage 274.0 (TID 2097723, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5084.0 in stage 274.0 (TID 2098342, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5351.0 in stage 274.0 (TID 2099242, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4951.0 in stage 274.0 (TID 2098900, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5568.0 in stage 274.0 (TID 2099172, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 274.0 (TID 2099091, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5457.0 in stage 274.0 (TID 2099079, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5119.0 in stage 274.0 (TID 2098367, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 274.0 (TID 2097680, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4959.0 in stage 274.0 (TID 2098265, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 274.0 (TID 2089295, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4939.0 in stage 274.0 (TID 2098635, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5123.0 in stage 274.0 (TID 2099121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 274.0 (TID 2098666, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5366.0 in stage 274.0 (TID 2099191, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5482.0 in stage 274.0 (TID 2099212, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5348.0 in stage 274.0 (TID 2099154, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5100.0 in stage 274.0 (TID 2098346, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5030.0 in stage 274.0 (TID 2098284, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 274.0 (TID 2085696, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5444.0 in stage 274.0 (TID 2099160, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5430.0 in stage 274.0 (TID 2099192, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 274.0 (TID 2098749, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5465.0 in stage 274.0 (TID 2099210, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5287.0 in stage 274.0 (TID 2099150, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5352.0 in stage 274.0 (TID 2099243, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5315.0 in stage 274.0 (TID 2099152, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.0 in stage 274.0 (TID 2093249, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6468 + 127) / 8878][Stage 276:(5528 + 124) / 8878][Stage 277:(5124 + 24) / 8878]WARN TaskSetManager - Lost task 5088.0 in stage 274.0 (TID 2099076, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5588.0 in stage 274.0 (TID 2099199, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 274.0 (TID 2091150, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 274.0 (TID 2098847, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 274.0 (TID 2066601, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 274.0 (TID 2072922, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 274.0 (TID 2089125, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 274.0 (TID 2084515, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 274.0 (TID 2071824, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6471 + 128) / 8878][Stage 276:(5547 + 108) / 8878][Stage 277:(5125 + 25) / 8878]WARN TaskSetManager - Lost task 5301.0 in stage 274.0 (TID 2084569, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 274.0 (TID 2081451, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5156.0 in stage 274.0 (TID 2099124, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5376.0 in stage 274.0 (TID 2099251, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6474 + 127) / 8878][Stage 276:(5588 + 68) / 8878][Stage 277:(5128 + 29) / 8878]WARN TaskSetManager - Lost task 5372.0 in stage 274.0 (TID 2099250, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 274.0 (TID 2054674, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6476 + 127) / 8878][Stage 276:(5605 + 51) / 8878][Stage 277:(5131 + 30) / 8878]WARN TaskSetManager - Lost task 5357.0 in stage 274.0 (TID 2099246, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5358.0 in stage 274.0 (TID 2099247, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5367.0 in stage 274.0 (TID 2099248, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6488 + 126) / 8878][Stage 276:(5624 + 34) / 8878][Stage 277:(5146 + 26) / 8878]WARN TaskSetManager - Lost task 6345.1 in stage 269.0 (TID 2075887, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 1728.0 in stage 274.0 (TID 2086321, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6490 + 125) / 8878][Stage 276:(5627 + 33) / 8878][Stage 277:(5148 + 26) / 8878]WARN TaskSetManager - Lost task 5369.0 in stage 274.0 (TID 2099249, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6493 + 125) / 8878][Stage 276:(5627 + 33) / 8878][Stage 277:(5151 + 25) / 8878]WARN TaskSetManager - Lost task 2936.0 in stage 273.0 (TID 2090147, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6495 + 124) / 8878][Stage 276:(5628 + 33) / 8878][Stage 277:(5153 + 25) / 8878]WARN TaskSetManager - Lost task 2938.0 in stage 273.0 (TID 2090148, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6516 + 123) / 8878][Stage 276:(5637 + 30) / 8878][Stage 277:(5164 + 26) / 8878]WARN TaskSetManager - Lost task 2925.0 in stage 273.0 (TID 2090144, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6526 + 123) / 8878][Stage 276:(5646 + 27) / 8878][Stage 277:(5176 + 26) / 8878]WARN TaskSetManager - Lost task 2686.0 in stage 274.0 (TID 2096204, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2303.0 in stage 273.0 (TID 2086109, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6526 + 123) / 8878][Stage 276:(5647 + 28) / 8878][Stage 277:(5176 + 26) / 8878]WARN TaskSetManager - Lost task 2912.0 in stage 273.0 (TID 2090115, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6529 + 121) / 8878][Stage 276:(5649 + 29) / 8878][Stage 277:(5178 + 26) / 8878]WARN TaskSetManager - Lost task 2921.0 in stage 273.0 (TID 2090134, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6544 + 121) / 8878][Stage 276:(5675 + 29) / 8878][Stage 277:(5187 + 25) / 8878]WARN TaskSetManager - Lost task 5085.0 in stage 275.0 (TID 2099201, trantor19.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 275:(6569 + 118) / 8878][Stage 276:(5683 + 27) / 8878][Stage 277:(5190 + 30) / 8878]ERROR YarnScheduler - Lost executor 5 on trantor19.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5311.0 in stage 275.0 (TID 2086161, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 5 lost)
WARN TaskSetManager - Lost task 5996.0 in stage 277.0 (TID 2100305, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 5 lost)
WARN TaskSetManager - Lost task 5311.0 in stage 277.0 (TID 2095457, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 5 lost)
WARN TaskSetManager - Lost task 5960.0 in stage 277.0 (TID 2100304, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 5 lost)
WARN TaskSetManager - Lost task 6013.0 in stage 277.0 (TID 2100306, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 5 lost)
[Stage 275:(6579 + 117) / 8878][Stage 276:(5686 + 26) / 8878][Stage 277:(5191 + 27) / 8878]ERROR YarnScheduler - Lost executor 45 on trantor07.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 8624.0 in stage 275.0 (TID 2099420, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 45 lost)
WARN TaskSetManager - Lost task 8732.0 in stage 275.0 (TID 2099438, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 45 lost)
[Stage 275:(6579 + 115) / 8878][Stage 276:(5686 + 26) / 8878][Stage 277:(5192 + 27) / 8878]WARN TaskSetManager - Lost task 5146.0 in stage 276.0 (TID 2100296, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 45 lost)
WARN TaskSetManager - Lost task 5165.0 in stage 276.0 (TID 2100299, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 45 lost)
WARN TaskSetManager - Lost task 5502.0 in stage 276.0 (TID 2100367, trantor07.umiacs.umd.edu): ExecutorLostFailure (executor 45 lost)
[Stage 275:(6615 + 112) / 8878][Stage 276:(5704 + 25) / 8878][Stage 277:(5198 + 27) / 8878]WARN TaskSetManager - Lost task 1727.0 in stage 274.0 (TID 2089390, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 1725.0 in stage 274.0 (TID 2089381, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6615 + 112) / 8878][Stage 276:(5706 + 25) / 8878][Stage 277:(5198 + 27) / 8878]WARN TaskSetManager - Lost task 1746.0 in stage 274.0 (TID 2089399, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6618 + 109) / 8878][Stage 276:(5707 + 27) / 8878][Stage 277:(5199 + 27) / 8878]WARN TaskSetManager - Lost task 2860.0 in stage 273.0 (TID 2089205, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6618 + 109) / 8878][Stage 276:(5707 + 27) / 8878][Stage 277:(5202 + 26) / 8878]WARN TaskSetManager - Lost task 8464.1 in stage 272.0 (TID 2089787, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3764.0 in stage 271.0 (TID 2085499, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3764.0 in stage 273.0 (TID 2092598, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6618 + 109) / 8878][Stage 276:(5710 + 26) / 8878][Stage 277:(5204 + 26) / 8878]ERROR YarnScheduler - Lost executor 4 on trantor15.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5950.0 in stage 275.0 (TID 2099641, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 4 lost)
WARN TaskSetManager - Lost task 5364.0 in stage 275.0 (TID 2099255, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 4 lost)
WARN TaskSetManager - Lost task 4866.0 in stage 276.0 (TID 2100662, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 4 lost)
WARN TaskSetManager - Lost task 4886.0 in stage 276.0 (TID 2100669, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 4 lost)
WARN TaskSetManager - Lost task 4990.0 in stage 276.0 (TID 2100674, trantor15.umiacs.umd.edu): ExecutorLostFailure (executor 4 lost)
[Stage 275:(6618 + 107) / 8878][Stage 276:(5710 + 23) / 8878][Stage 277:(5204 + 26) / 8878]WARN TaskSetManager - Lost task 6345.0 in stage 270.0 (TID 2082782, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6658 + 181) / 8878][Stage 276:(5737 + 39) / 8878][Stage 277:(5208 + 23) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 275.0 (TID 2100987, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 275:(6669 + 207) / 8878][Stage 276:(5746 + 40) / 8878][Stage 277:(5209 + 22) / 8878]WARN TaskSetManager - Lost task 2770.0 in stage 280.0 (TID 2100678, trantor15.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor15.umiacs.umd.edu/192.168.74.215:57516
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor15.umiacs.umd.edu/192.168.74.215:57516
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
WARN TaskSetManager - Lost task 3025.0 in stage 281.0 (TID 2100744, trantor15.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor15.umiacs.umd.edu/192.168.74.215:57516
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor15.umiacs.umd.edu/192.168.74.215:57516
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
WARN TaskSetManager - Lost task 3997.0 in stage 276.0 (TID 2100688, trantor04.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor15.umiacs.umd.edu/192.168.74.215:57516
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor15.umiacs.umd.edu/192.168.74.215:57516
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 275:(6685 + 233) / 8878][Stage 276:(5759 + 38) / 8878][Stage 277:(5209 + 22) / 8878]WARN TaskSetManager - Lost task 5364.1 in stage 275.0 (TID 2100843, trantor15.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 275:(6685 + 241) / 8878][Stage 276:(5762 + 38) / 8878][Stage 277:(5209 + 22) / 8878]WARN TaskSetManager - Lost task 6368.0 in stage 270.0 (TID 2082998, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6688 + 243) / 8878][Stage 276:(5763 + 41) / 8878][Stage 277:(5209 + 22) / 8878]WARN TaskSetManager - Lost task 5006.2 in stage 274.0 (TID 2099177, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 275:(6693 + 250) / 8878][Stage 276:(5790 + 40) / 8878][Stage 277:(5210 + 21) / 8878]WARN TaskSetManager - Lost task 5526.3 in stage 275.0 (TID 2101146, trantor16.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
ERROR TaskSetManager - Task 5526 in stage 275.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5130.0 in stage 275.0 (TID 2100816, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7524.0 in stage 275.0 (TID 2101078, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 275.0 (TID 2099052, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5329.0 in stage 275.0 (TID 2101016, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6927.0 in stage 275.0 (TID 2099180, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.1 in stage 275.0 (TID 2100857, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5464.0 in stage 275.0 (TID 2101049, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5382.0 in stage 275.0 (TID 2101034, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5019.0 in stage 275.0 (TID 2099053, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5037.0 in stage 275.0 (TID 2099084, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5495.0 in stage 275.0 (TID 2101056, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 275.0 (TID 2099167, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5126.0 in stage 275.0 (TID 2100911, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5123.0 in stage 275.0 (TID 2100909, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5320.0 in stage 275.0 (TID 2101099, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5088.0 in stage 275.0 (TID 2099207, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5414.0 in stage 275.0 (TID 2100907, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4956.0 in stage 275.0 (TID 2098936, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5061.0 in stage 275.0 (TID 2099113, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5471.0 in stage 275.0 (TID 2100861, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 275.0 (TID 2089689, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5084.0 in stage 275.0 (TID 2099197, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5435.0 in stage 275.0 (TID 2101042, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5392.0 in stage 275.0 (TID 2101102, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 275.0 (TID 2100869, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5042.0 in stage 275.0 (TID 2099090, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5407.0 in stage 275.0 (TID 2101122, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4951.2 in stage 275.0 (TID 2099161, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 275.0 (TID 2098996, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5555.0 in stage 275.0 (TID 2101082, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5082.0 in stage 275.0 (TID 2099188, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5328.0 in stage 275.0 (TID 2101011, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5321.0 in stage 275.0 (TID 2101100, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5950.1 in stage 275.0 (TID 2100844, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4950.0 in stage 275.0 (TID 2098930, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5287.0 in stage 275.0 (TID 2101017, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5420.0 in stage 275.0 (TID 2101132, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4992.0 in stage 275.0 (TID 2098992, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5486.0 in stage 275.0 (TID 2101062, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5083.0 in stage 275.0 (TID 2099194, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5515.0 in stage 275.0 (TID 2101069, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5416.0 in stage 275.0 (TID 2101105, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5452.0 in stage 275.0 (TID 2100969, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5270.0 in stage 275.0 (TID 2100880, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5480.0 in stage 275.0 (TID 2101052, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5327.0 in stage 275.0 (TID 2101114, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5336.0 in stage 275.0 (TID 2101018, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 275.0 (TID 2100862, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5468.0 in stage 275.0 (TID 2101046, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5578.0 in stage 275.0 (TID 2101109, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5129.0 in stage 275.0 (TID 2100873, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 275.0 (TID 2100855, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5591.0 in stage 275.0 (TID 2101111, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5440.0 in stage 275.0 (TID 2100979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5454.0 in stage 275.0 (TID 2100975, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5097.1 in stage 275.0 (TID 2100905, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5275.0 in stage 275.0 (TID 2100881, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5369.0 in stage 275.0 (TID 2101054, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7720.0 in stage 275.0 (TID 2100832, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 275.0 (TID 2099065, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.0 in stage 275.0 (TID 2101103, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5205.0 in stage 275.0 (TID 2101096, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5284.0 in stage 275.0 (TID 2100927, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5455.0 in stage 275.0 (TID 2101148, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 275.0 (TID 2100977, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5614.0 in stage 275.0 (TID 2101038, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5394.1 in stage 275.0 (TID 2093161, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 275.0 (TID 2100842, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 275.0 (TID 2101044, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 275.0 (TID 2099068, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5579.0 in stage 275.0 (TID 2101074, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5507.0 in stage 275.0 (TID 2101154, trantor16.umiacs.umd.edu): org.apache.spark.TaskKilledException
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:194)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
WARN TaskSetManager - Lost task 5485.0 in stage 275.0 (TID 2100879, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6710.0 in stage 275.0 (TID 2097129, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5070.0 in stage 275.0 (TID 2099120, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 275.0 (TID 2100871, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6928.0 in stage 275.0 (TID 2097480, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5444.0 in stage 275.0 (TID 2101048, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8481.0 in stage 275.0 (TID 2100520, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4939.0 in stage 275.0 (TID 2098885, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5318.0 in stage 275.0 (TID 2101097, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5397.0 in stage 275.0 (TID 2100903, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5509.0 in stage 275.0 (TID 2100993, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 275.0 (TID 2100995, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5156.0 in stage 275.0 (TID 2100921, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5366.0 in stage 275.0 (TID 2100951, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5503.0 in stage 275.0 (TID 2101094, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5446.0 in stage 275.0 (TID 2100840, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5105.0 in stage 275.0 (TID 2100829, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6340.0 in stage 275.0 (TID 2095553, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5602.0 in stage 275.0 (TID 2101135, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 275.0 (TID 2100868, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5391.0 in stage 275.0 (TID 2100854, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5013.0 in stage 275.0 (TID 2099051, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 275.0 (TID 2098998, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5046.0 in stage 275.0 (TID 2099093, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5286.0 in stage 275.0 (TID 2100966, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5482.0 in stage 275.0 (TID 2101019, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 275.0 (TID 2099327, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5204.0 in stage 275.0 (TID 2100990, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 275.0 (TID 2099031, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 275.0 (TID 2101010, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5041.0 in stage 275.0 (TID 2099089, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8732.1 in stage 275.0 (TID 2100913, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5484.0 in stage 275.0 (TID 2101025, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7510.0 in stage 275.0 (TID 2100981, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4972.0 in stage 275.0 (TID 2098955, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5413.0 in stage 275.0 (TID 2101104, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5140.0 in stage 275.0 (TID 2100917, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 275.0 (TID 2100997, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6619.0 in stage 275.0 (TID 2096788, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5388.0 in stage 275.0 (TID 2101028, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5460.0 in stage 275.0 (TID 2100845, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4959.0 in stage 275.0 (TID 2098939, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7663.0 in stage 275.0 (TID 2100830, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5451.0 in stage 275.0 (TID 2101007, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5128.0 in stage 275.0 (TID 2100998, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5055.0 in stage 275.0 (TID 2099103, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5353.0 in stage 275.0 (TID 2100934, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5085.1 in stage 275.0 (TID 2100923, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4958.0 in stage 275.0 (TID 2098938, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5100.0 in stage 275.0 (TID 2101021, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5315.0 in stage 275.0 (TID 2100932, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4988.0 in stage 275.0 (TID 2098984, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 275.0 (TID 2101027, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5152.0 in stage 275.0 (TID 2100925, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5068.0 in stage 275.0 (TID 2099119, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5402.0 in stage 275.0 (TID 2101033, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5057.0 in stage 275.0 (TID 2099104, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5080.0 in stage 275.0 (TID 2099169, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5125.0 in stage 275.0 (TID 2101050, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5348.0 in stage 275.0 (TID 2100933, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.0 in stage 275.0 (TID 2098937, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5465.0 in stage 275.0 (TID 2101008, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5095.0 in stage 275.0 (TID 2099228, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4960.0 in stage 275.0 (TID 2098943, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5102.0 in stage 275.0 (TID 2100818, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5033.0 in stage 275.0 (TID 2099082, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6253.0 in stage 275.0 (TID 2095357, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4953.0 in stage 275.0 (TID 2098933, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5549.0 in stage 275.0 (TID 2101006, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5004.0 in stage 275.0 (TID 2099035, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5180.0 in stage 275.0 (TID 2100965, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.0 in stage 275.0 (TID 2096582, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4976.0 in stage 275.0 (TID 2098958, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5566.0 in stage 275.0 (TID 2101045, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5620.0 in stage 275.0 (TID 2101061, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5637.0 in stage 275.0 (TID 2101072, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5350.0 in stage 275.0 (TID 2101020, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7208.0 in stage 275.0 (TID 2100894, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5378.0 in stage 275.0 (TID 2101120, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5020.0 in stage 275.0 (TID 2099063, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5143.0 in stage 275.0 (TID 2100924, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5077.1 in stage 275.0 (TID 2099163, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5594.0 in stage 275.0 (TID 2101036, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5469.0 in stage 275.0 (TID 2100852, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5553.0 in stage 275.0 (TID 2101035, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5053.0 in stage 275.0 (TID 2099100, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4940.0 in stage 275.0 (TID 2098886, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7273.0 in stage 275.0 (TID 2100895, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6635.0 in stage 275.0 (TID 2097985, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 275.0 (TID 2098994, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7444.0 in stage 275.0 (TID 2098715, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 275.0 (TID 2099164, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5447.0 in stage 275.0 (TID 2100915, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 275.0 (TID 2100863, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4978.0 in stage 275.0 (TID 2098970, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7469.0 in stage 275.0 (TID 2100918, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5494.0 in stage 275.0 (TID 2101086, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5030.0 in stage 275.0 (TID 2099071, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7207.0 in stage 275.0 (TID 2100876, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6854.0 in stage 275.0 (TID 2099054, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5172.0 in stage 275.0 (TID 2101066, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5352.0 in stage 275.0 (TID 2101022, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5433.0 in stage 275.0 (TID 2101084, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7183.0 in stage 275.0 (TID 2100821, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5376.0 in stage 275.0 (TID 2101067, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5389.0 in stage 275.0 (TID 2101068, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 275.0 (TID 2098957, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 275.0 (TID 2100859, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5427.0 in stage 275.0 (TID 2101079, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5428.0 in stage 275.0 (TID 2101083, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5040.0 in stage 275.0 (TID 2099088, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 275.0 (TID 2098987, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6851.0 in stage 275.0 (TID 2098999, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5038.0 in stage 275.0 (TID 2099085, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5501.0 in stage 275.0 (TID 2100991, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5185.0 in stage 275.0 (TID 2100972, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5410.0 in stage 275.0 (TID 2100976, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5062.0 in stage 275.0 (TID 2099114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5119.0 in stage 275.0 (TID 2101030, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5528.0 in stage 275.0 (TID 2101071, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5086.1 in stage 275.0 (TID 2100884, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 275.0 (TID 2096534, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 275.0 (TID 2100864, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 275.0 (TID 2098950, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 275.0 (TID 2099099, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6609.0 in stage 275.0 (TID 2097767, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5390.0 in stage 275.0 (TID 2100897, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5351.0 in stage 275.0 (TID 2100944, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5457.0 in stage 275.0 (TID 2100992, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5430.0 in stage 275.0 (TID 2101051, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4971.0 in stage 275.0 (TID 2098954, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5267.0 in stage 275.0 (TID 2100973, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6918.0 in stage 275.0 (TID 2099176, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5003.0 in stage 275.0 (TID 2099034, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5373.0 in stage 275.0 (TID 2100896, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2919.1 in stage 275.0 (TID 2096692, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 275.0 (TID 2098981, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 275.0 (TID 2098969, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7172.0 in stage 275.0 (TID 2099211, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5121.0 in stage 275.0 (TID 2100908, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 275.0 (TID 2099050, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5158.0 in stage 275.0 (TID 2100820, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5160.0 in stage 275.0 (TID 2100926, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5347.0 in stage 275.0 (TID 2101024, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 275.0 (TID 2098973, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5059.0 in stage 275.0 (TID 2099107, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 275.0 (TID 2081191, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 275.0 (TID 2089925, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5790 + 54) / 8878][Stage 277:(5210 + 44) / 8878][Stage 278:(4496 + 25) / 8878]WARN TaskSetManager - Lost task 5135.0 in stage 275.0 (TID 2101065, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.1 in stage 275.0 (TID 2096598, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5314.0 in stage 275.0 (TID 2101091, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 275.0 (TID 2091820, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5096.0 in stage 275.0 (TID 2099233, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4998.0 in stage 275.0 (TID 2098997, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5196.0 in stage 275.0 (TID 2100978, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 275.0 (TID 2096296, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5466.0 in stage 275.0 (TID 2100850, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4936.0 in stage 275.0 (TID 2098882, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 275.0 (TID 2080822, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 275.0 (TID 2083280, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.1 in stage 275.0 (TID 2096646, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4970.0 in stage 275.0 (TID 2098953, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 275.0 (TID 2086491, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5791 + 55) / 8878][Stage 277:(5212 + 44) / 8878][Stage 278:(4498 + 28) / 8878]WARN TaskSetManager - Lost task 5467.0 in stage 275.0 (TID 2101151, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 275.0 (TID 2088301, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 275.0 (TID 2053000, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 275.0 (TID 2091336, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 275.0 (TID 2080796, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2917.0 in stage 275.0 (TID 2096579, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.1 in stage 275.0 (TID 2099162, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5795 + 54) / 8878][Stage 277:(5213 + 44) / 8878][Stage 278:(4504 + 28) / 8878]WARN TaskSetManager - Lost task 5462.0 in stage 275.0 (TID 2100846, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5802 + 54) / 8878][Stage 277:(5215 + 42) / 8878][Stage 278:(4506 + 26) / 8878]WARN TaskSetManager - Lost task 5478.0 in stage 275.0 (TID 2101152, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5810 + 53) / 8878][Stage 277:(5219 + 42) / 8878][Stage 278:(4509 + 23) / 8878]WARN TaskSetManager - Lost task 5481.0 in stage 275.0 (TID 2101153, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5819 + 53) / 8878][Stage 277:(5223 + 42) / 8878][Stage 278:(4511 + 22) / 8878]WARN TaskSetManager - Lost task 5150.0 in stage 275.0 (TID 2100819, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5853 + 47) / 8878][Stage 277:(5233 + 45) / 8878][Stage 278:(4515 + 19) / 8878]WARN TaskSetManager - Lost task 5459.0 in stage 275.0 (TID 2101150, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5856 + 45) / 8878][Stage 277:(5237 + 47) / 8878][Stage 278:(4515 + 19) / 8878]WARN TaskSetManager - Lost task 8624.1 in stage 275.0 (TID 2100922, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(5882 + 37) / 8878][Stage 277:(5299 + 46) / 8878][Stage 278:(4525 + 19) / 8878]ERROR YarnScheduler - Lost executor 34 on trantor04.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6676.0 in stage 276.0 (TID 2101987, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 34 lost)
WARN TaskSetManager - Lost task 5384.0 in stage 276.0 (TID 2101547, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 34 lost)
WARN TaskSetManager - Lost task 5004.0 in stage 276.0 (TID 2101496, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 34 lost)
WARN TaskSetManager - Lost task 6653.0 in stage 276.0 (TID 2101973, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 34 lost)
WARN TaskSetManager - Lost task 5361.0 in stage 276.0 (TID 2101539, trantor04.umiacs.umd.edu): ExecutorLostFailure (executor 34 lost)
[Stage 276:(5900 + 49) / 8878][Stage 277:(5304 + 42) / 8878][Stage 278:(4527 + 19) / 8878]ERROR YarnScheduler - Lost executor 40 on trantor03.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5788.0 in stage 277.0 (TID 2102193, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 40 lost)
WARN TaskSetManager - Lost task 5770.0 in stage 277.0 (TID 2102190, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 40 lost)
WARN TaskSetManager - Lost task 5941.0 in stage 277.0 (TID 2102237, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 40 lost)
WARN TaskSetManager - Lost task 5360.0 in stage 277.0 (TID 2101895, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 40 lost)
WARN TaskSetManager - Lost task 5504.0 in stage 277.0 (TID 2102002, trantor03.umiacs.umd.edu): ExecutorLostFailure (executor 40 lost)
[Stage 276:(6057 + 77) / 8878][Stage 277:(5317 + 33) / 8878][Stage 278:(4536 + 18) / 8878]WARN TaskSetManager - Lost task 5364.2 in stage 275.0 (TID 2101147, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 276:(6104 + 96) / 8878][Stage 277:(5319 + 33) / 8878][Stage 278:(4552 + 18) / 8878]WARN TaskSetManager - Lost task 236.0 in stage 283.0 (TID 2102112, trantor04.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor04.umiacs.umd.edu/192.168.74.204:59349
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor04.umiacs.umd.edu/192.168.74.204:59349
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 276:(6143 + 104) / 8878][Stage 277:(5319 + 38) / 8878][Stage 278:(4552 + 18) / 8878]WARN TaskSetManager - Lost task 1155.0 in stage 283.0 (TID 2102264, trantor09.umiacs.umd.edu): java.io.IOException: Failed to connect to trantor03.umiacs.umd.edu/192.168.74.203:54362
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:191)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:156)
at org.apache.spark.network.netty.NettyBlockTransferService$$anon$1.createAndStart(NettyBlockTransferService.scala:78)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.fetchAllOutstanding(RetryingBlockFetcher.java:140)
at org.apache.spark.network.shuffle.RetryingBlockFetcher.access$200(RetryingBlockFetcher.java:43)
at org.apache.spark.network.shuffle.RetryingBlockFetcher$1.run(RetryingBlockFetcher.java:170)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: trantor03.umiacs.umd.edu/192.168.74.203:54362
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:208)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:287)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
... 1 more
[Stage 276:(6168 + 114) / 8878][Stage 277:(5321 + 39) / 8878][Stage 278:(4553 + 17) / 8878]WARN TaskSetManager - Lost task 6676.1 in stage 276.0 (TID 2102718, trantor04.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 276:(6283 + 148) / 8878][Stage 277:(5325 + 39) / 8878][Stage 278:(4556 + 26) / 8878]ERROR TaskSetManager - Task 6676 in stage 276.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5266.0 in stage 276.0 (TID 2102507, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4688.0 in stage 276.0 (TID 2102896, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 276.0 (TID 2102751, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4963.0 in stage 276.0 (TID 2103013, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4965.0 in stage 276.0 (TID 2102799, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5146.1 in stage 276.0 (TID 2100910, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5130.0 in stage 276.0 (TID 2102498, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4978.0 in stage 276.0 (TID 2103035, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4923.0 in stage 276.0 (TID 2102856, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5017.0 in stage 276.0 (TID 2102801, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5096.0 in stage 276.0 (TID 2102491, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4797.0 in stage 276.0 (TID 2102691, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 276.0 (TID 2103119, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4402.0 in stage 276.0 (TID 2102385, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5502.1 in stage 276.0 (TID 2100904, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 276.0 (TID 2102634, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5070.0 in stage 276.0 (TID 2102991, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4950.0 in stage 276.0 (TID 2102633, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4616.0 in stage 276.0 (TID 2102661, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4902.0 in stage 276.0 (TID 2103005, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4954.0 in stage 276.0 (TID 2099367, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4653.0 in stage 276.0 (TID 2102588, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4561.0 in stage 276.0 (TID 2102858, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5113.0 in stage 276.0 (TID 2103148, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4267.0 in stage 276.0 (TID 2102776, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4988.0 in stage 276.0 (TID 2103024, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4140.0 in stage 276.0 (TID 2101119, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4987.0 in stage 276.0 (TID 2102930, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5162.0 in stage 276.0 (TID 2102506, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5158.0 in stage 276.0 (TID 2102503, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4851.0 in stage 276.0 (TID 2103152, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4512.0 in stage 276.0 (TID 2102848, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4574.0 in stage 276.0 (TID 2102570, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4756.0 in stage 276.0 (TID 2102952, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 276.0 (TID 2102947, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4167.0 in stage 276.0 (TID 2101134, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 276.0 (TID 2102392, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5100.0 in stage 276.0 (TID 2103128, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4872.0 in stage 276.0 (TID 2102784, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5285.0 in stage 276.0 (TID 2102428, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4196.0 in stage 276.0 (TID 2102635, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5009.0 in stage 276.0 (TID 2102349, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5032.0 in stage 276.0 (TID 2103039, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.0 in stage 276.0 (TID 2103110, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4116.0 in stage 276.0 (TID 2101092, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5332.0 in stage 276.0 (TID 2102987, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5165.1 in stage 276.0 (TID 2100906, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5003.0 in stage 276.0 (TID 2102488, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5232.0 in stage 276.0 (TID 2102425, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4414.0 in stage 276.0 (TID 2102785, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4294.0 in stage 276.0 (TID 2102681, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 276.0 (TID 2103020, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4869.0 in stage 276.0 (TID 2102711, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4933.0 in stage 276.0 (TID 2102377, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5030.0 in stage 276.0 (TID 2102810, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5384.1 in stage 276.0 (TID 2102717, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4394.0 in stage 276.0 (TID 2102780, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4798.0 in stage 276.0 (TID 2102958, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.1 in stage 276.0 (TID 2102714, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4660.0 in stage 276.0 (TID 2102903, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5004.1 in stage 276.0 (TID 2102716, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4990.1 in stage 276.0 (TID 2100900, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6653.1 in stage 276.0 (TID 2102715, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5144.0 in stage 276.0 (TID 2102449, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5005.0 in stage 276.0 (TID 2102978, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4890.0 in stage 276.0 (TID 2102819, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3879.0 in stage 276.0 (TID 2100914, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5013.0 in stage 276.0 (TID 2102523, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4545.0 in stage 276.0 (TID 2102851, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 276.0 (TID 2103062, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4444.0 in stage 276.0 (TID 2102816, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 276.0 (TID 2102501, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.0 in stage 276.0 (TID 2102976, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5059.0 in stage 276.0 (TID 2103016, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5084.0 in stage 276.0 (TID 2103088, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5046.0 in stage 276.0 (TID 2102917, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 276.0 (TID 2102871, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 276.0 (TID 2093182, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4123.0 in stage 276.0 (TID 2101098, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4712.0 in stage 276.0 (TID 2102938, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5149.0 in stage 276.0 (TID 2102909, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4939.0 in stage 276.0 (TID 2102631, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4953.0 in stage 276.0 (TID 2103157, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4807.0 in stage 276.0 (TID 2102375, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5401.0 in stage 276.0 (TID 2103015, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4951.0 in stage 276.0 (TID 2103156, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4536.0 in stage 276.0 (TID 2102550, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5477.0 in stage 276.0 (TID 2103146, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 276.0 (TID 2093624, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5409.0 in stage 276.0 (TID 2103133, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5090.0 in stage 276.0 (TID 2102350, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4959.0 in stage 276.0 (TID 2102471, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5002.0 in stage 276.0 (TID 2102516, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4956.0 in stage 276.0 (TID 2103159, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5057.0 in stage 276.0 (TID 2103050, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4921.0 in stage 276.0 (TID 2102630, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4992.0 in stage 276.0 (TID 2102883, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4882.0 in stage 276.0 (TID 2102992, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4546.0 in stage 276.0 (TID 2102870, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4522.0 in stage 276.0 (TID 2102397, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4846.0 in stage 276.0 (TID 2102981, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4949.0 in stage 276.0 (TID 2103104, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4062.0 in stage 276.0 (TID 2100983, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4772.0 in stage 276.0 (TID 2103004, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 276.0 (TID 2102897, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 276.0 (TID 2101885, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4343.0 in stage 276.0 (TID 2102647, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4310.0 in stage 276.0 (TID 2102610, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 276.0 (TID 2102900, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7557.0 in stage 276.0 (TID 2101525, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 276.0 (TID 2103082, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 276.0 (TID 2085680, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5419.0 in stage 276.0 (TID 2103147, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 276.0 (TID 2095333, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 277:(5326 + 55) / 8878][Stage 278:(4556 + 56) / 8878][Stage 279:(3953 + 21) / 8878]WARN TaskSetManager - Lost task 5042.0 in stage 276.0 (TID 2102849, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 276.0 (TID 2086611, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4870.0 in stage 276.0 (TID 2103154, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4886.1 in stage 276.0 (TID 2100901, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4738.0 in stage 276.0 (TID 2102931, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 276.0 (TID 2089552, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 276.0 (TID 2094306, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4881.0 in stage 276.0 (TID 2103155, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 276.0 (TID 2102683, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 276.0 (TID 2101228, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4717.0 in stage 276.0 (TID 2102689, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 276.0 (TID 2091712, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 276.0 (TID 2103163, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 276.0 (TID 2103145, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5506.0 in stage 276.0 (TID 2103162, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 276.0 (TID 2086408, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 276.0 (TID 2102962, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 276.0 (TID 2095395, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4042.0 in stage 276.0 (TID 2100967, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 276.0 (TID 2103160, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4493.0 in stage 276.0 (TID 2102837, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4253.0 in stage 276.0 (TID 2102670, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 276.0 (TID 2083402, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 276.0 (TID 2103023, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.0 in stage 276.0 (TID 2103033, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5062.0 in stage 276.0 (TID 2103164, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5019.0 in stage 276.0 (TID 2103161, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4785.0 in stage 276.0 (TID 2102372, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 277:(5336 + 47) / 8878][Stage 278:(4560 + 55) / 8878][Stage 279:(3957 + 25) / 8878]WARN TaskSetManager - Lost task 6370.0 in stage 276.0 (TID 2070529, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 276.0 (TID 2103165, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 277:(5349 + 44) / 8878][Stage 278:(4588 + 41) / 8878][Stage 279:(3988 + 25) / 8878]WARN TaskSetManager - Lost task 4714.0 in stage 276.0 (TID 2102945, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 277:(6097 + 194) / 8878][Stage 278:(4831 + 78) / 8878][Stage 279:(4088 + 15) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 277.0 (TID 2105526, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 277:(6140 + 194) / 8878][Stage 278:(5014 + 91) / 8878][Stage 279:(4090 + 13) / 8878]WARN TaskSetManager - Lost task 5526.2 in stage 277.0 (TID 2105769, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 277:(6143 + 195) / 8878][Stage 278:(5018 + 92) / 8878][Stage 279:(4090 + 13) / 8878]WARN TaskSetManager - Lost task 5412.0 in stage 275.0 (TID 2100836, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 277:(6153 + 200) / 8878][Stage 278:(5160 + 90) / 8878][Stage 279:(4090 + 13) / 8878]ERROR TaskSetManager - Task 5526 in stage 277.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 6568.0 in stage 277.0 (TID 2105241, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5462.0 in stage 277.0 (TID 2105238, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6574.0 in stage 277.0 (TID 2105311, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6748.0 in stage 277.0 (TID 2105504, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5286.0 in stage 277.0 (TID 2104879, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5032.0 in stage 277.0 (TID 2105137, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5579.0 in stage 277.0 (TID 2105791, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5460.0 in stage 277.0 (TID 2105212, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5005.0 in stage 277.0 (TID 2105136, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 277.0 (TID 2105316, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5960.1 in stage 277.0 (TID 2101156, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 277.0 (TID 2105498, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5095.0 in stage 277.0 (TID 2105248, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4990.0 in stage 277.0 (TID 2105050, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5038.0 in stage 277.0 (TID 2105337, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5077.0 in stage 277.0 (TID 2105774, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5070.0 in stage 277.0 (TID 2105013, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5113.0 in stage 277.0 (TID 2105616, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5402.0 in stage 277.0 (TID 2105451, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5408.0 in stage 277.0 (TID 2105579, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5466.0 in stage 277.0 (TID 2105352, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4987.0 in stage 277.0 (TID 2105004, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 277.0 (TID 2105272, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5391.0 in stage 277.0 (TID 2105082, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5034.0 in stage 277.0 (TID 2105757, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5566.0 in stage 277.0 (TID 2105521, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 277.0 (TID 2105511, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6741.0 in stage 277.0 (TID 2105336, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5140.0 in stage 277.0 (TID 2105011, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4939.0 in stage 277.0 (TID 2104704, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5046.0 in stage 277.0 (TID 2104755, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5287.0 in stage 277.0 (TID 2105442, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5469.0 in stage 277.0 (TID 2105418, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 277.0 (TID 2105424, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5057.0 in stage 277.0 (TID 2104813, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 277.0 (TID 2104853, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5072.0 in stage 277.0 (TID 2105768, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5097.0 in stage 277.0 (TID 2104996, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 277.0 (TID 2105467, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 277.0 (TID 2105395, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 277.0 (TID 2104756, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5128.0 in stage 277.0 (TID 2105285, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.0 in stage 277.0 (TID 2105202, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4963.0 in stage 277.0 (TID 2105704, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5068.0 in stage 277.0 (TID 2105430, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5059.0 in stage 277.0 (TID 2105591, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 277.0 (TID 2104987, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5084.0 in stage 277.0 (TID 2105607, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5108.0 in stage 277.0 (TID 2105887, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 277.0 (TID 2105256, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5152.0 in stage 277.0 (TID 2105485, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 277.0 (TID 2105314, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4988.0 in stage 277.0 (TID 2105422, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.0 in stage 277.0 (TID 2105423, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5080.0 in stage 277.0 (TID 2104989, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4859.0 in stage 277.0 (TID 2105567, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5160.0 in stage 277.0 (TID 2105488, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 277.0 (TID 2105350, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5061.0 in stage 277.0 (TID 2104898, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5103.0 in stage 277.0 (TID 2105849, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5042.0 in stage 277.0 (TID 2105580, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5770.1 in stage 277.0 (TID 2104811, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5315.0 in stage 277.0 (TID 2105502, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 277.0 (TID 2105083, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5100.0 in stage 277.0 (TID 2105614, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5089.0 in stage 277.0 (TID 2105440, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6241.0 in stage 277.0 (TID 2103076, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 277.0 (TID 2104751, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5394.0 in stage 277.0 (TID 2105669, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5143.0 in stage 277.0 (TID 2105477, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5017.0 in stage 277.0 (TID 2105572, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4978.0 in stage 277.0 (TID 2105711, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5146.0 in stage 277.0 (TID 2105478, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3608.0 in stage 277.0 (TID 2104054, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5232.0 in stage 277.0 (TID 2105525, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5022.0 in stage 277.0 (TID 2105752, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6253.0 in stage 277.0 (TID 2105726, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5123.0 in stage 277.0 (TID 2105002, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 277.0 (TID 2104741, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 277.0 (TID 2104707, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5105.0 in stage 277.0 (TID 2105870, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5102.0 in stage 277.0 (TID 2105361, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5098.0 in stage 277.0 (TID 2105450, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5348.0 in stage 277.0 (TID 2105503, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6340.0 in stage 277.0 (TID 2105743, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4956.0 in stage 277.0 (TID 2104977, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4950.0 in stage 277.0 (TID 2104705, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 277.0 (TID 2101457, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5083.0 in stage 277.0 (TID 2104992, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4976.0 in stage 277.0 (TID 2105207, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5130.0 in stage 277.0 (TID 2104849, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4998.0 in stage 277.0 (TID 2105730, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 277.0 (TID 2104876, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5126.0 in stage 277.0 (TID 2105007, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5076.0 in stage 277.0 (TID 2105770, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5328.0 in stage 277.0 (TID 2105178, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5040.0 in stage 277.0 (TID 2105342, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 277.0 (TID 2105121, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5162.0 in stage 277.0 (TID 2104873, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.1 in stage 277.0 (TID 2101160, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5003.0 in stage 277.0 (TID 2104841, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4350.0 in stage 277.0 (TID 2105843, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4915.0 in stage 277.0 (TID 2105673, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4959.0 in stage 277.0 (TID 2104810, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 277.0 (TID 2105000, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 277.0 (TID 2105393, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5004.0 in stage 277.0 (TID 2105750, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 277.0 (TID 2104980, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6227.0 in stage 277.0 (TID 2102950, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5332.0 in stage 277.0 (TID 2105623, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4951.0 in stage 277.0 (TID 2104971, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5471.0 in stage 277.0 (TID 2105109, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 277.0 (TID 2105487, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5019.0 in stage 277.0 (TID 2104982, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 277.0 (TID 2105404, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5091.0 in stage 277.0 (TID 2105201, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5504.1 in stage 277.0 (TID 2104056, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5119.0 in stage 277.0 (TID 2105690, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 277.0 (TID 2105025, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5030.0 in stage 277.0 (TID 2105575, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6471.0 in stage 277.0 (TID 2103151, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5172.0 in stage 277.0 (TID 2105820, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 277.0 (TID 2104875, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 277.0 (TID 2105255, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 277.0 (TID 2105056, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4366.0 in stage 277.0 (TID 2105855, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5045.0 in stage 277.0 (TID 2105185, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 277.0 (TID 2105718, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5388.0 in stage 277.0 (TID 2105324, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5185.0 in stage 277.0 (TID 2105413, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5165.0 in stage 277.0 (TID 2105492, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 277.0 (TID 2105208, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5267.0 in stage 277.0 (TID 2105415, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 277.0 (TID 2105286, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4972.0 in stage 277.0 (TID 2105205, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4335.0 in stage 277.0 (TID 2105775, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5285.0 in stage 277.0 (TID 2105527, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6043.0 in stage 277.0 (TID 2102892, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 277.0 (TID 2104735, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5446.0 in stage 277.0 (TID 2105061, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5163.0 in stage 277.0 (TID 2105806, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5996.1 in stage 277.0 (TID 2102889, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5153.0 in stage 277.0 (TID 2105748, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5336.0 in stage 277.0 (TID 2105474, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5096.0 in stage 277.0 (TID 2104842, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5941.1 in stage 277.0 (TID 2104396, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 277.0 (TID 2105594, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6498.0 in stage 277.0 (TID 2104534, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 277.0 (TID 2101501, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5788.1 in stage 277.0 (TID 2104821, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5088.0 in stage 277.0 (TID 2105354, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4965.0 in stage 277.0 (TID 2105512, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 277.0 (TID 2103351, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 277.0 (TID 2105508, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 277.0 (TID 2105204, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 277.0 (TID 2103867, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 277.0 (TID 2105569, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5125.0 in stage 277.0 (TID 2105700, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5602.0 in stage 277.0 (TID 2105772, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 277.0 (TID 2105529, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5020.0 in stage 277.0 (TID 2105427, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 277.0 (TID 2086070, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5121.0 in stage 277.0 (TID 2105001, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 277.0 (TID 2101512, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4308.0 in stage 277.0 (TID 2105755, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4169.0 in stage 277.0 (TID 2105505, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5360.1 in stage 277.0 (TID 2104057, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 277.0 (TID 2091688, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6526.0 in stage 277.0 (TID 2104698, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 277.0 (TID 2089624, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 277.0 (TID 2105933, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5062.0 in stage 277.0 (TID 2104988, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5101.0 in stage 277.0 (TID 2105460, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5085.0 in stage 277.0 (TID 2105431, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5086.0 in stage 277.0 (TID 2104995, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 277.0 (TID 2086877, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5135.0 in stage 277.0 (TID 2105702, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 277.0 (TID 2104748, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 277.0 (TID 2101544, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5158.0 in stage 277.0 (TID 2104869, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 277.0 (TID 2089237, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5421.0 in stage 277.0 (TID 2105039, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 278:(5160 + 108) / 8878][Stage 279:(4090 + 85) / 8878][Stage 280:(3368 + 53) / 8878]WARN TaskSetManager - Lost task 5250.0 in stage 277.0 (TID 2074708, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 277.0 (TID 2079423, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 277.0 (TID 2083170, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2928.0 in stage 277.0 (TID 2083158, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 277.0 (TID 2089708, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4548.0 in stage 277.0 (TID 2105934, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 277.0 (TID 2081515, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 277.0 (TID 2089362, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 277.0 (TID 2105265, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2929.0 in stage 277.0 (TID 2083163, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2912.0 in stage 277.0 (TID 2081514, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 278:(5165 + 108) / 8878][Stage 279:(4101 + 75) / 8878][Stage 280:(3375 + 52) / 8878]WARN TaskSetManager - Lost task 2925.0 in stage 277.0 (TID 2083129, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 278:(5166 + 108) / 8878][Stage 279:(4126 + 50) / 8878][Stage 280:(3388 + 43) / 8878]WARN TaskSetManager - Lost task 2908.0 in stage 277.0 (TID 2081509, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 278:(5199 + 105) / 8878][Stage 279:(4148 + 30) / 8878][Stage 280:(3412 + 36) / 8878]WARN TaskSetManager - Lost task 4380.0 in stage 277.0 (TID 2105932, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 278:(5252 + 89) / 8878][Stage 279:(4187 + 34) / 8878][Stage 280:(3477 + 30) / 8878]WARN TaskSetManager - Lost task 4953.0 in stage 277.0 (TID 2104974, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 278:(5315 + 66) / 8878][Stage 279:(4235 + 36) / 8878][Stage 280:(3526 + 24) / 8878]WARN TaskSetManager - Lost task 5364.1 in stage 277.0 (TID 2105931, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 278:(6021 + 199) / 8878][Stage 279:(4315 + 30) / 8878][Stage 280:(3566 + 19) / 8878]ERROR YarnScheduler - Lost executor 27 on trantor05.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 3373.0 in stage 278.0 (TID 2105296, trantor05.umiacs.umd.edu): ExecutorLostFailure (executor 27 lost)
WARN TaskSetManager - Lost task 6370.0 in stage 278.0 (TID 2073352, trantor05.umiacs.umd.edu): ExecutorLostFailure (executor 27 lost)
[Stage 278:(6021 + 197) / 8878][Stage 279:(4316 + 29) / 8878][Stage 280:(3566 + 20) / 8878]WARN TaskSetManager - Lost task 4245.0 in stage 284.0 (TID 2107824, trantor05.umiacs.umd.edu): ExecutorLostFailure (executor 27 lost)
WARN TaskSetManager - Lost task 4598.0 in stage 284.0 (TID 2107844, trantor05.umiacs.umd.edu): ExecutorLostFailure (executor 27 lost)
WARN TaskSetManager - Lost task 4973.0 in stage 284.0 (TID 2107868, trantor05.umiacs.umd.edu): ExecutorLostFailure (executor 27 lost)
[Stage 278:(6043 + 199) / 8878][Stage 279:(4383 + 66) / 8878][Stage 280:(3584 + 15) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 278.0 (TID 2108669, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 278:(6060 + 204) / 8878][Stage 279:(4471 + 62) / 8878][Stage 280:(3587 + 16) / 8878]WARN TaskSetManager - Lost task 5526.2 in stage 278.0 (TID 2108792, trantor05.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 278:(6064 + 202) / 8878][Stage 279:(4477 + 66) / 8878][Stage 280:(3587 + 16) / 8878]ERROR TaskSetManager - Task 5526 in stage 278.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5130.0 in stage 278.0 (TID 2107900, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5328.0 in stage 278.0 (TID 2108653, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 278.0 (TID 2108639, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4963.0 in stage 278.0 (TID 2108335, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5101.0 in stage 278.0 (TID 2107977, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4950.0 in stage 278.0 (TID 2107740, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 278.0 (TID 2108642, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5038.0 in stage 278.0 (TID 2108283, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 278.0 (TID 2107765, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4978.0 in stage 278.0 (TID 2108340, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5160.0 in stage 278.0 (TID 2107996, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5057.0 in stage 278.0 (TID 2107775, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5045.0 in stage 278.0 (TID 2108011, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5061.0 in stage 278.0 (TID 2107787, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5072.0 in stage 278.0 (TID 2108352, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5140.0 in stage 278.0 (TID 2107931, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 278.0 (TID 2107986, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5034.0 in stage 278.0 (TID 2108347, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5152.0 in stage 278.0 (TID 2107991, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5085.0 in stage 278.0 (TID 2107969, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 278.0 (TID 2108277, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5108.0 in stage 278.0 (TID 2108376, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5077.0 in stage 278.0 (TID 2108358, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5105.0 in stage 278.0 (TID 2108365, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5388.0 in stage 278.0 (TID 2108570, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5469.0 in stage 278.0 (TID 2108115, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5098.0 in stage 278.0 (TID 2107972, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5084.0 in stage 278.0 (TID 2107849, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5089.0 in stage 278.0 (TID 2107970, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5287.0 in stage 278.0 (TID 2108381, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5471.0 in stage 278.0 (TID 2108216, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5022.0 in stage 278.0 (TID 2108346, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 278.0 (TID 2108042, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4998.0 in stage 278.0 (TID 2108343, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5096.0 in stage 278.0 (TID 2107891, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4953.0 in stage 278.0 (TID 2107814, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4976.0 in stage 278.0 (TID 2108272, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 278.0 (TID 2108258, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5146.0 in stage 278.0 (TID 2107985, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5088.0 in stage 278.0 (TID 2108288, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5119.0 in stage 278.0 (TID 2107875, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5004.0 in stage 278.0 (TID 2108344, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5126.0 in stage 278.0 (TID 2107928, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5267.0 in stage 278.0 (TID 2108330, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4350.0 in stage 278.0 (TID 2108784, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5462.0 in stage 278.0 (TID 2108085, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5391.0 in stage 278.0 (TID 2108041, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 278.0 (TID 2107949, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4988.0 in stage 278.0 (TID 2107954, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 278.0 (TID 2108608, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5030.0 in stage 278.0 (TID 2107830, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4990.0 in stage 278.0 (TID 2107988, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5311.0 in stage 278.0 (TID 2108415, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4558.0 in stage 278.0 (TID 2108807, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4548.0 in stage 278.0 (TID 2108800, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5095.0 in stage 278.0 (TID 2108406, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 278.0 (TID 2107822, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5363.0 in stage 278.0 (TID 2108579, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4308.0 in stage 278.0 (TID 2108778, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 278.0 (TID 2107989, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5086.0 in stage 278.0 (TID 2107851, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5091.0 in stage 278.0 (TID 2108043, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 278.0 (TID 2107950, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4330.0 in stage 278.0 (TID 2108781, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5364.0 in stage 278.0 (TID 2108520, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5402.0 in stage 278.0 (TID 2108752, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5102.0 in stage 278.0 (TID 2108292, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 278.0 (TID 2107942, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4987.0 in stage 278.0 (TID 2107982, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4956.0 in stage 278.0 (TID 2107817, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.0 in stage 278.0 (TID 2107956, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 278.0 (TID 2093691, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5097.0 in stage 278.0 (TID 2107854, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5233.0 in stage 278.0 (TID 2108088, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5315.0 in stage 278.0 (TID 2108046, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5032.0 in stage 278.0 (TID 2108002, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5080.0 in stage 278.0 (TID 2107831, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6253.0 in stage 278.0 (TID 2108578, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5083.0 in stage 278.0 (TID 2107833, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5437.0 in stage 278.0 (TID 2108647, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5143.0 in stage 278.0 (TID 2107983, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5285.0 in stage 278.0 (TID 2107685, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5042.0 in stage 278.0 (TID 2107835, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 278.0 (TID 2108268, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 278.0 (TID 2108280, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5421.0 in stage 278.0 (TID 2108072, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5340.0 in stage 278.0 (TID 2108664, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 278.0 (TID 2107904, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 278.0 (TID 2107819, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 278.0 (TID 2106303, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 278.0 (TID 2108419, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5017.0 in stage 278.0 (TID 2107815, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5394.0 in stage 278.0 (TID 2108538, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5165.0 in stage 278.0 (TID 2108014, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5175.0 in stage 278.0 (TID 2107943, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 278.0 (TID 2106303, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 278.0 (TID 2108419, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5017.0 in stage 278.0 (TID 2107815, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5175.0 in stage 278.0 (TID 2107943, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 278.0 (TID 2106303, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 278.0 (TID 2108419, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5017.0 in stage 278.0 (TID 2107815, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 7557.0 in stage 278.0 (TID 2106605, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 278.0 (TID 2106303, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 278.0 (TID 2108419, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5017.0 in stage 278.0 (TID 2107815, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5099.0 in stage 278.0 (TID 2108419, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5017.0 in stage 278.0 (TID 2107815, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5017.0 in stage 278.0 (TID 2107815, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5017.0 in stage 278.0 (TID 2107815, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5418 + 129) / 8878][Stage 280:(3800 + 56) / 8878][Stage 281:(3952 + 29) / 8878]
WARN TaskSetManager - Lost task 5036.0 in stage 278.0 (TID 2107877, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5266.0 in stage 278.0 (TID 2107920, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 278.0 (TID 2107960, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 278.0 (TID 2094390, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 278.0 (TID 2107979, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 278.0 (TID 2108431, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 278.0 (TID 2108777, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 278.0 (TID 2108773, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 278.0 (TID 2108068, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 278.0 (TID 2106083, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 278.0 (TID 2107741, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5425.0 in stage 278.0 (TID 2108623, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 278.0 (TID 2107998, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 278.0 (TID 2107668, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 278.0 (TID 2107788, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 278.0 (TID 2108724, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 278.0 (TID 2107967, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 278.0 (TID 2105935, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 278.0 (TID 2108810, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5079.0 in stage 278.0 (TID 2107843, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 278.0 (TID 2108673, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 278.0 (TID 2101166, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 278.0 (TID 2107955, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5278.0 in stage 278.0 (TID 2107945, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 278.0 (TID 2108799, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4477 + 129) / 8878][Stage 280:(3587 + 43) / 8878][Stage 281:(3736 + 79) / 8878]WARN TaskSetManager - Lost task 5008.0 in stage 278.0 (TID 2107973, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 278.0 (TID 2106559, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5295.0 in stage 278.0 (TID 2107975, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3712.0 in stage 278.0 (TID 2105705, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 278.0 (TID 2108297, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 278.0 (TID 2103433, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 278.0 (TID 2103112, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5118.0 in stage 278.0 (TID 2107792, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 278.0 (TID 2103121, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 278.0 (TID 2103806, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5470.0 in stage 278.0 (TID 2108700, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 278.0 (TID 2101418, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 278.0 (TID 2106759, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 278.0 (TID 2108568, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 278.0 (TID 2103122, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 278.0 (TID 2103134, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 278.0 (TID 2103114, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3382.0 in stage 278.0 (TID 2105303, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 278.0 (TID 2108814, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 278.0 (TID 2093563, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.1 in stage 278.0 (TID 2108459, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 278.0 (TID 2102964, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 278.0 (TID 2084458, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 278.0 (TID 2102775, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4486 + 125) / 8878][Stage 280:(3589 + 46) / 8878][Stage 281:(3738 + 81) / 8878]WARN TaskSetManager - Lost task 5251.0 in stage 278.0 (TID 2091945, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4536 + 82) / 8878][Stage 280:(3595 + 41) / 8878][Stage 281:(3767 + 61) / 8878]WARN TaskSetManager - Lost task 5324.0 in stage 278.0 (TID 2094191, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(4590 + 69) / 8878][Stage 280:(3728 + 36) / 8878][Stage 281:(3909 + 48) / 8878]WARN TaskSetManager - Lost task 5113.0 in stage 278.0 (TID 2107871, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5428 + 128) / 8878][Stage 280:(3833 + 49) / 8878][Stage 281:(3964 + 31) / 8878]WARN TaskSetManager - Lost task 5466.0 in stage 278.0 (TID 2108089, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5438 + 128) / 8878][Stage 280:(3834 + 49) / 8878][Stage 281:(3973 + 26) / 8878]WARN TaskSetManager - Lost task 5460.0 in stage 278.0 (TID 2108084, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5567 + 153) / 8878][Stage 280:(4014 + 63) / 8878][Stage 281:(3989 + 21) / 8878]WARN TaskSetManager - Lost task 3514.0 in stage 277.0 (TID 2083190, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 279:(5595 + 154) / 8878][Stage 280:(4015 + 63) / 8878][Stage 281:(3989 + 22) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 279.0 (TID 2112038, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 279:(5855 + 197) / 8878][Stage 280:(4134 + 66) / 8878][Stage 281:(4008 + 23) / 8878]WARN TaskSetManager - Lost task 5526.3 in stage 279.0 (TID 2112506, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
ERROR TaskSetManager - Task 5526 in stage 279.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5095.0 in stage 279.0 (TID 2111072, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5003.0 in stage 279.0 (TID 2112433, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4987.0 in stage 279.0 (TID 2111018, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5096.0 in stage 279.0 (TID 2112435, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5607.0 in stage 279.0 (TID 2112323, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5340.0 in stage 279.0 (TID 2112343, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5175.0 in stage 279.0 (TID 2110725, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5421.0 in stage 279.0 (TID 2111888, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5128.0 in stage 279.0 (TID 2111086, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5108.0 in stage 279.0 (TID 2110927, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5391.0 in stage 279.0 (TID 2111129, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5032.0 in stage 279.0 (TID 2111035, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5019.0 in stage 279.0 (TID 2111979, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 279.0 (TID 2111945, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5223.0 in stage 279.0 (TID 2112251, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 279.0 (TID 2111163, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5004.0 in stage 279.0 (TID 2110824, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5091.0 in stage 279.0 (TID 2111071, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5020.0 in stage 279.0 (TID 2110897, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5579.0 in stage 279.0 (TID 2112069, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5373.0 in stage 279.0 (TID 2112491, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 279.0 (TID 2111986, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5227.0 in stage 279.0 (TID 2112278, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5199.0 in stage 279.0 (TID 2111887, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5077.0 in stage 279.0 (TID 2110857, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5230.0 in stage 279.0 (TID 2112280, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 279.0 (TID 2111077, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 279.0 (TID 2111135, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5089.0 in stage 279.0 (TID 2110913, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5086.0 in stage 279.0 (TID 2111997, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 279.0 (TID 2111880, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 280:(4134 + 89) / 8878][Stage 281:(4008 + 26) / 8878][Stage 282:(2122 + 32) / 8878]WARN TaskSetManager - Lost task 5105.0 in stage 279.0 (TID 2110901, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5595.0 in stage 279.0 (TID 2112254, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 279.0 (TID 2111100, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 279.0 (TID 2110996, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5083.0 in stage 279.0 (TID 2111992, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5080.0 in stage 279.0 (TID 2111987, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 279.0 (TID 2112013, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 279.0 (TID 2111995, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4990.0 in stage 279.0 (TID 2111024, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5068.0 in stage 279.0 (TID 2110903, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5402.0 in stage 279.0 (TID 2112392, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4963.0 in stage 279.0 (TID 2110780, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3977.0 in stage 279.0 (TID 2112362, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5038.0 in stage 279.0 (TID 2112182, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 279.0 (TID 2110798, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4939.0 in stage 279.0 (TID 2112213, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5566.0 in stage 279.0 (TID 2112029, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5315.0 in stage 279.0 (TID 2112451, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3946.0 in stage 279.0 (TID 2112342, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3544.0 in stage 279.0 (TID 2112056, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3671.0 in stage 279.0 (TID 2112242, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5072.0 in stage 279.0 (TID 2110844, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5098.0 in stage 279.0 (TID 2110925, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.0 in stage 279.0 (TID 2112168, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5267.0 in stage 279.0 (TID 2112429, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3470.0 in stage 279.0 (TID 2111941, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3609.0 in stage 279.0 (TID 2112227, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5287.0 in stage 279.0 (TID 2112434, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 279.0 (TID 2105968, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5336.0 in stage 279.0 (TID 2112447, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5469.0 in stage 279.0 (TID 2111935, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 279.0 (TID 2111980, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5182.0 in stage 279.0 (TID 2111863, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 279.0 (TID 2112170, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5152.0 in stage 279.0 (TID 2112357, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5602.0 in stage 279.0 (TID 2112131, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5045.0 in stage 279.0 (TID 2111039, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 279.0 (TID 2111073, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5076.0 in stage 279.0 (TID 2110853, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4380.0 in stage 279.0 (TID 2112495, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 279.0 (TID 2112175, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 279.0 (TID 2110460, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 279.0 (TID 2112060, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4998.0 in stage 279.0 (TID 2110811, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4335.0 in stage 279.0 (TID 2112445, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4972.0 in stage 279.0 (TID 2112171, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5102.0 in stage 279.0 (TID 2112269, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7864.0 in stage 279.0 (TID 2112301, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5078.0 in stage 279.0 (TID 2112370, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5348.0 in stage 279.0 (TID 2112465, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3804.0 in stage 279.0 (TID 2112305, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5160.0 in stage 279.0 (TID 2112371, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5394.0 in stage 279.0 (TID 2112347, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3595.0 in stage 279.0 (TID 2112225, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5062.0 in stage 279.0 (TID 2111985, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5061.0 in stage 279.0 (TID 2112325, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7837.0 in stage 279.0 (TID 2108719, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5088.0 in stage 279.0 (TID 2112241, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4986.0 in stage 279.0 (TID 2112215, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4951.0 in stage 279.0 (TID 2111964, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3621.0 in stage 279.0 (TID 2112234, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5040.0 in stage 279.0 (TID 2112183, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 279.0 (TID 2111977, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4988.0 in stage 279.0 (TID 2110888, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5232.0 in stage 279.0 (TID 2110430, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7747.0 in stage 279.0 (TID 2108029, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5085.0 in stage 279.0 (TID 2110906, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7862.0 in stage 279.0 (TID 2110154, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 279.0 (TID 2110974, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 279.0 (TID 2112273, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7447.0 in stage 279.0 (TID 2108022, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4254.0 in stage 279.0 (TID 2112089, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4978.0 in stage 279.0 (TID 2110794, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5012.0 in stage 279.0 (TID 2112221, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5103.0 in stage 279.0 (TID 2110866, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4950.0 in stage 279.0 (TID 2112214, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 279.0 (TID 2110951, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5185.0 in stage 279.0 (TID 2112425, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4953.0 in stage 279.0 (TID 2111969, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 279.0 (TID 2111007, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5052.0 in stage 279.0 (TID 2112228, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 279.0 (TID 2112379, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5146.0 in stage 279.0 (TID 2112315, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.0 in stage 279.0 (TID 2108609, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5057.0 in stage 279.0 (TID 2112293, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4272.0 in stage 279.0 (TID 2112311, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 279.0 (TID 2108607, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5332.0 in stage 279.0 (TID 2112015, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5285.0 in stage 279.0 (TID 2110436, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.0 in stage 279.0 (TID 2110890, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5005.0 in stage 279.0 (TID 2111027, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4330.0 in stage 279.0 (TID 2112330, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 279.0 (TID 2112455, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4308.0 in stage 279.0 (TID 2112326, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3186.0 in stage 279.0 (TID 2108789, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 279.0 (TID 2110892, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 279.0 (TID 2110931, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 279.0 (TID 2110880, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3189.0 in stage 279.0 (TID 2108801, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5133.0 in stage 279.0 (TID 2110615, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 279.0 (TID 2110884, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5364.0 in stage 279.0 (TID 2112268, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 279.0 (TID 2110375, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5388.0 in stage 279.0 (TID 2112368, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2926.0 in stage 279.0 (TID 2108477, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4366.0 in stage 279.0 (TID 2112492, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2919.0 in stage 279.0 (TID 2108611, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 279.0 (TID 2112173, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4956.0 in stage 279.0 (TID 2111974, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5034.0 in stage 279.0 (TID 2110827, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 279.0 (TID 2112046, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5471.0 in stage 279.0 (TID 2111151, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5070.0 in stage 279.0 (TID 2111104, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5097.0 in stage 279.0 (TID 2111999, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.0 in stage 279.0 (TID 2108610, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3947.0 in stage 279.0 (TID 2112346, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 279.0 (TID 2111013, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 279.0 (TID 2111025, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3827.0 in stage 279.0 (TID 2112306, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2907.0 in stage 279.0 (TID 2108603, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5022.0 in stage 279.0 (TID 2110826, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2909.0 in stage 279.0 (TID 2108605, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 279.0 (TID 2106976, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 279.0 (TID 2106678, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 279.0 (TID 2107325, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3769.0 in stage 279.0 (TID 2112294, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3136.0 in stage 279.0 (TID 2108753, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5165.0 in stage 279.0 (TID 2112415, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4350.0 in stage 279.0 (TID 2112446, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 279.0 (TID 2108989, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.0 in stage 279.0 (TID 2108612, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5101.0 in stage 279.0 (TID 2110930, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4043.0 in stage 279.0 (TID 2112411, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 279.0 (TID 2109446, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2917.0 in stage 279.0 (TID 2108476, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 279.0 (TID 2109207, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 279.0 (TID 2089560, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5143.0 in stage 279.0 (TID 2112300, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 279.0 (TID 2089398, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 279.0 (TID 2107164, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4976.0 in stage 279.0 (TID 2112172, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.0 in stage 279.0 (TID 2108606, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 279.0 (TID 2108604, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 279.0 (TID 2102420, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5184.0 in stage 279.0 (TID 2111872, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 279.0 (TID 2102371, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 279.0 (TID 2104221, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 279.0 (TID 2109951, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 279.0 (TID 2101284, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 279.0 (TID 2103417, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2929.0 in stage 279.0 (TID 2108615, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.0 in stage 279.0 (TID 2111023, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 279.0 (TID 2106098, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4959.0 in stage 279.0 (TID 2112419, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8616.0 in stage 279.0 (TID 2100756, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 279.0 (TID 2101308, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 279.0 (TID 2111881, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.0 in stage 279.0 (TID 2108613, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7537.0 in stage 279.0 (TID 2108156, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 279.0 (TID 2108617, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 280:(4136 + 98) / 8878][Stage 281:(4008 + 43) / 8878][Stage 282:(2124 + 96) / 8878]WARN TaskSetManager - Lost task 6807.0 in stage 279.0 (TID 2108001, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2930.0 in stage 279.0 (TID 2108616, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 279.0 (TID 2104458, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7557.0 in stage 279.0 (TID 2109740, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2927.0 in stage 279.0 (TID 2108614, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 280:(4150 + 85) / 8878][Stage 281:(4013 + 44) / 8878][Stage 282:(2145 + 82) / 8878]WARN TaskSetManager - Lost task 5650.0 in stage 279.0 (TID 2112507, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 280:(5214 + 208) / 8878][Stage 281:(4151 + 30) / 8878][Stage 282:(2490 + 38) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 280.0 (TID 2114625, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 280:(5475 + 181) / 8878][Stage 281:(4300 + 49) / 8878][Stage 282:(2535 + 57) / 8878]WARN TaskSetManager - Lost task 5526.2 in stage 280.0 (TID 2115307, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 280:(5482 + 185) / 8878][Stage 281:(4303 + 46) / 8878][Stage 282:(2535 + 57) / 8878]ERROR TaskSetManager - Task 5526 in stage 280.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 4951.0 in stage 280.0 (TID 2114369, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4975.0 in stage 280.0 (TID 2113445, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.0 in stage 280.0 (TID 2114809, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 280.0 (TID 2114316, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5088.0 in stage 280.0 (TID 2114803, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5421.0 in stage 280.0 (TID 2113980, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 280.0 (TID 2114792, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5108.0 in stage 280.0 (TID 2114761, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 280.0 (TID 2114811, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 280.0 (TID 2114632, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5091.0 in stage 280.0 (TID 2114673, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2928.0 in stage 280.0 (TID 2113466, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5121.0 in stage 280.0 (TID 2115310, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.0 in stage 280.0 (TID 2113510, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5185.0 in stage 280.0 (TID 2114838, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 280.0 (TID 2114698, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5045.0 in stage 280.0 (TID 2114647, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.0 in stage 280.0 (TID 2114782, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5097.0 in stage 280.0 (TID 2114436, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5098.0 in stage 280.0 (TID 2114820, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 280.0 (TID 2114551, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5199.0 in stage 280.0 (TID 2115303, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5005.0 in stage 280.0 (TID 2114633, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 280.0 (TID 2114786, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 280.0 (TID 2114610, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5077.0 in stage 280.0 (TID 2114740, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 280.0 (TID 2113999, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 280.0 (TID 2114806, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5070.0 in stage 280.0 (TID 2114476, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.0 in stage 280.0 (TID 2113631, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 280.0 (TID 2114807, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4990.0 in stage 280.0 (TID 2114629, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5165.0 in stage 280.0 (TID 2114881, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 280.0 (TID 2114825, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 280.0 (TID 2114402, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5004.0 in stage 280.0 (TID 2114712, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5160.0 in stage 280.0 (TID 2114852, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5101.0 in stage 280.0 (TID 2114824, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5034.0 in stage 280.0 (TID 2114718, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4988.0 in stage 280.0 (TID 2114808, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5128.0 in stage 280.0 (TID 2114727, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5020.0 in stage 280.0 (TID 2114813, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3804.0 in stage 280.0 (TID 2115320, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 280.0 (TID 2114762, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5068.0 in stage 280.0 (TID 2114814, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5038.0 in stage 280.0 (TID 2114795, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5083.0 in stage 280.0 (TID 2114429, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5184.0 in stage 280.0 (TID 2113777, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5103.0 in stage 280.0 (TID 2114750, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5019.0 in stage 280.0 (TID 2114400, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5175.0 in stage 280.0 (TID 2113727, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 280.0 (TID 2114704, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2628.0 in stage 280.0 (TID 2113600, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5086.0 in stage 280.0 (TID 2114431, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 280.0 (TID 2114396, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 280.0 (TID 2114607, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 280.0 (TID 2114472, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2543.0 in stage 280.0 (TID 2112483, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5143.0 in stage 280.0 (TID 2114831, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5095.0 in stage 280.0 (TID 2114691, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3669.0 in stage 280.0 (TID 2113696, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5085.0 in stage 280.0 (TID 2114817, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2311.0 in stage 280.0 (TID 2112282, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5032.0 in stage 280.0 (TID 2114638, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5394.0 in stage 280.0 (TID 2115300, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 280.0 (TID 2114815, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5607.0 in stage 280.0 (TID 2115314, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 280.0 (TID 2102660, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 280.0 (TID 2114639, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4987.0 in stage 280.0 (TID 2114622, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2561.0 in stage 280.0 (TID 2112493, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5182.0 in stage 280.0 (TID 2113754, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5391.0 in stage 280.0 (TID 2114547, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5332.0 in stage 280.0 (TID 2114325, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5340.0 in stage 280.0 (TID 2114810, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5117.0 in stage 280.0 (TID 2114709, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5364.0 in stage 280.0 (TID 2114832, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 280.0 (TID 2113619, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 280.0 (TID 2114822, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 280.0 (TID 2114677, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4978.0 in stage 280.0 (TID 2114700, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5072.0 in stage 280.0 (TID 2114737, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4972.0 in stage 280.0 (TID 2114785, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.0 in stage 280.0 (TID 2113489, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 280.0 (TID 2114783, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4268.0 in stage 280.0 (TID 2113970, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2563.0 in stage 280.0 (TID 2112494, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5007.0 in stage 280.0 (TID 2113483, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5040.0 in stage 280.0 (TID 2114796, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2273.0 in stage 280.0 (TID 2112267, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5013.0 in stage 280.0 (TID 2114467, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5285.0 in stage 280.0 (TID 2114223, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2569.0 in stage 280.0 (TID 2112500, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2379.0 in stage 280.0 (TID 2112385, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 280.0 (TID 2115308, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 280.0 (TID 2114791, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2343.0 in stage 280.0 (TID 2112318, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2546.0 in stage 280.0 (TID 2112484, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.0 in stage 280.0 (TID 2112825, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2923.0 in stage 280.0 (TID 2111287, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4963.0 in stage 280.0 (TID 2114694, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.0 in stage 280.0 (TID 2113514, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5267.0 in stage 280.0 (TID 2114863, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 280.0 (TID 2113800, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2912.0 in stage 280.0 (TID 2113451, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 280.0 (TID 2109671, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2915.0 in stage 280.0 (TID 2113458, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 280.0 (TID 2113821, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6253.0 in stage 280.0 (TID 2115312, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5089.0 in stage 280.0 (TID 2114819, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5076.0 in stage 280.0 (TID 2114738, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5146.0 in stage 280.0 (TID 2114833, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 280.0 (TID 2113732, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5105.0 in stage 280.0 (TID 2114753, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2909.0 in stage 280.0 (TID 2114383, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4998.0 in stage 280.0 (TID 2114707, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5022.0 in stage 280.0 (TID 2114717, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 280.0 (TID 2113474, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2917.0 in stage 280.0 (TID 2113563, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 280.0 (TID 2114344, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2929.0 in stage 280.0 (TID 2113968, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 280.0 (TID 2113733, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 280.0 (TID 2112892, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2308.0 in stage 280.0 (TID 2112277, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5133.0 in stage 280.0 (TID 2113624, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 280.0 (TID 2113928, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3827.0 in stage 280.0 (TID 2115323, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3040.0 in stage 280.0 (TID 2113614, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2926.0 in stage 280.0 (TID 2113569, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3856.0 in stage 280.0 (TID 2113929, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 280.0 (TID 2114075, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 280.0 (TID 2113806, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2316.0 in stage 280.0 (TID 2112291, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2230.0 in stage 280.0 (TID 2112257, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2548.0 in stage 280.0 (TID 2112485, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4956.0 in stage 280.0 (TID 2114391, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5471.0 in stage 280.0 (TID 2114598, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4953.0 in stage 280.0 (TID 2114370, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.0 in stage 280.0 (TID 2111845, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5062.0 in stage 280.0 (TID 2114408, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5102.0 in stage 280.0 (TID 2114812, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5080.0 in stage 280.0 (TID 2114422, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5602.0 in stage 280.0 (TID 2114788, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 280.0 (TID 2113720, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2344.0 in stage 280.0 (TID 2112324, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2566.0 in stage 280.0 (TID 2112498, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.0 in stage 280.0 (TID 2112672, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2907.0 in stage 280.0 (TID 2113945, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4022.0 in stage 280.0 (TID 2115325, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4013.0 in stage 280.0 (TID 2115324, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5232.0 in stage 280.0 (TID 2114143, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2918.0 in stage 280.0 (TID 2114627, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2392.0 in stage 280.0 (TID 2112396, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2389.0 in stage 280.0 (TID 2112389, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7557.0 in stage 280.0 (TID 2113078, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5152.0 in stage 280.0 (TID 2114848, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2565.0 in stage 280.0 (TID 2112497, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4976.0 in stage 280.0 (TID 2114790, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2919.0 in stage 280.0 (TID 2115309, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2927.0 in stage 280.0 (TID 2115311, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 280.0 (TID 2107216, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 281:(4304 + 57) / 8878][Stage 282:(2535 + 72) / 8878][Stage 283:(1929 + 43) / 8878]WARN TaskSetManager - Lost task 2930.0 in stage 280.0 (TID 2113709, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 280.0 (TID 2102839, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5248.0 in stage 280.0 (TID 2109592, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.0 in stage 280.0 (TID 2113700, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5650.0 in stage 280.0 (TID 2115329, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8616.0 in stage 280.0 (TID 2103032, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 280.0 (TID 2107205, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 280.0 (TID 2109963, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2931.0 in stage 280.0 (TID 2091966, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 280.0 (TID 2106500, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 280.0 (TID 2110497, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 280.0 (TID 2113210, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 281:(4305 + 59) / 8878][Stage 282:(2535 + 77) / 8878][Stage 283:(1935 + 45) / 8878]WARN TaskSetManager - Lost task 5310.0 in stage 280.0 (TID 2103586, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3355.0 in stage 280.0 (TID 2113694, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 280.0 (TID 2103378, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 280.0 (TID 2109547, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 281:(4307 + 59) / 8878][Stage 282:(2535 + 79) / 8878][Stage 283:(1944 + 47) / 8878]WARN TaskSetManager - Lost task 5250.0 in stage 280.0 (TID 2108562, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 280.0 (TID 2107167, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2470.0 in stage 280.0 (TID 2112452, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2375.0 in stage 280.0 (TID 2112374, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2581.0 in stage 280.0 (TID 2112504, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 281:(4319 + 58) / 8878][Stage 282:(2545 + 82) / 8878][Stage 283:(1978 + 44) / 8878]WARN TaskSetManager - Lost task 2369.0 in stage 280.0 (TID 2112360, trantor16.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 281:(4409 + 40) / 8878][Stage 282:(2764 + 79) / 8878][Stage 283:(2261 + 36) / 8878]ERROR YarnScheduler - Lost executor 6 on trantor19.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 5362.0 in stage 281.0 (TID 2115381, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 6 lost)
WARN TaskSetManager - Lost task 5249.0 in stage 281.0 (TID 2115285, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 6 lost)
WARN TaskSetManager - Lost task 5921.0 in stage 281.0 (TID 2115502, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 6 lost)
WARN TaskSetManager - Lost task 1106.0 in stage 282.0 (TID 2116355, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 6 lost)
WARN TaskSetManager - Lost task 975.0 in stage 282.0 (TID 2116354, trantor19.umiacs.umd.edu): ExecutorLostFailure (executor 6 lost)
[Stage 281:(5323 + 188) / 8878][Stage 282:(2787 + 70) / 8878][Stage 283:(2283 + 32) / 8878]WARN TaskSetManager - Lost task 5526.0 in stage 281.0 (TID 2117516, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 281:(5592 + 196) / 8878][Stage 282:(2815 + 85) / 8878][Stage 283:(2301 + 31) / 8878]WARN TaskSetManager - Lost task 5469.0 in stage 280.0 (TID 2114212, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 281:(5737 + 202) / 8878][Stage 282:(2895 + 87) / 8878][Stage 283:(2305 + 27) / 8878]WARN TaskSetManager - Lost task 5526.3 in stage 281.0 (TID 2118192, trantor22.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
ERROR TaskSetManager - Task 5526 in stage 281.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 4990.0 in stage 281.0 (TID 2117410, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5091.0 in stage 281.0 (TID 2117445, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5385.0 in stage 281.0 (TID 2117542, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5543.0 in stage 281.0 (TID 2117548, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2929.0 in stage 281.0 (TID 2116582, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5086.0 in stage 281.0 (TID 2116827, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5249.1 in stage 281.0 (TID 2116447, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5362.1 in stage 281.0 (TID 2116474, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5132.0 in stage 281.0 (TID 2118186, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5005.0 in stage 281.0 (TID 2117421, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5036.0 in stage 281.0 (TID 2116720, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5364.0 in stage 281.0 (TID 2117514, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3743.0 in stage 281.0 (TID 2118034, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5162.0 in stage 281.0 (TID 2118095, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5160.0 in stage 281.0 (TID 2118112, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5062.0 in stage 281.0 (TID 2116737, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5607.0 in stage 281.0 (TID 2117877, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5602.0 in stage 281.0 (TID 2117601, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5182.0 in stage 281.0 (TID 2116768, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4507.0 in stage 281.0 (TID 2118175, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5032.0 in stage 281.0 (TID 2117426, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5276.0 in stage 281.0 (TID 2117721, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5070.0 in stage 281.0 (TID 2117406, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5098.0 in stage 281.0 (TID 2117699, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5027.0 in stage 281.0 (TID 2116729, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5020.0 in stage 281.0 (TID 2117683, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5408.0 in stage 281.0 (TID 2117606, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5391.0 in stage 281.0 (TID 2117474, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4967.0 in stage 281.0 (TID 2118077, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4920.0 in stage 281.0 (TID 2118173, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5175.0 in stage 281.0 (TID 2116761, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5340.0 in stage 281.0 (TID 2118090, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4997.0 in stage 281.0 (TID 2118107, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4987.0 in stage 281.0 (TID 2117407, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5000.0 in stage 281.0 (TID 2116722, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5096.0 in stage 281.0 (TID 2117963, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4963.0 in stage 281.0 (TID 2117677, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5388.0 in stage 281.0 (TID 2117550, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5595.0 in stage 281.0 (TID 2117706, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5088.0 in stage 281.0 (TID 2118179, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5003.0 in stage 281.0 (TID 2117956, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5023.0 in stage 281.0 (TID 2117399, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5126.0 in stage 281.0 (TID 2118062, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5014.0 in stage 281.0 (TID 2117682, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4533.0 in stage 281.0 (TID 2117745, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4978.0 in stage 281.0 (TID 2117685, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5095.0 in stage 281.0 (TID 2117446, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4535.0 in stage 281.0 (TID 2118048, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5101.0 in stage 281.0 (TID 2117700, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5083.0 in stage 281.0 (TID 2116789, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5013.0 in stage 281.0 (TID 2117398, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5072.0 in stage 281.0 (TID 2117702, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4977.0 in stage 281.0 (TID 2117670, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5045.0 in stage 281.0 (TID 2117430, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5089.0 in stage 281.0 (TID 2117698, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6253.0 in stage 281.0 (TID 2117915, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5146.0 in stage 281.0 (TID 2118073, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5373.0 in stage 281.0 (TID 2118114, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5001.0 in stage 281.0 (TID 2117414, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5108.0 in stage 281.0 (TID 2117717, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4951.0 in stage 281.0 (TID 2116696, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5150.0 in stage 281.0 (TID 2118021, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5536.0 in stage 281.0 (TID 2116889, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4981.0 in stage 281.0 (TID 2117671, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4919.0 in stage 281.0 (TID 2118171, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5134.0 in stage 281.0 (TID 2117712, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5618.0 in stage 281.0 (TID 2118101, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4204.0 in stage 281.0 (TID 2118177, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5189.0 in stage 281.0 (TID 2117529, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4993.0 in stage 281.0 (TID 2117688, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5076.0 in stage 281.0 (TID 2117707, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5099.0 in stage 281.0 (TID 2117449, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2916.0 in stage 281.0 (TID 2116645, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5421.0 in stage 281.0 (TID 2116758, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4972.0 in stage 281.0 (TID 2118081, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5034.0 in stage 281.0 (TID 2117695, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5077.0 in stage 281.0 (TID 2117708, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4633.0 in stage 281.0 (TID 2118102, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5038.0 in stage 281.0 (TID 2118138, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4268.0 in stage 281.0 (TID 2118030, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5629.0 in stage 281.0 (TID 2118188, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4774.0 in stage 281.0 (TID 2117880, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5128.0 in stage 281.0 (TID 2117475, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5085.0 in stage 281.0 (TID 2117692, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5361.0 in stage 281.0 (TID 2118093, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4052.0 in stage 281.0 (TID 2118111, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5040.0 in stage 281.0 (TID 2118150, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5485.0 in stage 281.0 (TID 2117498, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5011.0 in stage 281.0 (TID 2117678, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5105.0 in stage 281.0 (TID 2117715, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5158.0 in stage 281.0 (TID 2118075, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5309.0 in stage 281.0 (TID 2118001, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5103.0 in stage 281.0 (TID 2117714, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5921.1 in stage 281.0 (TID 2116440, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5133.0 in stage 281.0 (TID 2116759, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5184.0 in stage 281.0 (TID 2117469, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4012.0 in stage 281.0 (TID 2118086, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3856.0 in stage 281.0 (TID 2116754, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5564.0 in stage 281.0 (TID 2116939, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5165.0 in stage 281.0 (TID 2118158, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4988.0 in stage 281.0 (TID 2117675, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5022.0 in stage 281.0 (TID 2117694, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5152.0 in stage 281.0 (TID 2118096, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5019.0 in stage 281.0 (TID 2116727, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5068.0 in stage 281.0 (TID 2117687, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3669.0 in stage 281.0 (TID 2116711, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5394.0 in stage 281.0 (TID 2117440, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5097.0 in stage 281.0 (TID 2116832, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5285.0 in stage 281.0 (TID 2116983, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4957.0 in stage 281.0 (TID 2118069, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5471.0 in stage 281.0 (TID 2117484, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 281.0 (TID 2117476, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5199.0 in stage 281.0 (TID 2117681, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5579.0 in stage 281.0 (TID 2117321, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5143.0 in stage 281.0 (TID 2118032, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2920.0 in stage 281.0 (TID 2116647, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2921.0 in stage 281.0 (TID 2114963, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4601.0 in stage 281.0 (TID 2118091, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5609.0 in stage 281.0 (TID 2117976, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4548.0 in stage 281.0 (TID 2118180, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5597.0 in stage 281.0 (TID 2117966, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5566.0 in stage 281.0 (TID 2116957, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5332.0 in stage 281.0 (TID 2117109, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4953.0 in stage 281.0 (TID 2116715, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4583.0 in stage 281.0 (TID 2118078, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5230.0 in stage 281.0 (TID 2117803, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6370.0 in stage 281.0 (TID 2106622, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5123.0 in stage 281.0 (TID 2116860, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5233.0 in stage 281.0 (TID 2117804, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5080.0 in stage 281.0 (TID 2116767, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4539.0 in stage 281.0 (TID 2118050, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5121.0 in stage 281.0 (TID 2116855, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4505.0 in stage 281.0 (TID 2118157, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5237.0 in stage 281.0 (TID 2117805, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5251.0 in stage 281.0 (TID 2109504, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5616.0 in stage 281.0 (TID 2118008, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5492.0 in stage 281.0 (TID 2117508, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2924.0 in stage 281.0 (TID 2114966, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5223.0 in stage 281.0 (TID 2117801, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3040.0 in stage 281.0 (TID 2115776, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4998.0 in stage 281.0 (TID 2117691, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4365.0 in stage 281.0 (TID 2117979, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4926.0 in stage 281.0 (TID 2118174, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2910.0 in stage 281.0 (TID 2116580, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4593.0 in stage 281.0 (TID 2118185, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5227.0 in stage 281.0 (TID 2117802, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5300.0 in stage 281.0 (TID 2113132, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2932.0 in stage 281.0 (TID 2115122, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4558.0 in stage 281.0 (TID 2118181, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2930.0 in stage 281.0 (TID 2114968, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2914.0 in stage 281.0 (TID 2116608, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3998.0 in stage 281.0 (TID 2118083, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 281.0 (TID 2117549, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5008.0 in stage 281.0 (TID 2116458, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5221.0 in stage 281.0 (TID 2116943, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5412.0 in stage 281.0 (TID 2116749, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4586.0 in stage 281.0 (TID 2118183, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5159.0 in stage 281.0 (TID 2118193, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2908.0 in stage 281.0 (TID 2115117, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5302.0 in stage 281.0 (TID 2113203, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5545.0 in stage 281.0 (TID 2116924, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2907.0 in stage 281.0 (TID 2116558, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6328.0 in stage 281.0 (TID 2115370, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5469.0 in stage 281.0 (TID 2116842, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5006.0 in stage 281.0 (TID 2114930, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2913.0 in stage 281.0 (TID 2115121, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5402.0 in stage 281.0 (TID 2117572, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5325.0 in stage 281.0 (TID 2112755, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2925.0 in stage 281.0 (TID 2116658, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(2895 + 105) / 8878][Stage 283:(2305 + 120) / 8878][Stage 284:(2469 + 68) / 8878]WARN TaskSetManager - Lost task 4018.0 in stage 281.0 (TID 2118088, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2917.0 in stage 281.0 (TID 2116671, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4398.0 in stage 281.0 (TID 2118006, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5301.0 in stage 281.0 (TID 2112929, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4225.0 in stage 281.0 (TID 2118191, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5004.0 in stage 281.0 (TID 2117693, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4976.0 in stage 281.0 (TID 2118085, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2926.0 in stage 281.0 (TID 2116672, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 3355.0 in stage 281.0 (TID 2115778, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4483.0 in stage 281.0 (TID 2118144, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7557.0 in stage 281.0 (TID 2115509, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6383.0 in stage 281.0 (TID 2110200, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7605.0 in stage 281.0 (TID 2112980, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4989.0 in stage 281.0 (TID 2118087, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8616.0 in stage 281.0 (TID 2104472, trantor12.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8639.0 in stage 281.0 (TID 2108026, trantor05.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2931.0 in stage 281.0 (TID 2102540, trantor02.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7537.0 in stage 281.0 (TID 2115063, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5248.0 in stage 281.0 (TID 2113228, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4786.0 in stage 281.0 (TID 2118159, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6363.0 in stage 281.0 (TID 2113315, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6344.0 in stage 281.0 (TID 2110003, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(2900 + 106) / 8878][Stage 283:(2318 + 113) / 8878][Stage 284:(2470 + 70) / 8878]WARN TaskSetManager - Lost task 4956.0 in stage 281.0 (TID 2116717, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4757.0 in stage 281.0 (TID 2118156, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 8712.0 in stage 281.0 (TID 2115633, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7992.0 in stage 281.0 (TID 2115273, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5250.0 in stage 281.0 (TID 2113168, trantor06.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5324.0 in stage 281.0 (TID 2110905, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5310.0 in stage 281.0 (TID 2109471, trantor01.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(2903 + 107) / 8878][Stage 283:(2350 + 85) / 8878][Stage 284:(2481 + 64) / 8878]WARN TaskSetManager - Lost task 5232.0 in stage 281.0 (TID 2116963, trantor17.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(5925 + 297) / 8878][Stage 283:(3888 + 46) / 8878][Stage 284:(2660 + 17) / 8878]WARN TaskSetManager - Lost task 2685.0 in stage 273.0 (TID 2089222, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2708.0 in stage 273.0 (TID 2089226, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2701.0 in stage 273.0 (TID 2089225, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2694.0 in stage 273.0 (TID 2089223, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 2700.0 in stage 273.0 (TID 2089224, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6376.1 in stage 276.0 (TID 2089832, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(5925 + 303) / 8878][Stage 283:(3889 + 46) / 8878][Stage 284:(2660 + 17) / 8878]WARN TaskSetManager - Lost task 4330.1 in stage 277.0 (TID 2090083, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(5925 + 304) / 8878][Stage 283:(3889 + 46) / 8878][Stage 284:(2660 + 17) / 8878]WARN TaskSetManager - Lost task 4705.0 in stage 276.0 (TID 2089834, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4819.0 in stage 276.0 (TID 2099364, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 4670.0 in stage 276.0 (TID 2089833, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(6224 + 330) / 8878][Stage 283:(5663 + 28) / 8878][Stage 284:(2665 + 12) / 8878]WARN TaskSetManager - Lost task 5650.0 in stage 281.0 (TID 2118194, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(6252 + 338) / 8878][Stage 283:(5680 + 24) / 8878][Stage 284:(2668 + 9) / 8878]WARN TaskSetManager - Lost task 6707.0 in stage 282.0 (TID 2125332, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 282:(6278 + 337) / 8878][Stage 283:(5711 + 26) / 8878][Stage 284:(2669 + 8) / 8878]WARN TaskSetManager - Lost task 6631.0 in stage 282.0 (TID 2125305, trantor20.umiacs.umd.edu): java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:833)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:897)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.google.common.io.CountingInputStream.read(CountingInputStream.java:60)
at org.archive.util.zip.OpenJDK7InflaterInputStream.fill(OpenJDK7InflaterInputStream.java:242)
at org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:162)
at org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)
at org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)
at org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)
at java.io.InputStream.read(InputStream.java:101)
at org.warcbase.data.WarcRecordUtils.copyStream(WarcRecordUtils.java:128)
at org.warcbase.data.WarcRecordUtils.getContent(WarcRecordUtils.java:98)
at org.warcbase.spark.archive.io.GenericArchiveRecord.<init>(GenericArchiveRecord.scala:48)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at org.warcbase.spark.matchbox.RecordLoader$$anonfun$loadArchives$2.apply(RecordLoader.scala:45)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:389)
at scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[Stage 282:(6278 + 337) / 8878][Stage 283:(5712 + 26) / 8878][Stage 284:(2669 + 8) / 8878]WARN TaskSetManager - Lost task 2886.0 in stage 281.0 (TID 2116532, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
[Stage 282:(6285 + 338) / 8878][Stage 283:(5713 + 26) / 8878][Stage 284:(2669 + 8) / 8878]ERROR YarnScheduler - Lost executor 86 on trantor20.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6355.0 in stage 270.0 (TID 2082929, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 86 lost)
WARN TaskSetManager - Lost task 2721.0 in stage 272.0 (TID 2089854, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 86 lost)
WARN TaskSetManager - Lost task 2721.0 in stage 281.0 (TID 2087771, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 86 lost)
WARN TaskSetManager - Lost task 6707.1 in stage 282.0 (TID 2125396, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 86 lost)
WARN TaskSetManager - Lost task 2721.0 in stage 282.0 (TID 2099969, trantor20.umiacs.umd.edu): ExecutorLostFailure (executor 86 lost)
[Stage 282:(6325 + 340) / 8878][Stage 283:(5715 + 28) / 8878][Stage 284:(2670 + 7) / 8878]ERROR YarnScheduler - Lost executor 106 on trantor21.umiacs.umd.edu: remote Akka client disassociated
WARN TaskSetManager - Lost task 6463.0 in stage 282.0 (TID 2125310, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 106 lost)
WARN TaskSetManager - Lost task 6342.0 in stage 282.0 (TID 2125241, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 106 lost)
WARN TaskSetManager - Lost task 6389.0 in stage 282.0 (TID 2125297, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 106 lost)
WARN TaskSetManager - Lost task 6438.0 in stage 282.0 (TID 2125300, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 106 lost)
WARN TaskSetManager - Lost task 6368.0 in stage 282.0 (TID 2125296, trantor21.umiacs.umd.edu): ExecutorLostFailure (executor 106 lost)
[Stage 282:(6333 + 335) / 8878][Stage 283:(5740 + 28) / 8878][Stage 284:(2670 + 7) / 8878]WARN TaskSetManager - Lost task 6707.2 in stage 282.0 (TID 2125486, trantor20.umiacs.umd.edu): com.esotericsoftware.kryo.KryoException: Error during Java deserialization.
Serialization trace:
ISO8601 (org.warcbase.spark.archive.io.GenericArchiveRecord)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:42)
at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:648)
at com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:605)
at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
at org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:138)
at org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
at org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at org.apache.spark.storage.MemoryStore.unrollSafely(MemoryStore.scala:248)
at org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:172)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:79)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.ZippedPartitionsRDD2.compute(ZippedPartitionsRDD.scala:88)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
at org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:70)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.StreamCorruptedException: invalid stream header: 79737200
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:301)
at com.esotericsoftware.kryo.serializers.JavaSerializer.read(JavaSerializer.java:40)
... 41 more
[Stage 282:(6338 + 335) / 8878][Stage 283:(5747 + 28) / 8878][Stage 284:(2670 + 7) / 8878]ERROR TaskSetManager - Task 6707 in stage 282.0 failed 4 times; aborting job
WARN TaskSetManager - Lost task 5693.0 in stage 282.0 (TID 2125476, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5720.0 in stage 282.0 (TID 2125416, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6570.0 in stage 282.0 (TID 2125412, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5635.0 in stage 282.0 (TID 2125401, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5709.0 in stage 282.0 (TID 2125402, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6706.0 in stage 282.0 (TID 2125322, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5571.0 in stage 282.0 (TID 2124461, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5573.0 in stage 282.0 (TID 2125430, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5586.0 in stage 282.0 (TID 2124420, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5770.0 in stage 282.0 (TID 2125441, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6575.0 in stage 282.0 (TID 2124687, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5721.0 in stage 282.0 (TID 2124255, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5533.0 in stage 282.0 (TID 2124765, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5561.0 in stage 282.0 (TID 2125382, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5474.0 in stage 282.0 (TID 2125233, trantor24.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5783.0 in stage 282.0 (TID 2125255, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6589.0 in stage 282.0 (TID 2125279, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5808.0 in stage 282.0 (TID 2125269, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5828.0 in stage 282.0 (TID 2125344, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5779.0 in stage 282.0 (TID 2125444, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6557.0 in stage 282.0 (TID 2124609, trantor20.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5422.0 in stage 282.0 (TID 2125201, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5407.0 in stage 282.0 (TID 2124398, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5769.0 in stage 282.0 (TID 2124465, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6528.0 in stage 282.0 (TID 2125314, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5111.0 in stage 282.0 (TID 2123333, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5644.0 in stage 282.0 (TID 2125226, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5798.0 in stage 282.0 (TID 2124738, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5751.0 in stage 282.0 (TID 2124924, trantor07.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5926.0 in stage 282.0 (TID 2125234, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5416.0 in stage 282.0 (TID 2125097, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5806.0 in stage 282.0 (TID 2125443, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5557.0 in stage 282.0 (TID 2125420, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5787.0 in stage 282.0 (TID 2125230, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5657.0 in stage 282.0 (TID 2125242, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5636.0 in stage 282.0 (TID 2125414, trantor19.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6510.0 in stage 282.0 (TID 2099705, trantor18.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5621.0 in stage 282.0 (TID 2125019, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5767.0 in stage 282.0 (TID 2125405, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5291.0 in stage 282.0 (TID 2124167, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5760.0 in stage 282.0 (TID 2124258, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5398.0 in stage 282.0 (TID 2124116, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5821.0 in stage 282.0 (TID 2125248, trantor04.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5685.0 in stage 282.0 (TID 2125179, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5748.0 in stage 282.0 (TID 2124628, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5730.0 in stage 282.0 (TID 2125335, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5661.0 in stage 282.0 (TID 2125281, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5792.0 in stage 282.0 (TID 2125410, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5476.0 in stage 282.0 (TID 2125243, trantor23.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5411.0 in stage 282.0 (TID 2124509, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5945.0 in stage 282.0 (TID 2125449, trantor09.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5510.0 in stage 282.0 (TID 2125399, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 7809.0 in stage 282.0 (TID 2125337, trantor00.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5599.0 in stage 282.0 (TID 2124857, trantor15.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5487.0 in stage 282.0 (TID 2125210, trantor10.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 6532.0 in stage 282.0 (TID 2125372, trantor21.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5796.0 in stage 282.0 (TID 2125419, trantor14.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5898.0 in stage 282.0 (TID 2124889, trantor08.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5504.0 in stage 282.0 (TID 2125244, trantor03.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task 5570.0 in stage 282.0 (TID 2125287, trantor22.umiacs.umd.edu): TaskKilled (killed intentionally)
WARN TaskSetManager - Lost task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment